WO2019109326A1

WO2019109326A1 - Page cache processing method and device, and server

Info

Publication number: WO2019109326A1
Application number: PCT/CN2017/115189
Authority: WO
Inventors: 周建平; 陈于康; 马海波
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2017-12-08
Filing date: 2017-12-08
Publication date: 2019-06-13
Also published as: CN108780458A

Abstract

Provided are a page cache processing method and device, a back-end application server and a server. The method comprises: when an access instruction sent by a user terminal is acquired, pre-determining whether there is a cache matching the access instruction in a shared memory; if so, feeding the cache content back to the user terminal; if not, determining whether there is a cache matching the access instruction in a cache server; if so, feeding the cache content back to the user terminal; and also if not, a back-end application server taking content corresponding to the access instruction, and feeding the data taken back to the user terminal. Therefore, the response speed of a system is increased, and the data throughput thereof is increased.

Description

Page cache processing method, device and server

Technical field

The present application relates to the field of computer network technologies, and in particular, to a page cache processing method, apparatus, and server.

Background technique

In the prior art, when the user needs to access a web address, the user terminal sends an access instruction to the server corresponding to the website. When the server of the website obtains the instruction, the back end application server retrieves and feeds back and accesses the instruction to the user terminal. Match the page data.

For a server with a large amount of access, because the access volume is huge, the server needs a certain processing time every time an access request is processed. Therefore, the data throughput is low when the server has a large flow and high concurrent situation, and It is difficult to achieve a quick response to access commands.

Summary of the invention

In view of this, the present invention provides a page cache processing method, apparatus, and server.

To achieve the above object, the present invention provides the following technical solutions:

A page cache processing method includes:

Obtain an access instruction;

Returning the cached content when there is a cache corresponding to the access instruction in the shared memory;

If the shared memory does not have a cache corresponding to the access instruction, determining whether a cache corresponding to the access instruction exists in the cache server;

Returning the cached content when there is a cache corresponding to the access instruction in the cache server;

If the cache server does not have a cache corresponding to the access instruction, the backend application server retrieves and returns content that matches the access instruction.

A page cache processing device includes:

An instruction acquisition unit, configured to acquire an access instruction;

a shared memory unit that returns a cached content when there is a cache corresponding to the access instruction in the shared memory;

a first determining unit, configured to: if the shared memory does not have a cache corresponding to the access instruction Determining whether there is a cache corresponding to the access instruction in the cache server;

a cache unit, configured to return a cached content when a cache corresponding to the access instruction exists in the cache server;

And a backend data retrieving unit, configured to: retrieve, by the backend application server, content that matches the access instruction, if the cache server does not have a cache corresponding to the access instruction.

A server, comprising the page cache processing device of any of the above.

According to the foregoing technical solution, the embodiment of the present invention provides a method, a device, and a server for processing a page cache. The method determines the shared memory in advance by acquiring an access instruction sent by the user terminal. Whether the cache matching the access command, if present, feeds back the cached content to the user terminal, and if not, determines whether there is a cache matching the access command in the cache server, and if so, feedback to the user terminal If the cached content does not exist, the content corresponding to the access command is retrieved by the backend application server, and the retrieved data is fed back to the user terminal. It can be seen that, when the user accesses the webpage, the corresponding cached content is preferentially retrieved from the shared memory and the cache server, and only if the corresponding cached content does not exist in the shared memory and the cache server, The backend application server retrieves data corresponding to the access instruction, thereby improving the response speed of the system and increasing the data throughput thereof.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is an embodiment of the present invention, and those skilled in the art can obtain other drawings according to the provided drawings without any creative work.

FIG. 1 is a schematic flowchart of a page cache processing method according to an embodiment of the present application;

2 is a schematic flowchart of a page cache processing method according to another embodiment of the present disclosure;

FIG. 3 is a schematic structural diagram of a page cache processing apparatus according to an embodiment of the present disclosure.

Detailed ways

The technical solution in the embodiment of the present invention will be clarified in the following with reference to the accompanying drawings in the embodiments of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS It is apparent that the described embodiments are only a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

In order to improve the response speed of the web application framework in the case of high traffic and high concurrency, and improve its throughput, the present application discloses a page cache processing method, apparatus and server.

As shown in FIG. 1 , the specific operation process of the page cache processing method disclosed in this embodiment of the present application may include:

Step S101: Acquire an access instruction;

The access command is an access command generated according to an access request sent by the user terminal, and the user terminal may refer to a computer, a mobile phone, etc., when the user accesses the webpage by using the user terminal, sending an access instruction to the server side of the webpage. The access request may include the accessed URL and the country. In the method, the generated key may be used as an access command according to the URL (Uniform Resource Locator) and the corresponding key generated by the country. The server side may retrieve a target webpage that matches the URL and the country according to the key.

Taking the e-commerce page as an example, the access users may come from various countries in the world, and the common language and text of each country are different. Therefore, in order to facilitate the normal browsing of pages by users in various countries, the technical solutions disclosed in the present application may be used. A Uniform Resource Identifier corresponds to multiple pages, each page corresponds to a different country or a combination of countries and languages, and the URL of the access request and the country or a unique key corresponding to the URL, country, and language, by the unique The key can determine the landing page corresponding to this access request.

Step S102: determining whether there is a cache matching the access command stored in the shared memory, and if so, executing step S103, otherwise executing step S104;

The shared memory can be implemented by a web cache technology, which refers to a copy of a web resource (page html, data, etc.) existing between the server and the client. The cache will save a copy of the output according to the incoming request; when the next request comes, obtain the URL and country of the request, and determine whether the two requests (the next request and the last request) have the same URL, if The same URL, the cache will decide whether to use the copy to respond to the access request directly or according to the caching mechanism, or send the request to the server again.

Based on the web cache, in the technical solution disclosed in the embodiment of the present application, the shared memory is used to store a copy of a page corresponding to the access instruction, and the copy of the page is used as a cache of the shared memory. Content, that is, in the present application, the cached copy in the shared memory is a complete webpage content, and when an access instruction sent by the user terminal is obtained, it is determined whether the shared memory has a copy of the page accessed by the access instruction, That is, it is determined whether there is a copy of the webpage corresponding to the URL of the access command and the country in the shared memory, and if yes, executing step S103, directly sending a copy of the webpage to the user without performing data interaction with the server terminal.

In the technical solution disclosed in the embodiment of the present application, the cached content in the shared memory may be set according to user requirements, for example, it may include a copy of the page accessed in the most recent preset time period, and the access frequency exceeds a set value. A copy of the page, a copy of the page of the preset specific page, or a copy of the page with a visit amount greater than the preset value in the most recent period of time.

Step S103: Extracting a cache in the shared memory that matches the access instruction, and feeding back the cache to the user terminal;

When there is a cache corresponding to the access instruction in the shared memory, the corresponding cache is directly retrieved from the shared memory, and the cache is fed back to the mobile terminal as response data of the access command.

Further, when the cached content in the shared memory is not updated in a long period of time, or the content is invalid due to other reasons, the content that cannot be fed back to the user or fed back to the user may be caused. Determining, when the cached content matches the access instruction, whether the cached content corresponding to the access instruction is valid, and if so, extracting and returning the cached content to the user terminal, if the cached content is invalid If the cached content corresponding to the access command does not exist in the shared memory, step S104 is performed.

Step S104: determining whether there is a cache corresponding to the access instruction in the cache server, and if so, executing step S105, otherwise, performing step S106;

In this step, when there is no copy of the page corresponding to the access instruction in the shared memory, the cached content in the cache server in the server is screened to determine whether the cached content of the cache server exists. A copy of the page matching the access command, and then performing the corresponding subsequent steps according to the judgment result.

In the technical solution disclosed in the embodiment of the present application, the cache server may be referred to as a redis database, and the cached content in the redis database may be set according to user requirements, for example, it may include access within a preset preset time period. A copy of the page, the page access frequency that exceeds the set value A copy of the page of the preset, specific page, or a copy of the page whose visit amount is greater than the preset value in the most recent period of time.

Step S105: Extract a cache matching the access instruction in the cache server, and feed the cache to the user terminal;

Further, when the cached content in the cache server is not updated in a long period of time, or the content is invalid due to other reasons, the content that cannot be fed back to the user or fed back to the user may be caused. Determining whether the cache corresponding to the access instruction is valid when there is a cache corresponding to the access instruction in the cache server, and if yes, returning the cache content to the user terminal, and if not, determining that the cache server does not exist and The cache corresponding to the access instruction is executed, and step S106 is performed.

Step S106: Retrieving and returning to the user terminal the content matching the access instruction by the backend application server;

All the webpage content is stored in the backend application server, and when the shared memory and the cache server do not find a copy of the webpage matching the access instruction, the database may be directly retrieved from the database in the backend application server. The webpage corresponding to the access instruction is fed back to the user terminal, and the feedback content can also be written into the cache server or the shared memory.

In the above solution, after obtaining the access instruction sent by the user terminal, it is determined in advance whether there is a cache matching the access command in the shared memory, and if so, the cached content is fed back to the user terminal, and if not, the cache server is determined. Whether there is a cache matching the access instruction, if yes, feeding back the cached content to the user terminal, if not, the content corresponding to the access instruction is retrieved by the backend application server, and the content is retrieved The data arrived is fed back to the user terminal. It can be seen that, when the user accesses the webpage, the corresponding cached content is preferentially retrieved from the shared memory and the cache server, and only when the corresponding cached content does not exist in the shared memory and the cache server. The backend application server retrieves data corresponding to the access instruction, thereby improving the response speed of the system and increasing the data throughput thereof.

In the technical solution disclosed in the foregoing embodiment of the present application, in order to facilitate foreign users to access webpages and improve the efficiency of foreign users accessing webpages, a shared memory and a cache server may be preset for each country, and the shared memory and cache server only accept the country. User access instructions for users in the country When accessing the webpage, the access instruction is sent to the shared memory in advance, and when there is no corresponding cache in the shared memory, the access instruction is sent to the cache server, and when there is no corresponding cache in the cache server, the access is accessed again. The instructions are sent to the backend application server. And in order to achieve fast data transfer and improve access speed, the shared memory, the cache server, and the back-end application server may use a network dedicated line, that is, a shared memory, a cache server, and a back-end application server through a dedicated The data transmission channel communicates.

In the technical solution disclosed in the embodiment of the present application, the cached content in the shared memory and the cache server may be set according to different rules. That is, the server side stores the cache data in a server-side cache layer, for example, storing static page data in the shared memory and the cache server. The shared memory is taken first, then the cache server, and if the shared memory and the cache server do not hit the access instruction, the source is returned to the backend application server.

Preferably, in the technical solution disclosed in the foregoing embodiment of the present application, when the content matched by the access instruction is retrieved by the backend application server, the user terminal directly feeds back the user when the access command is received again. The content of the technical solution disclosed in the foregoing embodiment of the present application may further include:

And the content that is matched by the backend application server and matched with the access instruction is written into the cache server. At this time, the data content stored in the cache server is the content that has been accessed in the most recent preset time period.

Preferably, in the technical solution disclosed in the foregoing embodiment of the present application, the cached content in the shared memory may be hot data, and the hot data is data content whose access frequency is greater than a set value. In order to facilitate the timely update of the hot data, in the method disclosed in the foregoing embodiment of the present application, referring to FIG. 2, when the cache server or the backend application server feeds back the content to the user terminal, the method may further include:

Step S201: Counting the access frequency of the accessed content corresponding to the obtained access instruction;

Step S202: determining whether the access frequency is greater than a set value, and if yes, continuing execution.

Step S203: Store the access content in the shared memory.

When the access frequency of the access content is counted, the specific process may be: parsing the obtained access instruction, and obtaining the target webpage corresponding to each access instruction, specifically, may be included by the access instruction. Determining the target webpage by using a URL, a country or a URL, a country, and a language. When the target webpage is determined, determining whether the target webpage exists in the preset access list, and if yes, the visit amount of the target webpage is increased by 1, if not The target webpage is added to the preset access list, and the access amount of the target webpage is increased by one, and the access frequency of each target webpage is calculated according to the obtained time of each access instruction, and the target is obtained. The frequency of access to a web page is the frequency of access to the content. When it is determined that the access frequency is greater than the set value, after the content corresponding to the access instruction is fed back to the user terminal by the cache server or the backend application server, the access command may also be matched. Content is written to the shared memory. The user access instruction may pass through the shared memory before being transmitted to the backend application server. Therefore, in the embodiment of the present application, the preset access list may be set on the shared memory end.

Preferably, in order to facilitate the sharing of the non-thermal data in the shared memory, the method may further include: real-time counting the access frequency of each cached data in the shared memory, and detecting that the access frequency of a cached content is lower than the set frequency. When the value is set, the cached content is moved out of the shared memory.

In actual use, the back-end application server operation and maintenance personnel may update and adjust certain configuration contents on the page. For example, the operation and maintenance personnel need to launch new products or downline some old products; or the back-end application server. The operation and maintenance personnel set a timed task in the background, for example, a delivery reminder or an appointment reminder is periodically generated in the webpage, so that the configuration content in the page stored in the backend application server is adjusted according to the timing task, in order to update the shared memory in time. And the cached page in the cache server, the above method may further include:

When the data content stored in the backend application server is changed, the content of the webpage corresponding to the backend application server is changed. At this time, if the content in the shared memory and the cache server is not updated, the user is shared by the user. The erroneous data is obtained in the memory and the cache server. In order to provide a better user experience for the user, the technical solution disclosed in the embodiment of the present application can also monitor the data content of the back-end application database in real time, and after the judgment Whether the content in the application database is updated, if yes, the page corresponding to the updated content in the backend application database is calculated according to the mapping relationship between the preset model and the page, and the content of the page is updated, and the shared memory is determined. And/or whether the page is stored in the cache server, and if so, the shared memory and the page stored in the cache server are updated according to the updated page of the backend application server.

The following describes the above page update method by e-commerce page:

A preset model relationship is stored in the backend application server, and the model relationship refers to goods and pages. The mapping relationship between the product and the product, by recording the model relationship, when the parameters of a certain product corresponding to the stored page in the backend application server are adjusted, the associated page cache data referenced by the backend application server needs to be updated. The page content of the page stored in the backend application server corresponding to the item is adjusted by the model relationship. Determining whether the updated page is cached in the shared mitigation/cache server, and if so, updating the shared memory and the page stored in the cache server according to the updated page of the backend application server.

Corresponding to the foregoing method, the present application further discloses a page cache processing apparatus. Referring to FIG. 3, the apparatus may be applied to a shared memory and a cache server. Specifically, the apparatus may include:

The instruction collection unit 100 is configured to acquire an access instruction;

The shared memory unit 200 returns the cached content when there is a cache corresponding to the access instruction in the shared memory;

The first determining unit 300 is configured to determine, if the shared memory does not have a cache corresponding to the access instruction, whether there is a cache corresponding to the access instruction in the cache server;

The cache unit 400 is configured to: when the cache corresponding to the access instruction exists in the cache server, return the cache content;

The backend data retrieval unit 500 is configured to send a user access instruction to the backend application server when the cache server does not have a cache corresponding to the access instruction, to be retrieved and returned by the backend application server. The content of the access instruction matches.

Preferably, the backend data retrieval unit 500 is further configured to: after being retrieved by the backend application server and returned to the content matching the access instruction,

And the content that is matched by the backend application server and matched with the access instruction is written into the cache server.

Preferably, after the backend data retrieval unit retrieves and returns the content matching the access instruction, the backend data retrieval unit is further configured to:

And the content that is matched by the backend application server and matched with the access instruction is written into the shared memory.

Preferably, the instruction collection unit 100 is specifically configured to:

Parsing the access request input by the obtained user terminal, obtaining the URL of the required access and The country ID or URL, country ID, and language generate a corresponding key according to the accessed URL and country ID or URL, country ID, and language, and use the key as an access instruction.

Preferably, the above apparatus further includes:

A hot page cache unit for storing pages that meet the set conditions in the shared memory. Specifically, the hotspot page buffer unit is configured to: perform real-time statistics on the access frequency of the accessed content corresponding to the obtained access instruction, and store the content in the shared memory when determining that the access frequency of the content is greater than the set value. When the access frequency of the access content is counted, the specific process may be: parsing the obtained access instruction, and obtaining the target webpage corresponding to each access instruction, specifically, the URL and the country or the URL and the country ID included in the access instruction. And determining, by the language, the target webpage, if the target webpage is determined, determining whether the target webpage exists in the preset access list, and if yes, the visit amount of the target webpage is increased by 1, if not, the preset accessing The target webpage is added to the list, and the access volume of the target webpage is increased by one. According to the obtained time of each access instruction, the access frequency of each target webpage is calculated, and the access frequency of the target webpage is the access content. Frequency of visits. When it is determined that the access frequency is greater than the set value, after the content corresponding to the access instruction is fed back to the user terminal by the cache server or the backend application server, the content that can also be matched with the access instruction Write to the shared memory.

The hotspot page buffer unit may be further configured to perform real-time statistics on the access frequency of each cached data in the shared memory. When detecting that the access frequency of a cached content is lower than a set value, the cached content is moved out of the shared memory.

Preferably, corresponding to the foregoing method, the shared memory unit is specifically configured to:

Determining, when the cached content corresponding to the access instruction exists in the shared memory, whether the cached content corresponding to the access instruction is valid, and if yes, returning the cached content, and if not, determining that the shared memory does not exist and the accessing instruction Corresponding cache content.

Preferably, corresponding to the foregoing method, the cache unit is specifically configured to:

When there is a cache corresponding to the access instruction in the cache server, determining whether the cache corresponding to the access instruction is valid, and if yes, returning the cache content, and if not, determining that there is no corresponding to the access instruction in the cache server Cache.

Corresponding to the above method, the foregoing apparatus may further include:

An update unit for judging whether the content in the backend application database is updated, and if so, according to the pre The mapping relationship between the model and the page is calculated to obtain a page corresponding to the updated content in the backend application database, and the cache in the shared memory and the cache server is refreshed according to the updated content and the page corresponding to the updated content.

Corresponding to the above apparatus, the present application also discloses a server that applies the page buffer processing apparatus according to any one of the above items.

Finally, it should also be noted that in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities. There is any such actual relationship or order between operations. Furthermore, the term "comprises" or "comprises" or "comprises" or any other variations thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device that comprises a plurality of elements includes not only those elements but also Other elements, or elements that are inherent to such a process, method, item, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

The various embodiments in the present specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same similar parts between the various embodiments may be referred to each other.

The above description of the disclosed embodiments enables those skilled in the art to make or use the application. Various modifications to these embodiments are obvious to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the application. Therefore, the application is not limited to the embodiments shown herein, but is to be accorded the broadest scope of the principles and novel features disclosed herein.

Claims

A page cache processing method, comprising:

Obtain an access instruction;

Returning the cached content when there is a cache corresponding to the access instruction in the shared memory;

If the shared memory does not have a cache corresponding to the access instruction, determining whether a cache corresponding to the access instruction exists in the cache server;

Returning the cached content when there is a cache corresponding to the access instruction in the cache server;

If the cache server does not have a cache corresponding to the access instruction, the backend application server retrieves and returns content that matches the access instruction.
The page cache processing method according to claim 1, wherein after the backend application server retrieves and returns the content that matches the access instruction, the method further includes:

And the content that is matched by the backend application server and matched with the access instruction is written into the cache server.
The page cache processing method according to claim 1, wherein after the backend application server retrieves and returns the content that matches the access instruction, the method further includes:

And the content that is matched by the backend application server and matched with the access instruction is written into the shared memory.
The method of processing a page cache according to claim 1, wherein the obtaining an access instruction comprises:

Obtaining the accessed URL and the country ID, generating a corresponding key according to the URL and the country ID, and using the key as an access instruction.
The page buffer processing method according to claim 1, wherein the shared memory stores a page whose access frequency satisfies a setting condition.
The page buffer processing method according to claim 5, wherein the setting condition is that the access frequency is greater than a preset value.
The page cache processing method according to claim 1, wherein when there is a cache corresponding to the access instruction in the shared memory, the cached content is returned, which specifically includes:

Determining a pair with the access instruction when there is a cache corresponding to the access instruction in the shared memory Whether the cache should be valid, if yes, return the cache content, if not, determine that there is no cache corresponding to the access command in the shared memory.
The page cache processing method according to claim 1, wherein when the cache corresponding to the access instruction exists in the cache server, the cached content is returned, which specifically includes:

When there is a cache corresponding to the access instruction in the cache server, determining whether the cache corresponding to the access instruction is valid, and if yes, returning the cache content, and if not, determining that there is no corresponding to the access instruction in the cache server Cache.
The page caching method according to claim 1, wherein each cache server and shared memory correspond to one country, that is, each cache server and shared server are responsive to access commands of users in their corresponding countries.
The page caching method according to claim 1, wherein each of the cache servers and the shared memory and the backend application server exchange data through a dedicated line.
The page caching method according to claim 1, further comprising:

Determining whether the content in the back-end application database is updated. If yes, calculating, according to the mapping relationship between the preset model and the page, the page corresponding to the updated content in the back-end application database, according to the updated content and the page corresponding to the updated content. Refresh the cache in the shared memory and cache server.
A page cache processing device, comprising:

An instruction acquisition unit, configured to acquire an access instruction;

a shared memory unit that returns a cached content when there is a cache corresponding to the access instruction in the shared memory;

a first determining unit, configured to determine, if the shared memory does not have a cache corresponding to the access instruction, whether a cache corresponding to the access instruction exists in the cache server;

a cache unit, configured to return a cached content when a cache corresponding to the access instruction exists in the cache server;

And a backend data retrieving unit, configured to: retrieve, by the backend application server, content that matches the access instruction, if the cache server does not have a cache corresponding to the access instruction.
The page cache processing device according to claim 12, wherein the backend data retrieving unit is further configured to: after the backend application server retrieves and returns the content that matches the access instruction,

Writing the content matching the access instruction to the backend application server to write the Cache server.
The page cache processing device according to claim 12, wherein the backend data retrieving unit is further configured to: after the backend application server retrieves and returns the content that matches the access instruction,

And the content that is matched by the backend application server and matched with the access instruction is written into the shared memory.
The page buffer processing device according to claim 12, wherein the instruction collection unit is specifically configured to:

Obtaining the accessed URL and the country ID, generating a corresponding key according to the URL and the country ID, and using the key as an access instruction.
The device for processing a page cache according to claim 15, further comprising:

A hot page cache unit for storing pages that meet the set conditions in the shared memory.
The page cache processing device according to claim 16, wherein the hot page cache unit is specifically configured to:

Store pages with access frequencies greater than the preset value in shared memory.
The page cache processing device according to claim 12, wherein the shared memory unit is specifically configured to:

When there is a cache corresponding to the access instruction in the shared memory, determining whether the cache corresponding to the access instruction is valid, and if yes, returning the cache content, and if not, determining that there is no corresponding to the access instruction in the shared memory Cache.
The page cache processing device according to claim 12, wherein the cache unit is specifically configured to:

When there is a cache corresponding to the access instruction in the cache server, determining whether the cache corresponding to the access instruction is valid, and if yes, returning the cache content, and if not, determining that there is no corresponding to the access instruction in the cache server Cache.
The page cache processing device according to claim 12, wherein the number of the shared memory unit and the cache unit is plural, and each shared memory unit and the cache unit correspond to one country, that is, each shared memory unit. And a cache unit is responsive to access instructions of users within its corresponding country.
A page buffering device according to claim 12, wherein each shared memory Data exchange between the unit and the cache unit and the backend data retrieval unit through a dedicated line.
The page caching apparatus according to claim 12, further comprising:

An update unit, configured to determine whether the content in the backend application database is updated, and if so, calculate a page corresponding to the updated content in the backend application database according to a mapping relationship between the preset model and the page, according to the updated content and The page corresponding to the update content refreshes the shared memory and the cache in the cache server.
A server characterized by using the page buffer processing apparatus according to any one of claims 12-22.