CN101539932A - Synchronization access technology of transforming web page - Google Patents

Abstract

The invention relates to a simultaneous access method for converted pages. The conversion engine converts the WEB pages returned by the network server according to the user's access request into WAP pages, returns the converted pages to the user and caches them, and receives the user's access to the page again. After the request, first check the availability of the cached converted page, if the cached converted page is available, then directly return the converted page to the user, if the cached converted page is not available, forward the user to the corresponding web server The page returned by the web server is converted and returned to the user, and the newly converted page can be re-cached to replace the original cached page in the buffer. The invention only needs to convert the same WEB page once in a suitable time period, which can meet the access requirements of multiple users for the same webpage, speed up the processing speed, save processing time and improve the processing capacity.

Description

Simultaneous access technology for converted pages

technical field

The invention relates to a simultaneous access method for converted pages, in particular to a simultaneous access method for multiple users to access the same website during the process of accessing a WEB website by a mobile terminal with a small screen such as a mobile phone through a WAP conversion engine (server) of the WWW.

Background technique

Existing mobile terminals with small screens such as mobile phones can only directly access WAP websites, and when accessing WEB websites, they need to convert the visited WEB pages into WAP pages. People provide possibilities according to the needs of different users and the existing technical background , various ways of converting webpages have been proposed. For example, China No. 03801966.3 invention application discloses a method for displaying HTML documents on the display screen of a mobile client terminal. formatting such that the width of the reformatted document is adapted to the width of a display screen and displaying said reformatted document on the display screen, wherein the step of reformatting the HTML document comprises converting table cells in the HTML document into blocks Level elements, and apply image screening/reduction and space character conversion methods to delete large images that are difficult to display and small images that do not need to be displayed, so that the converted page can be properly displayed on the mobile phone screen; another example is the Chinese invention patent 200710176543.9 The application discloses a method for allowing small-screen mobile terminals to access and browse WWW websites, which includes the following steps: (1) converting the web page file format into a format that meets the WAP standard; (2) folding the secondary part of the web page; (3) Re-layout to make the width of the webpage adapt to the width of the display screen of the mobile terminal. After the foldable block is folded, a hyperlink targeting the content of the foldable block is established at the corresponding position of the page, and the hyperlink is displayed at the corresponding position of the page. Link mark, this hyperlink mark is exactly described folding mark, when the user clicks on this hyperlink mark, then the corresponding foldable block is " unfolded ", is displayed on the display screen of mobile terminal, and this invention can move the page The display on the small display screen of the terminal is clearly displayed, and the secondary part is folded, which provides conditions for mobile terminals such as mobile phones to browse WWW websites.

However, although these existing technologies have all realized to a certain extent the access of mobile terminals with small screens such as mobile phones to WEB websites, it is necessary for the web server to perform a conversion on the webpage returned by each access request. WWW's WAP conversion engine (referred to as conversion engine) is realized. This conversion engine will face many users at the same time, so it is inevitable that multiple users visit the same WWW website at the same time or the same user repeatedly visits the same WWW website. The method of converting each user every time will undoubtedly cause the engine to convert the same web page repeatedly at the same time or in a short period, resulting in a waste of processing power of the conversion engine.

Contents of the invention

In order to overcome the above-mentioned defects of the prior art, the present invention provides a simultaneous access method for converted pages. After adopting this method, the conversion engine only needs to convert the same WEB page once in a suitable time period (synchronized). , it is possible to meet the access requirements of multiple users (including the same user multiple times, the same below) to the same web page.

The technical scheme of the present invention to achieve the above object is: a simultaneous access method for converted pages, the conversion engine converts the WEB pages returned by the network server according to the user's access request into WAP web pages, returns the converted pages to the user and caches them, and then After receiving the user's request to access the page, first check the availability of the cached converted page, if the cached converted page is available, then directly return the converted page to the user, if the cached converted page is not available, then The user's access request is forwarded to the corresponding web server, and the page returned by the web server is converted and returned to the user.

After the present invention converts a page according to the user's request, the converted page is stored in the cache, and after receiving the request to access the page again, the availability of the converted page of the cache is first checked, if the converted page of the cache is available, The converted page is directly returned to the user, thereby avoiding unnecessary repeated conversion, reducing the amount of data processing for page conversion, accelerating the processing speed, saving processing time, and improving processing capacity.

Detailed ways

According to the method provided by the invention, the technical processing process of conversion engine mainly comprises:

Step A, the conversion engine accepts the user's access request, obtains the URL, and crawls and converts the page;

Step B, the conversion engine caches the converted static page;

In step C, the conversion engine obtains a new user's access request to the same URL page or a same user's access request to the same URL page;

Step D, the conversion engine checks the availability of the cache for the conversion page stored in the buffer, if the page cache is available, then the conversion engine does not perform conversion, but directly returns the cached page to the new user, only when the page cache is not available, need to recrawl and convert the page, and return the converted page to the user;

Step E, generally, in the case of re-crawling and converting the corresponding page, the re-transformed static page should be stored in the cache, and the original cache page should usually be deleted.

Said checking the availability of the cached converted page includes checking the following:

(1) The cache of the specified URL page exists;

(2) The cached page is a non-dynamic web page;

(3) There is no difference in the conversion requirements of relevant users;

(4) The original web page will declare its own cache policy and cache period, and check that the cache on the server has not expired;

(5) Send a GET request to the original website of the URL, and obtain the returned status code 304.

You can determine cache validity and use cache in the following ways:

(6) There is a cache;

(7) The cache is visible (effective) to the current request;

(8) If it is a dynamic page, use the user's own cache; if it is a static page, use the public cache;

(9) The cache has not expired;

(10) If the cache exists but has expired, send a request with eTag to the server, and the server returns 304 to indicate that the cache can continue to be used, and update the cache information.

Claims (5)

1. A contemporaneous access method for converted pages, characterized in that the conversion engine converts the WEB pages returned by the web server according to the user's access request into WAP web pages, returns the converted pages to the user and caches them, and receives the user's access to the page again After the request of the page, first check the availability of the cached converted page, if the cached converted page is available, then directly return the converted page to the user, if the cached converted page is not available, then send the corresponding web server Forward the user's access request, convert the page returned by the web server and return it to the user. 2. The contemporaneous access method of conversion page as claimed in claim 1, is characterized in that comprising the following concrete steps: Step A, the conversion engine accepts the user's access request, obtains the URL, and crawls and converts the page; Step B, the conversion engine caches the converted static page; In step C, the conversion engine obtains a new user's access request to the same URL page or a same user's access request to the same URL page; Step D, the conversion engine checks the availability of the cache for the conversion page stored in the cache, if the page cache is available, the conversion engine directly returns the cached page to the new user, if the page cache is not available, re-crawls and converts the page, and return the converted page to the user. 3. The contemporaneous access method of conversion page as claimed in claim 2, is characterized in that also comprising: Step E, in the case of re-crawling and converting the corresponding page, store the re-transformed static page in the cache, and delete the original cache page. 4. The contemporaneous access method of converted pages as claimed in claim 1, 2 or 3, characterized in that said checking the availability of the cached converted pages includes checking the following: (1) The cache of the specified URL page exists; (2) The cached page is a non-dynamic web page; (3) There is no difference in the conversion requirements of relevant users; (4) The original web page will declare its own cache policy and cache period, and check that the cache on the server has not expired; (5) Send a GET request to the original website of the URL, and obtain the returned status code 304. 5. The contemporaneous access method of conversion page as claimed in claim 4, is characterized in that adopting following mode to judge cache effectiveness and use cache: (1) There is a cache; (2) The cache is visible (effective) to the current request; (3) If it is a dynamic page, use the user's own cache; if it is a static page, use the public cache; (4) The cache has not expired; (5) If the cache exists but has expired, send a request with eTag to the server, and the server returns 304 to indicate that the cache can continue to be used, and update the cache information.