KR20050004274A - Search engine, search system, method for making a database in a search system, and recording media - Google Patents

Abstract

The update date of the index page acquired by the circuit boat 3 is compared with the update date of the link destination, and when the link destination is new, the update date of the index page is replaced with the update date of the link page. The keyword extracted from the linked page is added to the keyword of the index page extracted by the circuit boat.

Description

Search engine, search system, database creation method and storage medium {SEARCH ENGINE, SEARCH SYSTEM, METHOD FOR MAKING A DATABASE IN A SEARCH SYSTEM, AND RECORDING MEDIA}

The present invention relates to a search engine for searching distributed data on a network, a search system, a database creation method in a search system, and a recording medium.

Altavista (http://www.altavista.com/), Lycos (http://www.lycos.com/), Yahoo! (http://www.yahoo.com There are many search engines on the network using robots. They use software that collects information over a network, mechanically called robots. The collected data is then databased (morphological analysis of the page information, the index table is created and stored in the database) so that the user can search the data.

The robot searches a sentence described in Hyper Text Markup Language (HTML) on a network, finds a link described therein, and collects data existing on the network. There are full-text searches for the database, but some search only for titles and URLs.

Since the said database is large, it may be distributed. However, since the quantity is large, it is a simple division and is not divided with any meaning.

In the search, keyword search is performed. In other words, a search is performed by inputting a language included in a sentence to be searched.

On the other hand, mirror sites are installed to reduce traffic by distributing the concentration of access to popular sites. For example, I-Server (http://www.pointcast.com/products/iserver.html) of Point Cast Network (PCN) manages mirror sites by prefetching information to PCN headquarters on a regular basis.

Conventionally, the following problems exist in a search engine for distributed data on a network.

(1) It is difficult to handle increasing data.

For example, page data on the World Wide Web (WWW) is said to be over 40 million in the world in 1996, and is expected to increase exponentially in the future. At present, the number of pages and the amount of data per page also tend to increase rapidly.

It is extremely difficult to manage the database simply by dividing such rapidly increasing data by quantity.

(2) Information with low update frequency tends to have less access. Pages with low update frequency tend to be outdated and have little access. For this reason, a retrieval system that preferentially displays pages with high update frequency is effective.

(3) When a domain or URL is registered in a conventional search engine, the robot traverses the domain or URL, and when the search keyword is extracted from the file extracted by the traversal, the update date is acquired at the same time. Then, the newness of the file is judged according to the acquired update date, and priority is given to the display of the search results.

However, in the case of the index page constituted by the frame tag, even if the page linked in each frame is updated, unless the index page is updated, the update date remains as it is, and there is a problem that the contents do not match the search result. In addition, in the case of a system in which a page with a low update frequency is excluded from the search object, there is a problem that a page corresponding to a frame is treated particularly disadvantageously.

The present invention has been invented in view of the above, and the correct update frequency information is changed by changing the update date of the expanded search target data scattered on the database network to the latest update date of the update date of the linked page. The purpose of the present invention is to provide a method for creating a database and a storage medium in a search engine, a search system, and a search system.

Another object of the present invention is to provide a database creation method and a storage medium in a search engine, a search system, and a search system that can acquire and add a keyword of a linked page to a keyword of a database indexed page. have.

1 is a diagram showing a configuration example of a search engine in one embodiment of the present invention;

2 is a diagram illustrating a configuration of an index page;

3 is a flowchart showing the operation of one embodiment of the present invention;

4 is a flowchart showing each operation of a circuit boat, a web server, and a user;

5 is a diagram illustrating an example of a screen for inputting a domain or URL to be registered;

6 is a diagram showing a screen example of a registered URL;

7 is a diagram showing a screen example when a keyword is input;

8 is a diagram illustrating a screen example of a search result by a search engine.

In order to achieve the above object, a search engine according to the present invention includes a database storing an index page including at least a URL (Uniform Resource Locator) or a domain, an update date, and a keyword in an index page of information on a network, and a designated domain. Or a circuit boat which traverses the database on the basis of a URL, obtains an update date of the index page and an update date of a page on a website linked from the index page, and the latest update date is an update date of the index page. It is composed.

In addition, the search engine according to the present invention, in the index page on the network, iterates through a database storing an index page including at least a Uniform Resource Locator (URL) or a domain and a keyword, and the database based on a specified domain or URL. And a circulation boat for acquiring the keywords of the index page and the page to be linked from the index page, and adding the keywords of the obtained page to the keywords of the index page.

In addition, the search system according to the present invention, in the index page of the information on the network, at least based on a database containing an index page containing a Uniform Resource Locator (URL) or domain, an update date, and a keyword, and a designated domain or URL. Iterating the database, obtaining an update date of the index page and an update date of a page on a website linked from the index page, and a circuit boat in which the latest update date is the update date of the index page, and the designated keyword. It is configured with an engine for searching the database.

In addition, the search system of the present invention, in the index page on the network, iterates over a database storing at least an index page including a Uniform Resource Locator (URL) or a domain and a keyword, and the database based on a designated domain or URL, A circulation boat for acquiring a keyword of a page to be linked from the index page, adding a keyword of the acquired page to a keyword of the index page, and a search engine for searching the database based on a specified keyword; It is configured by.

According to the present invention, there is provided an index page of information on a network, the database including at least a URL (Uniform Resource Locator) or a database storing an index page including a domain, an update date, and keywords, and performing a database search according to a search request. In the database creation method in the retrieval system, the database is traversed based on a specified domain or URL to obtain an update date of the index page and an update date from pages on a website linked from the index page, and the obtained update date. The latest update date of the index page is set as the update date.

According to the present invention, there is provided an index page of information on a network, comprising: a database including at least a URL or domain, an update date, and an index page including a keyword and performing a database search in accordance with a search request. In the method for creating a database, the database is traversed based on a specified domain or URL to obtain a keyword of the index page and a page to be linked from the index page, and convert the keyword of the obtained page to the keyword of the index page. It is characterized by adding.

According to the present invention, there is provided an index page of information on a network, the database including at least a URL (Uniform Resource Locator) or a database storing an index page including a domain, an update date, and keywords, and performing a database search according to a search request. A storage medium having a program for creating a database in a retrieval system on a computer, wherein the database is traversed based on a specified domain or URL to update the index page and pages on a website linked from the index page. The program for causing the computer to execute the procedure for acquiring the update date of the data and the procedure for setting the latest update date among the acquired update dates as the update date of the index page.

In addition, according to the present invention, in an index page of information on a network, a database including at least a URL (Uniform Resource Locator) or a domain storing an index page including a domain, an update date, and a keyword, and performs a database search according to a search request. A storage medium equipped with a program for creating a database in a computer in a retrieval system, wherein the database is traversed based on a specified domain or URL to obtain keywords of the index page and the page linked from the index page. And a program for causing the computer to execute the procedure to add the keyword of the acquired page to the keyword of the index page.

Also, the database traversal targets the same domain as the index page.

Further, the index page and the page to which the destination is linked are constituted by frame tags, and the latest update date of the pages in the frame is set as the update date of the index page.

According to the present invention, the update date of the index page acquired by the circuit boat is compared with the update date of the linked page, and when the update date of the linked page is new, the update date of the index page is replaced with the update date of the linked page. .

In addition, the keyword extracted from the linked page is added to the keyword of the index page extracted by the circulation boat.

In addition, the invention concerning each apparatus mentioned above is also established as a description about a method.

The invention also holds as a machine-readable medium storing a program for executing a corresponding procedure or means on a computer.

In the case of a robot traversal type search engine such as a flash eye, since the page linked to each frame is mainly updated without updating the index page for the frame-compatible page, the update frequency is treated as extremely low. According to the present invention, a search function similar to a non-frame page can be obtained even in a search service corresponding to a frame.

In addition, from the viewpoint of the efficiency of the database, in general, the larger the database, the more pages can be searched for, so that the amount of information increases and the bit rate also increases. However, if the registration is increased indefinitely, the number of search pages for one keyword also increases, making it difficult for the searcher to extract necessary information therefrom. According to the present invention, since the search information can be collected in the index page, efficient search is possible.

(Example)

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

First, the phrase is defined.

Page means a page of hypertext. In the world of WWW, a page has a unique URL.

URL (Uniform Resource Locator) is information required to access page data. The URL contains the protocol, domain name, port number, and path name information.

Robot is a collection of documents on the network from reading hypertext written documents such as Hyper Text Markup Language (HTML) or Standard Generalized Markup Languaged (SGML), and mechanically finding the links written there. Realized by software. Instead of robots, there are also called spiders or wanderers.

The basic operation of the robot is as follows.

(Step 1) Register the designated homepage in the visiting list.

(Step 2) The robot gets a page according to the visiting list.

(Step 3) The obtained page is analyzed and the URL is extracted.

(Step 4) Add the extracted URL to the visiting list (but do not register duplicate URL).

Thereafter, steps 2 to 4 are repeated. In addition, the acquisition frequency of the page may be determined according to the update frequency of the page.

Next, this embodiment is described.

In this embodiment, the page is treated as an example of data distributed in the network.

1 is a block diagram of an entire search system including a search engine of the present invention. As shown in the diagram, the network 1 is connected with a web server 9, 11, a user PC 13, a search server 19, and a search engine 21. FIG. The search engine 21 is composed of a circuit boat 3 (robot), a database 5, and an engine 17. The circuit boat 3 accesses a registered domain and URL, obtains an update date, and extracts a keyword. In addition, the linked page is accessed, an update date is obtained, and a keyword is extracted. The acquired update date and the extracted keyword are registered in the database 5. The database stores a visiting list of index pages. The index page is composed of, for example, a URL, a keyword, and attribute information as shown in FIG. 2, and the attribute information includes an update date. The engine 17 searches the database 5 based on the designated keyword. The search engine 19 is, for example, a search server 19 represented by Infoseek or the like.

Next, the operation of the search engine of the present invention will be described with reference to Figs.

First, a user creates a home page including a frame and uploads it to the web server 9 (11).

In step S1 of Fig. 3, the user registers a domain or URL. That is, on the screen of the user PC 13, a domain or URL input screen (registration screen of the search engine) as shown in FIG. 5, for example, is displayed. The user enters a search domain or URL and selects registration button 15. As a result, as shown in FIG. 4, the circuit boat 3 registers the domain or URL input by the user to the visiting list in the database 5. As shown in FIG.

Next, in step S3 of Fig. 3, access to the index page is performed. That is, as shown in FIG. 4, the circuit boat 3 transmits the registered domain or URL to the web server 11, and the web server accesses the index page based on the received domain or URL, and transmits to the circuit boat. do.

The circulation boat 3 acquires the update date A of the index page sent from the web server 11. Next, in step S7 of Fig. 3, keywords registered in the index page are extracted.

Next, in step S9 of Fig. 3, the link destination is accessed. That is, as shown in Fig. 4, the circuit boat 3 transmits the link destination access included in the index page to the web server 9 (11). The web server 9 (11) accesses the page of the link destination on the web server (9) 11 based on the link destination access, and transmits the page to the circuit boat 3. Next, in step S11 of FIG. 3, the update date B is acquired. In other words, as shown in Fig. 4, the circuit boat 3 acquires the update date B of the page to be linked, and further extracts the keyword. And in step S13 of FIG. 3, a comparison of update date A and B is performed, and an update date is updated in step S15. That is, as shown in Fig. 4, when the update date B of the linked page is larger (the date is new) than the update date A of the index page, the update date of the index page is B. In step S17 of FIG. 3, the keyword is extracted and added to the keyword of the index page in step S19. In step S21, it is determined whether or not the circulation has ended. If the circulation has not been completed, the process returns to step S9 to repeat steps S9 to S21 again.

On the other hand, if it is determined in step S21 that the circulation has ended, the circulation boat 3 registers the obtained update date and keywords in the database 5 in step S23.

FIG. 6 is a diagram showing an example in which the circuit boat 3 sets the latest update date of the page in the frame as the update date of the index page. In other words, for example, www.domain.com/index.html is registered by the user using the registration screen of the domain or URL shown in FIG. It is also assumed that the update date of the current index page is March 14, 2000. Then, the link page of title.html having the date of update of February 14, 2000, the link page of menu.html having the date of update of August 1, 2000, and August 8, 2000 It is assumed that it consists of a link page of welcom.html having an update date of. The circuit boat 3 acquires the update dates of these linked pages, compares them, and sets August 8, 2000, which is the newest update date, as the update date of the index page.

In addition, when a user performs a search, for example, a keyword input screen for a search as shown in FIG. When a keyword is input from the search button and the search button 17 is selected, a keyword search is performed by the engine 17 shown in FIG. 1, and the search result as shown in FIG. 8 is displayed, for example. In this example, " www.domain.com/index.html August 8, 2000 update" is displayed on the page of the search server 19 as a search result.

In addition, the range that the circuit boat 3 traverses may be limited to pages linked by designation of each frame. Moreover, you may limit to the same domain.

The present invention can be used for a search system on a network using a robot.

Claims (8)

An index page on a network, comprising: a database storing at least an index page including a Uniform Resource Locator (URL) or a domain and a keyword; A circuit boat which traverses the database on the basis of a specified domain or URL, obtains the index page and the keyword of the page linked from the index page, and adds the keyword of the obtained page to the keyword of the index page. Search engine, characterized in that configured. The search engine of claim 1, wherein the circuit boat is configured to traverse the same domain as the index page. An index page on a network, comprising: a database storing at least an index page including a Uniform Resource Locator (URL) or a domain and a keyword; A circuit boat that traverses the database based on a specified domain or URL, obtains a keyword of the index page and a page linked from the index page, and adds the keyword of the obtained page to the keyword of the index page; And an engine for searching the database based on the designated keyword. 4. The retrieval system according to claim 3, wherein the circuit boat is configured to traverse the same domain as the index page. An index page of information on a network, comprising: a database storing at least an index page including a URL or a domain, an update date, and a keyword, and a database creation method in a search system for performing a database search in accordance with a search request. It traverses the said database based on the designated domain or URL, and acquires the keyword of the said index page and the page linked from this index page, And a keyword of the obtained page is added to a keyword of the index page. 6. The method of claim 5, wherein the traversal of the database targets the same domain as the index page. An index page of information on a network, comprising: a database in a search system that has at least a URL (Uniform ResourceLocator) or a database containing an index page including a domain, an update date, and a keyword, and performs a database search in accordance with a search request. In a storage medium having a program for writing on a computer, A procedure of traversing the database based on a specified domain or URL to obtain keywords of the index page and the page to be linked from the index page; And a program for causing a computer to execute a procedure for adding a keyword of the acquired page to a keyword of the index page. 8. The storage medium of claim 7, wherein when the computer traverses the database, the same domain as the index page is traversed.