JP2011227731A - Query selection device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To extract a click log from which a query that becomes a noise is removed when generating a correct DB in a correct answer extraction process that is a preceding process of a highly accurate ranking function generator.
The present invention obtains a query score having a higher value as the entropy description amount of a query included in a click log storage means is shorter, stores the query score in the query score storage means, and stores the maximum score from the query score storage means. A query is acquired, a record including the query is acquired from the click log storage unit, and stored in the selected click log storage unit. As a result, in the correct answer extraction process for generating the ranking function, a query useful for ranking function generation is selected from the selected click log storage means to generate a correct DB.
[Selection] Figure 1

Description

  The present invention relates to a query selection device and a program, and more particularly, to a query selection device and a program for automatically generating a ranking function for calculating a score for realizing a ranking of search results in a web search system.

  FIG. 7 shows a configuration of a conventional ranking function generation system.

  An outline of the prior art will be briefly described.

  The ranking function generation system includes a Web page database (DB) 10, a click log DB 110, a correct answer DB 30, a feature DB 40, a feature extraction device 20, a correct answer extraction device 120, and a ranking function generation device 90.

  As shown in FIG. 8, the Web page DB 10 stores information (page identifier, URL, text) of a Web page to be searched.

  The click log DB 110 stores information (page identifier) of the clicked document among the search results presented for the input query as shown in FIG.

  As shown in FIG. 10, the correct answer database 30 stores ranking information of each page for each query.

  The correct answer extraction device 120 receives the click log DB 110 and generates a correct answer DB 30. As a method for generating the correct DB 30, the total number of clicks obtained by adding all the click logs for the query / document pair is used (for example, see Non-Patent Document 2).

  The feature extraction apparatus 20 receives the correct DB 30 and the Web page DB 10 as inputs, extracts features (see, for example, Non-Patent Document 2), and generates a feature DB 40. An example of the feature DB 40 is shown in FIG. Specifically, a word frequency (Term Frequency; TF) indicating how many times a query appears on the web page and the importance of the web page are called features, and the value is called a feature value. Further, information using a click log such as how many times a web page is clicked in a certain search query can be used. Here, the click log is a log of the search system, and records the user's click information for the search result of the search query input by the user.

  Based on the feature DB 40 and the correct answer DB 30, the ranking function generation device 90 generates a ranking function. Examples of the ranking function generation function include Non-Patent Document 2 and the like, and implementation thereof includes Non-Patent Document 3 and the like.

Z. Dou, R. Song, X. Yuan and J.-R. Wen: Are click-through data adequate for learning web search rankings? In Proceedings of the 17th ACM Conference on Information and Knowledge Management (CIKM), pp.73 -83, 2008. T. Joachims, Optimizing Search Engines Using Clickthrough Data, Proceedings of the ACM Conference on Knowledge Discovery and Data Mining (KDD), ACM, 2002 svm_rank (http://www.cs.cornell.edu/People/tj/svm_light/svm_rank.html)

  However, the click log DB 110 of the above prior art includes a log in which many search results are clicked regardless of the suitability of the search results, such as an adult query. Information is presumed to have an adverse effect on ranking function generation.

  The present invention has been made in view of the above points, and an object of the present invention is to provide a query selection device and a program capable of generating a ranking function with high accuracy by selecting a query useful for ranking function generation.

  FIG. 1 is a principle configuration diagram of the present invention.

The present invention (Claim 1) is a query selection device for selecting a query used to generate a correct database for generating a ranking function,
Click log storage means 110 for storing an input query and information of a document clicked by a user based on a search log;
A query score calculation unit 150 that obtains a query score that increases as the entropy description amount of the query included in the click log storage unit 110 is short, and stores the query score in the query score storage unit 160;
A query selection unit 130 that acquires a query having the maximum score from the query score storage unit 160, acquires a record including the query from the click log storage unit 110, and stores it in the selection click log storage unit 140.

In the present invention (claim 2), the query score calculation means 150 of claim 1
The number of documents searched by the query is acquired from the click log storage unit 110, and the amount of information in the document space, the appearance probability of the query in the click log storage unit 110, and the frequency at which the document is clicked by the query are obtained. Means for obtaining a query score using the click entropy obtained from the value divided by the total number of clicks.

  The present invention (Claim 3) is a query selection program for causing a computer to function as each means constituting the query selection apparatus according to Claim 1 or 2.

  As described above, it is not necessary to use all the logs included in the click log DB, but the query selection device removes queries that cause noise in advance and selects a query that is useful for ranking function generation. Can be generated.

It is a principle block diagram of this invention. 1 is a system configuration diagram according to an embodiment of the present invention. It is an example of query score DB in one embodiment of this invention. It is an example of the selection click log DB in one embodiment of the present invention. It is a flowchart of the query score calculation part process in one embodiment of this invention. It is a flowchart of the process of the query selection part in one embodiment of this invention. It is a block diagram of the ranking function generation system in the conventional ranking function generation technique. It is an example of Web page DB in the conventional ranking function generation system. It is an example of the click log DB in the conventional ranking function generation system. It is an example of correct answer DB in the conventional ranking function generation system. It is an example of characteristic DB in the conventional ranking function generation system.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 2 shows a system configuration in an embodiment of the present invention.

  In the figure, the same components as those in FIG. 7 are denoted by the same reference numerals, and description thereof is omitted.

  In the conventional method, the correct log DB 30 is generated using the click log DB 110 as an input to the correct answer extracting device 120. However, the present invention is different in that the correct DB 30 is generated using the selected click log DB 140.

  First, an overview of the query selection device 100 will be described.

  The query selection device 100 includes a query score calculation unit 150, a query selection unit 130, and a query score DB 160.

  The query score DB 160 holds information about how useful the query is for generating the ranking function, and stores the scores for all the queries held in the click log DB 110 as shown in FIG.

  The query score calculation unit 150 receives the click log DB 110 as an input, calculates a score for each query, and outputs it to the query score DB 160. Details will be described later.

  The query selection unit 130 outputs click log information of a preset number of queries to the selected click log DB 140 based on the score information stored in the query score DB 130. An example of data stored in the selected click log DB 140 is shown in FIG. Since the data structure held by the selected click log DB 140 is essentially the same as that of the click log DB 110, it is possible to generate a ranking function using the selected click log DB 140 in the same framework as the conventional technology.

  The details of the query score calculation unit 150 and the flow of processing will be described below.

  FIG. 5 is a flowchart of the process of the query score calculation unit according to the embodiment of the present invention.

Step 11) The total number of documents included in the click log DB 110 is acquired, and this is stored as D _total in a memory (not shown).

Step 12) The total number of queries included in the click log DB 110 is acquired, and this is set as Q _total and stored in a memory (not shown).

  Step 13) If the unprocessed query is included in the click log DB 110, the process proceeds to step 14, and if not, the process ends.

  Step 14) An unprocessed query q is acquired from the click log DB 110.

Step 15) Obtain the number of documents D (q) retrieved by the query q, calculate the information amount h (p) in the document space using the _total number of documents D _total obtained in Step 11 by the following formula, Store in a memory (not shown).

で計算される。ここでｐは、

Calculated by Where p is

を用いて求めることができる。

Can be obtained using

Step 16) The appearance frequency | q | in the click log DB 110 of the query q is acquired, and the query appearance probability p _q is calculated as follows using the Q _total acquired in Step 12 and stored in a memory (not shown). Store.

ステップ１７） クエリｑの検索によってクリックされた文書集合を元にｐ（ｄ｜ｑ）を次のように計算する。

Step 17) Calculate p (d | q) as follows based on the set of documents clicked by the query q.

ここでfreq(d,q)はクエリｑによって文書ｄがクリックされた頻度を表している。分母はクエリｑにおけるクリック総数を表している。これを用いて、クリックエントロピーＨ（ｐ（ｑ））を

Here, freq (d, q) represents the frequency with which the document d is clicked by the query q. The denominator represents the total number of clicks in query q. Using this, click entropy H (p (q))

によって算出し、メモリ（図示せず）に格納する。

And is stored in a memory (not shown).

Step 18) Obtain p, p _q , H (p (q)) obtained in the above steps 15, 16, and 17 and stored in a memory (not shown) to obtain the query q per document. The description length DL (q), that is, the query score is obtained by the following equation.

上記の式で算出されたクエリスコアＤＬ（ｑ）をクエリスコアＤＢ１６０に書き出し、ステップ１３に移行する。

The query score DL (q) calculated by the above formula is written in the query score DB 160, and the process proceeds to step 13.

  Next, the processing flow of the query selection unit 130 will be described.

  FIG. 6 is a flowchart of the process of the query selection unit according to the embodiment of the present invention.

Step 21) The query selection unit 130 sets a total number Q _select of queries to be selected.

Step 22) If the number of selected queries S> Q _select , the process is terminated. Otherwise, the process proceeds to step 23.

  Step 23) A query q that is not selected from the query score DB 160 and has the maximum score is acquired.

  Step 24) Acquire a record including the query q from the click log DB 110, output it to the selected click log DB 140, and proceed to Step 22.

  Since the selected click log DB 140 can be generated by the above processing, the correct answer DB 30 can be generated using a useful query in which a query that causes noise is removed in the correct answer extracting device 120. As a result, the ranking function generation device 90 can generate an efficient ranking function using the correct answer DB 30.

  Note that the operation of the query selection device 100 described above can be constructed as a program, installed in a computer used as the query selection device, executed, or distributed via a network.

  Further, the constructed program can be stored in a portable storage medium such as a hard disk, a flexible disk, or a CD-ROM, and can be installed or distributed in a computer.

  The present invention is not limited to the above-described embodiment, and various modifications and applications can be made within the scope of the claims.

10 Web page DB
20 Feature Extractor 30 Correct DB
40 Feature DB
90 ranking function generation device 100 query selection device 110 clock log storage means, click log DB
120 correct answer extraction device 130 query selection means, query selection unit 140 selected click log storage means, selected click log DB
150 Query score calculation means, query score calculation section 160 Query score storage means, query score DB

Claims (3)

A query selection device for selecting a query used to generate a correct database for generating a ranking function,
Click log storage means for storing the input query and information of the document clicked by the user based on the search log;
A query score calculating means for obtaining a query score that is higher as the entropy description amount of the query included in the click log storing means is shorter, and storing the query score in the query score storing means;
Query selection means for obtaining a query having the maximum score from the query score storage means, obtaining a record including the query from the click log storage means, and storing it in the selected click log storage means;
A query selection device characterized by comprising: The query score calculation means includes
The number of documents searched by the query is acquired from the click log storage means, and the amount of information in the document space, the appearance probability of the query in the click log storage means, and the frequency that the document was clicked by the query are obtained in the query. The query selection device according to claim 1, further comprising means for obtaining the query score using click entropy obtained from a value divided by the total number of clicks.   The query selection program for functioning a computer as each means which comprises the query selection apparatus of Claim 1 or 2.

Images