Method and apparatus for evaluating search prompting system

Patent metadata

Field	Value
Publication number	US-2016299964-A1
Application number	US-201415031929-A
Country	US
Kind code	A1
Filing date	Oct 9, 2014
Priority date	Oct 24, 2013
Publication date	Oct 13, 2016
Grant date	—

Abstract

The present disclosure discloses a method for evaluating a search prompting system and a corresponding apparatus. The method includes: extracting corresponding assessment terms at random according to an assessment target; acquiring in sequence a minimum number of words that needs to be entered to cover each of the assessment terms; calculating a corresponding coverage efficiency factor and a corresponding prompt efficiency factor according to the minimum number of words that needs to be entered to cover each of the assessment terms, and calculating a coverage rate of each of the assessment terms according to the coverage efficiency factor and the prompt efficiency factor; and performing weighted averaging calculation on the coverage rate of each of the assessment terms, to obtain a coverage rate of the assessment target. In the present disclosure, a coverage efficiency factor and a prompt efficiency factor are further taken into consideration for the calculation of a suggestion coverage rate of an assessment term, so that the evaluation of the effectiveness of a search prompting system can be comprehensively quantified and refined. Therefore, the result of effectiveness evaluation can more accurately reflect the problems of the search prompting system, which enables developers to perform corresponding adjustment, thereby further improving the search prompt efficiency of the search prompting system.

First claim

What is claimed is:

1 . A method for evaluating a search prompting system, comprising the following steps:
extracting corresponding assessment terms according to an assessment target; acquiring in sequence a minimum number of words that needs to be entered to cover each of the assessment terms; calculating a coverage efficiency factor and a prompt efficiency factor according to the minimum number of words that needs to be entered to cover each of the assessment terms, and calculating a coverage rate of each of the assessment terms according to the coverage efficiency factor and the prompt efficiency factor; and performing weighted averaging calculation on the coverage rate of each of the assessment terms, to obtain a coverage rate of the assessment target.

2 . The method for evaluating a search prompting system according to claim 1 , wherein a method for calculating the coverage efficiency factor is:
1—(the minimum number of words that needs to be entered to cover the assessment term/the number of words in the assessment term).

3 . The method for evaluating a search prompting system according to claim 1 , wherein a method for calculating the prompt efficiency factor is:
when the minimum number of words that needs to be entered to cover the assessment term is entered in the search prompting system, recording a display position of the assessment term in a search prompting result; determining the number of clicks corresponding to the display position of the assessment term in the search prompting result of the assessment term; and determining a ratio of the number of clicks accounts to the number of clicks of the first position in the search prompting result of the assessment term as the prompt efficiency factor.

4 . The method for evaluating a search prompting system according to claim 1 , wherein a method for calculating the coverage rate of each of the assessment terms is:
if the minimum number of words that needs to be entered to cover the assessment term is greater than 0, the coverage rate of the assessment term=the minimum number of words that needs to be entered to cover the assessment term×a coverage efficiency factor model of the assessment term×a prompt efficiency factor model of the assessment term; and if the minimum number of words that needs to be entered to cover the assessment term is equal to 0, the coverage rate of the assessment term=1.

5 . The method for evaluating a search prompting system according to claim 1 , wherein the extracting corresponding assessment terms according to an assessment target comprises:
obtaining the assessment terms corresponding to the assessment target by performing sampling from a log collection system or random extraction from a hot list according to the assessment target.

6 . An apparatus for evaluating a search prompting system, comprising:
an assessment term acquiring module, configured to extract corresponding assessment terms according to an assessment target; a search module, configured to acquire in sequence a minimum number of words that needs to be entered to cover each of the assessment terms; a calculation module, configured to: calculate a coverage efficiency factor and a prompt efficiency factor according to the minimum number of words that needs to be entered to cover each of the assessment terms, and calculate a coverage rate of each of the assessment terms according to the coverage efficiency factor and the prompt efficiency factor; and a summarization module, configured to perform weighted averaging calculation on the coverage rate of each of the assessment terms, to obtain a coverage rate of the assessment target.

7 . The apparatus for evaluating a search prompting system according to claim 6 , wherein a method for calculating the coverage efficiency factor is:
1—(the minimum number of words that needs to be entered to cover the assessment term/the number of words in the assessment term).

8 . The apparatus for evaluating a search prompting system according to claim 6 , wherein a method for calculating the prompt efficiency factor is:
when the minimum number of words that needs to be entered to cover the assessment term is entered in the search prompting system, recording a display position of the assessment term in a search prompting result; and determining the number of clicks corresponding to the display position of the assessment term in the search prompting result of the assessment term, and calculating a ratio of the number of clicks accounts to the number of clicks of the first position in the search prompting result of the assessment term, so as to obtain the prompt efficiency factor.

9 . The apparatus for evaluating a search prompting system according to claim 6 , wherein a method for calculating the coverage rate of each of the assessment terms is:
if the minimum number of words that needs to be entered to cover the assessment term is greater than 0, the coverage rate of the assessment term=the minimum number of words that needs to be entered to cover the assessment term×a coverage efficiency factor model of the assessment term×a prompt efficiency factor model of the assessment term; and if the minimum number of words that needs to be entered to cover the assessment term is equal to 0, the coverage rate of the assessment term=1.

10 . The apparatus for evaluating a search prompting system according to claim 6 , wherein the extracting corresponding assessment terms according to an assessment target comprises:
obtaining the assessment terms corresponding to the assessment target by performing sampling from a log collection system or random extraction from a hot list according to the assessment target.

11 . Computer programs stored in a non-transitory computer readable storage medium, when executed by a processor, the computer programs performs the steps of:
extracting corresponding assessment terms according to an assessment target; acquiring in sequence a minimum number of words that needs to be entered to cover each of the assessment terms; calculating a coverage efficiency factor and a prompt efficiency factor according to the minimum number of words that needs to be entered to cover each of the assessment terms, and calculate a coverage rate of each of the assessment terms according to the coverage efficiency factor and the prompt efficiency factor; and performing weighted averaging calculation on the coverage rate of each of the assessment terms, to obtain a coverage rate of the assessment target.

12 . The computer programs according to claim 10 , wherein a method for calculating the coverage efficiency factor is:
1—(the minimum number of words that needs to be entered to cover the assessment term/the number of words in the assessment term).

13 . The computer programs according to claim 10 , wherein a method for calculating the prompt efficiency factor is:
when the minimum number of words that needs to be entered to cover the assessment term is entered in the search prompting system, recording a display position of the assessment term in a search prompting result; and determining the number of clicks corresponding to the display position of the assessment term in the search prompting result of the assessment term; and determining a ratio of the number of clicks accounts to the number of clicks of the first position in the search prompting result of the assessment term as the prompt efficiency factor.

14 . The computer programs according to claim 10 , wherein a method for calculating the coverage rate of each of the assessment terms is:
if the minimum number of words that needs to be entered to co

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Wu Zhijian
• Zhao Zixuan
• Liu Yang
• Guo Xu
• Qin Wuquan
• Li Qiang
• Lin Song

Classifications

• G06F17/30867

  Physics · mapped topic

• G06F17/30663 Primary

  Physics · mapped topic

• G06F17/3097

  Physics · mapped topic

• G06F16/3334 Primary

  Selection or weighting of terms from queries, including natural language queries · CPC title

• G06F16/951

  Indexing; Web crawling techniques · CPC title