TWI515584B - Compupter-assisted specialized noun produced dictionary system and method therefor - Google Patents

Description

Computer aided professional noun dictionary generation system and method

The invention relates to a computer aided professional noun dictionary generation system and method, in particular to a system and method for automatically selecting new professional terms in an input document and interpreting them for public inquiry.

With the evolution of human civilization and the accelerated innovation of information such as emerging technologies, doctrines or essays, new proprietary vocabulary is increasing rapidly, which makes the original professional vocabulary processing system insufficient to meet demand, in various paper or electronic vocabulary systems. Words are usually used, although the number of words in the dictionary can be increased as much as possible, but no matter how big the vocabulary is, it is impossible to generalize all the words that may be used. This is because with the evolution of civilization, the words themselves will As time increases, and there are specific keyword words or proper nouns in various fields of knowledge, these are not known to the system designer in advance, so the dictionary of proper nouns or other various words include The vocabulary can't be changed. It should be updated with the processed articles or related fields, and new words can be generated by automatically extracting from various fields. It can bring about the application scope of the proper noun vocabulary system or the exploration of new fields. Great help.

Therefore, in order to improve the speed of updating the new vocabulary of the existing professional vocabulary processing system, which is too slow to meet the demand, the present invention thus provides a professional noun dictionary generating system, which can automatically select new vocabulary from the content of the input document. And interpret it and put it into the dictionary for enquiry, by input The documentation updates the vocabulary at any time to meet the needs of each area.

To achieve the above functions, a computer-assisted professional noun dictionary generation system includes a database module including an old professional noun storage area and a new professional term storage area; and a receiving module for receiving an input document; a repeating sequence module coupled to the receiving module for segmenting and dividing the input document to form a plurality of language units; a statistical word frequency probability module coupled to the repeating sequence module and the database module Used to analyze and compare the language units to filter out old professional nouns, prepositions and articles, and generate new professional terms stored in the new professional noun storage area; an interpretation module coupled to the above database module In order to explain the new terminology, and to classify the completed new professional term as the old terminology, and store it in the old professional term storage area of the database module.

The computer aided professional noun dictionary generation system further includes a dictionary query module coupled to the database module for querying old professional nouns.

The language unit contains a single word or a phrase.

The illuminating module utilizes an open library of web search engines to explain the new terminology.

The invention further provides a computer aided professional noun dictionary generating method, which comprises storing an old professional noun; receiving an input document; segmenting the input document into a plurality of language units; analyzing and comparing the language units to filter The old professional nouns, prepositions and articles are used to produce new professional nouns; the new professional nouns are explained, and the new professional terms that are explained are classified into the old professional nouns.

The language unit contains a single word or a phrase.

The illuminating module utilizes an open library of web search engines to explain the new terminology.

The effect of the invention: the vocabulary is updated at any time to meet the needs of use in various fields.

With regard to the technical features and the enhancement of the present invention, the preferred embodiments of the present invention can be clearly presented. First, referring to the first embodiment, the preferred embodiment of the present invention is a computer-aided professional term dictionary. System, including:

A database module (10) includes an old professional noun storage area (12) and a new professional term storage area (14).

A receiving module (16) for receiving an input document, the input document comprising a new journal, a new patent, a new doctrine or news.

a repeating sequence module (18) coupled to the receiving module for segmenting the input document into a plurality of language units (including a single word or a phrase), the repeating sequence module (18) The basic mathematical model is established according to the style of each type of repeated sequence in biogenetics, and then the program is written according to the mathematical mode, and the analyzed words and word-related data are integrated into a related database. In detail, using Matteo Pellegrini a method of detecting repeated segments to hyphenation which the matrix using the formula P _ij, which is a matrix of N * N, compared to each other if the two strings, which is equal, within the matrix of ( The i, j) address value is changed from 0 to 1, and this method will try to find the longest and repeated word to achieve the word break.

a statistic frequency probability module (20) (TF-IDF) coupled to the repeating sequence module (18) and the database module (10) for analyzing the language unit to filter out the old professional Nouns, prepositions and articles, and new professional terms are stored in the new professional noun storage area (14). Further, the statistical word frequency probability module (20) is a statistical method for evaluating the language unit. The importance of the content stored in the input document and the database module (10), the importance of the language unit increases in proportion to the number of occurrences in the input document, and at the same time, as the database module is old The number of occurrences in the professional noun storage area decreases inversely.

The language unit has recurring characteristics. Therefore, if the number of occurrences of the language unit is higher, the more likely it is a new professional noun, the above ni, j is the number of occurrences of a single said language unit in the input document dj, and the denominator Then is the sum of the occurrences of all the language units in the input document dj.

Inverse Document Frequency (IDF) is a measure of the universal importance of the language unit. The IDF of a particular language unit can be divided by the total number of input documents by the input document containing a specific language unit. The number of pieces, and then the logarithm of the obtained quotient is obtained: among them:

|D|: The total number of input documents in the database module (10).

|{ d : d t _i }|: The number of input documents containing a certain characteristic language unit ti (ie, the number of input documents of n _i ≠ 0).

Then: tfidf _i,j =tf _i,j . Idf _i

Therefore, when a high language unit frequency within a particular input document, and a low input document frequency of the high language unit in the total input document, the high-weighted language unit is determined to form the new professional noun, And for expert inspection.

An explanatory module (22) coupled to the database module (10) for explaining the new terminology and classifying the completed new professional term into the old terminology and storing In the old professional term storage area of the database module, it is further explained that the explanatory module (22) uses the open dictionary library of the network search engine to explain the new professional term.

A dictionary query module (24) is coupled to the database module (10) for querying old terminology by scholars, experts, publishers, students, and dictionary compilers.

The invention further provides a computer aided professional noun dictionary generation method, which comprises:

Step 01: The database module (10) stores old professional nouns.

Step 02: The receiving module (16) receives an input document.

Step 03: The repeating sequence module (18) segments the input document into a plurality of language units (including a single word or a phrase).

Step 04: The statistical word frequency probability module (20) analyzes and compares the language units to filter out old professional nouns, prepositions, and articles to generate new professional terms.

Step 05: The explanation module (22) interprets the new professional term and classifies the completed new professional term into the old professional term, and the explanation system uses a web search engine to program The open library is used to explain the new terminology.

Through the above methods, new professional terms are automatically selected and explained, and used for public inquiry. It will be of great help to the application scope of the proper noun vocabulary system or the exploration of new fields.

However, the above description is only a preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, that is, the simple equivalent changes and modifications according to the scope of the present invention and the description of the invention are the present invention. Within the scope of the patent.

(10) ‧‧‧Database Module

(12) ‧‧‧Old terminology storage area

(14) ‧‧‧New terminology storage area

(16)‧‧‧ receiving module

(18)‧‧‧Repetitive sequence module

(20) ‧‧‧Statistics Frequency Probability Module

(22)‧‧‧ Explain module

(24) ‧‧‧ dictionary query module

The first figure is a schematic diagram illustrating the sexual relationship of the system module of the preferred embodiment.

The second figure is a schematic diagram illustrating the implementation of the method of the preferred embodiment.

(10) ‧‧‧Database Module

(12) ‧‧‧Old terminology storage area

(14) ‧‧‧New terminology storage area

(16)‧‧‧ receiving module

(18)‧‧‧Repetitive sequence module

(20) ‧‧‧Statistics Frequency Probability Module

(22)‧‧‧ Explain module

(24) ‧‧‧ dictionary query module

Claims (7)

A computer-assisted professional noun dictionary generation system includes: a database module, including an old professional noun storage area and a new professional noun storage area, the old professional nouns are stored with plural old professional nouns; a receiving module is used Receiving an input document; a repeating sequence module coupled to the receiving module, the repeating sequence module is to establish a basic mathematical mode according to a pattern of various types of repeated sequences in biogenetics, and then respectively write the program according to the mathematical mode And integrating the analyzed words and word-related data into a related database to find the longest and repeated words to achieve the word break, which is used to divide the input document by using the repeated segment detection method. A segmentation word forms a complex language unit, which uses a matrix P _{ij of the} following formula, which is a matrix of N*N. If two mutually compared strings have equal values, then (i,j in the matrix The address value is changed from 0 to 1, and this method will try to find the longest and repeated word to achieve the word break; a statistic frequency probability module coupled to the repeating sequence module and the database module for analyzing the language unit to filter out old professional nouns, prepositions and articles, and generating new professional term storage In the new professional noun storage area, the statistical frequency probability module is used to evaluate the importance of the language unit in the input document and the database module storage content, the importance of the language unit is along with the input document The number of occurrences increases in proportion, and at the same time decreases inversely with the number of occurrences in the old professional noun storage area of the database module, and uses a reverse file frequency as a measure to evaluate the universal importance of the language unit. For evaluating a high language unit frequency in the input document, and a low input document frequency of the high language unit in the total input document, determining the high-weighted language unit to form the new professional noun, For expert review, the formula is as follows: Where: |D|: the total number of input documents in the database module; |{d:d t _i }|: the number of input documents containing a certain characteristic language unit t _i (ie the number of input documents of n _i ≠ 0), then: tfidf _i,j =tf _i,j . An idf _i ; an interpretive module coupled to the database module for explaining the new terminology and classifying the completed new professional term into the old term, and storing in the The old professional term storage area of the database module. For example, the computer-aided professional noun dictionary generation system described in claim 1 further includes a dictionary query module coupled to the database module for querying old professional terms. The computer-aided professional noun dictionary generating system according to claim 1, wherein the language unit includes a single word or a phrase. For example, the computer-aided professional noun dictionary generating system described in claim 1 of the patent scope, the explanatory module utilizes an open library of a web search engine to perform the explanation of the new professional term. A method for generating a computer-assisted professional noun dictionary includes: storing an old professional term; receiving an input document; and using the repeated segment detection method to segment the word into a plurality of language units, the repeated sequence module According to the style of each type of repeated sequence in a biogenetics, the basic mathematical model is established, and the program is written according to the mathematical mode, and the analyzed words and word related data are integrated into a related database to find the longest and repeated a word to thereby achieve a word break; an analysis of the language unit, using a reverse file frequency as a measure of the universal importance of the language unit for evaluating the high language unit frequency within the input document, and The low-input document frequency of the high-language unit in the total input document determines the high-weighted language unit to filter out old professional nouns, prepositions, and articles to generate new professional terms; New professional nouns, and classify the completed new professional terms into the old professional nouns. The method for generating a computer-assisted professional noun dictionary according to claim 5, wherein the language unit includes a single word or a phrase. The method for generating a computer-assisted professional noun dictionary according to claim 5, wherein the explanatory module is programmable by using a web search engine Put the library to explain the new terminology.