KR20010067853A - Slang Filtering system using syllable connecting infomation. - Google Patents

Abstract

PURPOSE: A vulgar and lecherous word intercepting system is provided to filter and intercept the vulgar and lecherous words combined abnormally or the vulgar and lecherous literary style by applying a natural language processing technique and a combination characteristics of syllables. CONSTITUTION: The system comprises steps of separating input characters by the unit of a sentence, extracting core syllables by checking the syllables among each separated sentence, searching for the core syllables in the vulgar and lecherous word database in which the vulgar and lecherous words are combined by a syllable combination method, searching for syllable combination conditions among the searched results, determining if the corresponding syllables are vulgar or lecherous according to the searched condition, stopping the next process in the case that the corresponding syllable is vulgar or lecherous, and continuing the next process in the case that the corresponding syllable is not vulgar or lecherous.

Description

Slang Filtering System using syllable connecting infomation.

The present invention is to filter the content of the documents on the web using the syllable combining principle of the Korean language, and more particularly, to automatically filter pornographic or profanity in the document content of chat rooms or web bulletin boards.

Currently, internet conversation has rapidly developed beyond text language to chat technology using voice language and video. Although the chat is performed through voice and video, all of them communicate based on a symbol medium called text, so the chat through the text is inevitably maintained even if the chat technology is advanced. However, it is well known that such chatting causes many social problems.

Also on the bulletin board, there are many articles that criticize the site. However, the content of the article goes beyond the critique of the site and shows a myriad of vulgar and lewd expressions that damage the personality and dignity of individuals and organizations.

Therefore, there is a need for administrators to control the personality and honor of individuals and groups, and to control chats or web boards that are exposed to restraint and defenselessness. However, freedom of management and expression are in conflict with each other, and the best way to properly manage chat and bulletin boards is to encourage users to use sound words.

If users use obscene or vulgar language on chat or bulletin boards, the present invention automatically filters or blocks them. This not only gives Internet users the pleasure of surfing the web, but also prevents the swear words that are poured on website operators.

The obscene / slang filter has been invented for the purpose of solving problems of chats and bulletin boards that are emerging as social problems, reviving their original functions, and encouraging users to use a healthy and enjoyable Internet.

In the past, software that blocks slang is mainly operated in a chat window or a chat site of a game site. However, because these slang blockers are word-matching methods, slightly altering obscene words or slang words does not block slang words, and also blocks unconditional words. Therefore, not only does it cause inconvenience to users, but also can be said to infringe users' freedom of expression because it is not properly blocked.

Therefore, it is a technical goal of the present invention to solve the problems of the existing slang breaker, to double the satisfaction of users and operators. In the present invention, in order to overcome the limitation of word matching, natural language processing technology is used to use the coupling characteristics of syllables. The technique to be achieved in the present invention is based on the syllable combination information of Korean using natural language processing, the proper filter function of the indecent obscene / slang words, the blocking of slang / slang words according to the style, the exact filtering of abnormally combined slang words and In addition, the breaker runs quickly in real time.

In the drawing, the lewd / profanity blocker blocks obscene words and profanity through five main steps.

Figure 1 of Figure 1 is a task for separating the character string by sentence unit. Like a bulletin board, a string containing multiple sentences must be separated into sentences.

Figure 2 is the process of selecting the central syllables from the separated sentences, and selects the central syllables by searching the pornographic / slang DB of Figure 3.

The lewd / pronounced DB shown in Figure 3 is a database that stores pronouns and pronouns according to syllable combining information and conditions.

Figure 4 is a routine to search the syllable combination condition of obscene profanity when the central syllable is selected.

Figure 5 is a step for determining whether it is obscene or slang based on the search for syllable combining condition in No. 4.

In order to develop the technology to achieve in the present invention will be applied to natural language processing techniques as follows.

1. Using syllable combination information

The basic principle of slang blockers is the word matching method, which can only block the matched vocabulary. Therefore, the present invention determines whether or not promiscuous profanity is used by using syllable coupling characteristics of Korean rather than word matching. The syllable combining characteristic is that the syllables that can be combined in a syllable in Korean are limited to specific syllables, and there is an infinite combination of syllables. For example, the vocabulary of 'dog' is a general oil noun that actually refers to domestic animals. However, when this 'dog' is used in slang, it acts as a prefix and derives numerous slang words. Therefore, the slang derived from 'dog' is determined whether the slang is made by catching 'dog' as the central syllable and determining the condition of the syllables that are combined afterward.

By using the syllable combining information, it is possible to block a large amount of slang words with a smaller amount of DB than in the conventional word matching method.

2. The distinctive obscene / slang distinction

A double slang refers to the case where the same vocabulary becomes a slang and not a slang (eg "year"). In the present invention, such a heavy slang word can be distinguished more than 90% accurately through the conditional search of syllables and contexts.

3. Abnormal syllable combined treatment

When netizens input Korean characters these days, they do not match the normal Korean character input method (eg "ㄱ ㅐ ㅅ ㅐ ㄲ ㅣ"). It's as if a phoneme is treated as a syllable and a character is input. These slang words could not be processed by the existing slang breaker. However, in the present invention, such abnormal syllable-combination obscene / pronouns are treated as one syllable, respectively, and searched with syllable-combination information to block correctly.

4. Differentiation between spoken and written forms

In the present invention, two types of breakers for chat rooms and breakers for bulletin boards are provided. Generally speaking, the styles are different from each other when speaking (spoken) and when writing long sentences (written), so that they are configured according to the characteristics of each style to increase the efficiency of blocking.

5. Real time scan speed

The present invention uses a fast Unix DBM format Berkeley DB for a database that contains syllable / profanity syllable combination information to search and block in real time regardless of the number or length of sentences. Berkeley DB's small capacity and high speed allow you to use the Internet at the same speed as without this lewd / swear circuit breaker.

The system configuration of the present invention is as follows.

1. Split the input string into sentence units.

2. Search the central syllable by searching the separated sentences by syllable.

3. Search for syllables in the obscene / slang database.

4. The obscene and profanity DB is a database of obscene words and pronouns combined with each other by syllable combining method.

5. Search syllable combining information condition in searched DB.

6. The syllable determines whether the syllable is indecent or non-verbal based on the searched condition.

7. If it is determined that it is obscene / profanity, stop the post-production, or continue the post-production.

The present invention can be applied to various chat sites or game sites to suppress the use of pornographic and profanity words of chat users. Therefore, it is possible to induce healthy language life of teenagers who are the main age groups of chatting and games, and also to block out interpersonal fellowship and prostitution in chat.

In addition, when applied to various web bulletin boards, it is possible not only to prevent abusive criticism of site management organizations or individuals, but also to gather public opinions of the criticism of the site.

The present invention participates not only in this short-term ripple effect but also in the long term in the language education of the youth. It naturally prevents the use of vulgar or unhealthy slang words, which naturally induces youth to use sound and beautiful words on the web. Therefore, we will naturally lead the movement of Korean language verbalization.

Claims (1)

A method using "syllable combining information" rather than word matching in slang blocking.