KR100697625B1 - Braille recognition and conversion method and system in mobile communication terminal - Google Patents

Abstract

The present invention relates to a braille recognition and conversion method and system therefor in a mobile communication terminal, which is required by a user using a braille table on a database after decoding a braille image captured by a camera of the mobile communication terminal. Braille recognized to be recognized as a character is converted into a character to be matched using a character table for conversion between ordinary characters, and converted into characters of various languages (Korean, English, Japanese, etc.) according to a designation or selection. Can be displayed and spoken to the visually impaired. In this way, braille is input by contactlessly from the method of photographing, thereby providing convenience of braille input and at the same time, anyone who does not know the braille who is not visually impaired can easily know.

Camera Phone, Braille Recognition, Braille Conversion, Braille Voice Output

Description

System and Method for Recognition and Conversion in Mobile Telephone Terminal}

1 is a system diagram of a mobile communication terminal referred to for description of an embodiment of the present invention;

2 is a flowchart for braille recognition and conversion in a mobile communication terminal equipped with a camera according to an embodiment of the present invention.

The present invention relates to a method for recognizing braille for the visually impaired in a mobile communication terminal having a camera, and in particular, a general person who is not familiar with visual impairment or braille by recognizing braille input through the camera shooting of the mobile communication terminal. The present invention relates to a braille recognition and conversion method and a system in a mobile communication terminal that converts text or voice so that it can be easily understood.

Generally, the braille used by the visually impaired is made by using a dot plate and a braille paper, and the braille is marked convexly by puncturing through the plate at regular intervals, and the visually impaired person recognizes it by touch with his finger. . With the expansion of mobile communication terminals (mobile phones), everyone is now using necessities, and the mobile communication terminals for the handicapped, that is, the visually handicapped, have improved the difficulty in inputting Braille. Some examples of conventional mobile communication terminals for the visually impaired are as shown in Korean Patent Laid-Open Publication Nos. 1999-09326 and 1998-074223, and convex Braille on the button surface of the keypad to confirm by voice when a key is pressed. As disclosed in Korean Patent Laid-Open Publication No. 10-2005-0004476, there is a method of adopting a method of differentiating braille keypad structures from the general public according to a familiar braille system of the visually impaired. However, all of the conventional methods have a problem in that a keypad of a mobile communication terminal needs to be manufactured separately. In another method of Korea Patent Publication No. 10-2005-0027799, after mounting a scanner on a mobile communication terminal, inputting Braille through a scanner In the case of a business card processed in Braille, the contact is almost made, and the braille is recognized from the difference between the convex portions of the Braille. The scanner has to be additionally installed in a predetermined position of the mobile communication terminal only for braille input. Therefore, the scanner is restricted in space due to the trend of adding and minimizing functions. Because some contact must be made during scanning, the recognition rate will be lowered if you are not careful.
In addition, in recent years, most mobile communication terminals have a built-in camera, and have been changed to high performance. However, the purpose of the mobile communication terminals is still impossible to improve the performance of a video or a conventional camera. .

delete

Accordingly, an object of the present invention is to provide a method and a system capable of inputting a non-contact method through photographing braille in a mobile communication terminal equipped with a camera.

It is another object of the present invention to provide a method of increasing the range and value of a high performance camera using a braille input by a camera in a mobile communication terminal having a built-in camera.

Another object of the present invention is to recognize the braille photographed by the camera to convert the text of the various languages as well as Hangul and save or send text (e-mail, SMS ...) and the visually impaired Rather, it provides a way for the general public to facilitate understanding.

Still another object of the present invention is to provide a method of recognizing braille photographed by a camera, converting the text into text, and converting the text into speech for the visually impaired.

The present invention for performing the above object is a braille photographing input unit for capturing the image of the braille through a camera and then decoding the data format, and a braille database unit for storing data for converting the braille image into characters of various languages; The braille recognition unit recognizes braille by comparing the decoded value of the braille image with the output of the braille database unit, and the braille recognized by the braille recognition unit is set to various characters such as Korean, English, Japanese ..... It consists of a character conversion unit for converting, and a braille-character conversion table unit referred to when converting the braille recognized by the character conversion unit into a variety of characters, such as Korean, English, Japanese .... It can be used for other purposes such as SMS, etc., and is configured to be able to be directly heard by TTS.

delete

delete

In addition, for another purpose, a braille input process for inputting a braille through a camera of a mobile communication terminal, an image decoding process for decoding a braille image photographed in the braille input process, and braille data decoded in the image decoding process A braille recognition process that recognizes the braille by using a table on a braille database that is already stored by dividing the difference between a convex characteristic and a curve of the braille characteristic, and a conversion table between braille and general characters already stored in the braille recognition process. It consists of a character conversion process that converts into a single character that is matched among various languages (Korean, English, Chinese, Japanese, etc.), and also converts all or part of the conversion in the character conversion process. The converted text can be saved in various ways, e-mail, SMS, etc. Such as that used for the purpose, or output as voice, and also features a process for printing an image composed of braille as it is or transformed characters.

DETAILED DESCRIPTION Hereinafter, detailed descriptions of preferred embodiments of the present invention will be described with reference to the accompanying drawings. It should be noted that the same components in the drawings represent the same numerals wherever possible.

The present invention can be implemented in a mobile communication terminal equipped with a camera, a braille table database unit for recognizing the braille image photographed Braille, and the recognized Braille in various languages (Korean, English, Japanese, Chinese) The conversion table, etc., which are provided for converting the characters into characters, is not specific to the present invention, and can be newly constructed or already provided by various methods. Note that it is not specified. Therefore, it will be apparent to those skilled in the art.

1 is a view showing the configuration of a mobile communication terminal according to an embodiment of the present invention, in particular the configuration of a mobile communication terminal having a camera. A braille photographing input unit which photographs Braille through the camera unit 140 and decodes the imaged image into a data format and inputs the image through the image processor 150;

A memory having a braille database part for converting braille images into characters of various languages and a braille-character conversion table part referenced when converting recognized braille into various characters such as Korean, English, Japanese, etc. 103),

Braille recognition part that controls braille recognition by comparing the decoded value of braille image and output of braille database part. Hangul, English, Japanese set from braille-character conversion table part. It has a control unit 110 for controlling to convert to a variety of characters, such as ..., the control unit 110 is configured to be used for other purposes, such as SMS, and the TTS can be heard directly in the voice to TTS All.

In the following description of the parts not described in FIG. 1, the RF unit 123 of FIG. 1 performs a wireless communication function of the mobile communication terminal. The RF unit 123 includes an RF transmitter for upconverting and amplifying a frequency of a transmitted signal, and an RF receiver for amplifying a received signal with low noise and downconverting a frequency.

The data processor 120 includes a transmitter for encoding and modulating the transmitted signal and a receiver for demodulating and decoding the received signal. That is, the data processor 123 may be configured of a modem and a codec. Here, the codec includes a data codec for processing packet data and an audio codec for processing an audio signal such as voice, and processes the data into braille data converted into text.

The audio processor 125 plays a function of reproducing a received audio signal output from the audio codec of the data processor 120 or transmitting a transmitted audio signal generated from a microphone to the audio codec of the data processor 120. The braille converted to characters is recognized and output as sound.

The memory 130 may be composed of program memory and data memories. The program memory stores programs for controlling a general operation of the mobile communication terminal and programs for braille recognition and conversion according to an embodiment of the present invention. Data memory consists of a Braille database (DB) which is referred to for braille recognition after decoding a braille image taken from the camera, and various languages (Korean, English, Japanese, Chinese, etc.) depending on the selected or specified braille. Stores the referenced Braille / generic character table section for conversion into characters, and the recognized Braille and converted languages are stored directly in the data memory, but optionally for phonebooks, dictionaries and notes do.

The controller 110 controls not only braille recognition and character conversion through braille photographing and braille recognition and character conversion, but also to be stored for use for e-mail and SMS transmission and other purposes. It performs functions to control the overall operation of the. In addition, the controller 110 may include the data processor 120.

The camera module 140 captures braille, a camera sensor for converting the optical signal of the photographed braille into an electrical signal, and a signal for converting the analog image signal of the braille photographed from the camera sensor into digital data. A processing unit is provided to convert the braille image into digital data.

The image processor 150 processes the image signal of the braille output from the camera unit 140 in units of frames and outputs the frame image data according to the characteristics and the size of the display unit 160. In addition, the image processor 150 includes an image codec and performs a function of compressing the frame image data displayed on the display unit 160 in a set manner or restoring the compressed frame image data to original frame image data. do. The image codec may be a JPEG codec, an MPEG4 codec, a wavelet codec, or the like.

The display unit 160 displays the braille image signal output from the image processor 150 on a screen, and displays the braille image and the recognized or converted braille.

The key input unit 127 is provided with keys for setting and selection for braille recognition processing and function keys for setting various functions.

The output port 170 may be a conventional USB port as a printer connection port, and characters converted into various languages such as Braille or Korean, Chinese, English, Chinese, etc. recognized by the controller 110. If you want to print on, you can print directly or by moving to a computer.

2 is a flow chart for braille recognition and conversion in a mobile communication terminal equipped with a camera according to an embodiment of the present invention.

Therefore, one embodiment of the present invention will be described in detail with reference to Figs. 1 to 2, generally embossed braille is thicker than normal paper, so the hole in the hole and the part not. The difference in cancer is known to be severe. The present invention is intended to facilitate the input of braille by shooting rather than the contact method in a mobile communication terminal equipped with a camera using the features of the convex portion of the braille. That is, the photographed Braille is recognized from the difference between light and dark and the interval between braille.

In order to recognize the braille created in braille, first, a function for braille recognition and conversion is selected in the mobile communication terminal equipped with the camera unit 140 as shown in the example of FIG. 1. If there is a key input from the key input unit 127 in step 201 of FIG. 2 to select a function, the controller 110 checks whether the photographing mode is in step 203. In the photographing mode, when the document made with the braille is photographed while being placed in the proximity of the camera unit 140, the braille document is output as digital braille image data (205).

The braille image data output from the camera unit 140 is received by the image processing unit 150 in units of frames in step 207 under the control of the controller 110 and decoded by the image codec to be displayed on the display unit 160. do.

In step 209, it is checked whether the decoded braille image data is designated for braille recognition.

If it is not in the mode for braille recognition, the decoded image is displayed as it is, and if it is in the mode for braille recognition, the controller 110 displays the decoded braille image in the memory 130 in the braille database (DB). Recognize Braille by referring to the table.

The recognized Braille is converted into a language required by the general public (volunteer) for the visually impaired or a person with a disability, that is, a letter, and whether the entire recognized Braille is converted into the required language or only a part of it. In step (215), the choice is confirmed. If it is not a whole but a partial selection, in step (217), only a part to be recognized is selected using the direction keys from the reference point.

By the input of the key input unit 127, the controller 110 selects one of several languages (Korean, English, Japanese, ..., etc.) to be converted according to the portion selected in steps 215 and 217. . When the language required by the visually impaired or the general public who is helping the handicapped is designated, in step 219, the control unit 110 converts the character into a corresponding character by referring to a conversion table for converting the braille from the memory 130 to the general character. Displayed at 160 (221). When the display is converted to the various necessary characters, the visually impaired as well as the general public can easily read and understand the special language called Braille.

Depending on whether to store the converted characters in the phone book 225, dictionary and memo (225, 227) is stored in the phone book, dictionary, memo of the memory unit 130 (235, 237), SMS or message transmission mode On the back 223, the controller 110 enters the message transmission mode of the call and transmits the text through the data processor 120 and the RF unit 123 (233).

In the mode for converting the text into voice (TTS) (229), the control unit 110 converts the visually impaired data into audio that can be heard by the voice and passes through the audio processing unit 125 through the data processing unit 120. The audio is output (229).

On the other hand, when printing the converted character as it is, the control unit 110 reads the converted character from the memory 130 and outputs through the output port 170 in step 241, it is transferred to a computer to be output to the printer When you want to print the braille recognized in step 213, the braille stored in the memory 130 is read and output through the output port 170 in step 243, and the braille is converted into characters in step 219. If you want to print the output from the memory 130 and output through the output port 170 in the process (241) can be output directly to the connected printer or to a computer to output to the printer.

As described above, in the present invention, the braille input is input through a method of photographing a camera of a mobile communication terminal, so that the braille can be easily input. The braille input is automatically recognized and simultaneously converted into characters of various languages or voice. It can be used to help the visually impaired who are socially marginalized, and can be easily interpreted by the general public, such as volunteers who do not know Braille, and has the advantage of increasing the range of cameras used in the highly functional mobile communication terminals. have.

Claims (10)

In the mobile communication terminal with a built-in camera, An input process of making the braille input contactless in each input mode of the mobile communication terminal, a recognition process of recognizing the braille image input in the input process, Braille recognition and conversion method in the mobile communication terminal, characterized in that for converting the braille recognized in the braille recognition process to a character or voice designated according to the conversion table. The method of claim 1, The input process is a braille recognition and conversion method for a mobile communication terminal, characterized in that configured to input the braille in a non-contact by shooting the camera. The method of claim 1, The text conversion process is a braille recognition and conversion method for a mobile communication terminal, characterized in that configured to convert to a multi-lingual language or voice desired by the user. In the mobile communication terminal with a built-in camera, A braille input process of photographing and inputting braille through a camera in each input mode of the mobile communication terminal, an image decoding process of decoding a braille image photographed in the braille input process, and a decoding of the braille data decoded in the image decoding process According to the braille recognition process that recognizes braille by referring to the table on the braille database that is stored from the difference between the contrast and the interval that distinguishes the braille, and the braille recognition process in the braille recognition process according to the conversion table between characters. Braille recognition and conversion method in a mobile communication terminal comprising a character conversion process for converting the language (Hangul, English, Chinese, Japanese, ....., etc.) to a matching character. The method of claim 4, wherein Braille recognition and conversion method for a mobile communication terminal, characterized in that further comprising the step of selecting whether to convert all or part of the character conversion in the character conversion process. The method of claim 4, wherein Braille recognition and conversion in the mobile communication terminal characterized in that it further adds a process of storing the converted character in the character conversion process (telephone book, dictionary, memo ...) or convert to voice (TTS) Way The method of claim 4, wherein Braille recognition and conversion method for a mobile communication terminal, characterized in that further comprising the step of transmitting the text converted in the text conversion process by e-mail or SMS. The method of claim 4, wherein Braille recognition and conversion method in the mobile communication terminal, characterized in that further adding the step of printing the characters converted in the braille or the character conversion process recognized in the braille recognition process. In the mobile communication terminal equipped with a camera unit, A braille input unit for decoding and inputting braille into image data in each input mode of a mobile communication terminal; A braille database unit that stores data for converting braille images into characters of various languages, A braille recognition unit for recognizing braille by comparing the image data decoded by the braille input unit with an output of the braille database unit; Character conversion unit for converting the braille recognized by the braille recognition unit into a variety of characters, such as set Hangul, English, Japanese ....., Braille recognition and conversion system in a mobile communication terminal, characterized in that the braille-character conversion table portion that is referred to when converting the braille recognized by the character conversion unit into a variety of characters, such as Korean, English, Japanese ..... . The method of claim 9, The braille input unit is a braille recognition and conversion system in the mobile communication terminal, characterized in that configured to input through the shooting of the camera.

Images