[go: up one dir, main page]

WO2018124564A1 - Système de lecture braille par vibrations, et procédé d'implémentation de système de lecture braille par vibrations basés sur un écran tactile - Google Patents

Système de lecture braille par vibrations, et procédé d'implémentation de système de lecture braille par vibrations basés sur un écran tactile Download PDF

Info

Publication number
WO2018124564A1
WO2018124564A1 PCT/KR2017/014803 KR2017014803W WO2018124564A1 WO 2018124564 A1 WO2018124564 A1 WO 2018124564A1 KR 2017014803 W KR2017014803 W KR 2017014803W WO 2018124564 A1 WO2018124564 A1 WO 2018124564A1
Authority
WO
WIPO (PCT)
Prior art keywords
vibration
braille
touch motion
row
touch
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2017/014803
Other languages
English (en)
Korean (ko)
Inventor
임승혁
김수현
임담혁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Korea University Research and Business Foundation
Original Assignee
Korea University Research and Business Foundation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Korea University Research and Business Foundation filed Critical Korea University Research and Business Foundation
Publication of WO2018124564A1 publication Critical patent/WO2018124564A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/003—Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays

Definitions

  • the present invention relates to a vibration braille system and a touch screen-based vibration braille implementation method, and in detail, visual information expressed on a touch screen is represented by a physical tactile vibration braille so that visually impaired people can utilize a general-purpose device based on a touch screen.
  • the present invention relates to a vibration braille system and a touch screen based vibration braille implementation method.
  • touch-based displays will be attached to many things in the future, and they will serve as remote controllers as well as display visual information.
  • the touch screen-based device not only transmits signals using vision, but also cannot display physical uneven braille on the screen surface.
  • the visually impaired people who cannot use vision have not been able to use all general-purpose electronic devices equipped with general touch screens including smartphones and tablet PCs, and the inconveniences will increase further in the future.
  • mainstream information communication devices and systems such as telephones, TVs, the Internet, and the like are often incompatible with existing visual aids such as screen readers and braille information terminals.
  • the speed of development is so fast that even if the auxiliary equipment is made by applying the information and communication technology of the time, it does not meet the new technology trend and becomes useless. This problem prevents people with disabilities from fully enjoying the benefits of the new technology.
  • E-books can be easily accessed through tablets or various smart devices, and can hold a number of books in one device, so they can be read anywhere without restrictions such as volume or weight.
  • Visually impaired people can also translate textbooks into electronic Braille and easily access them through general-purpose devices such as mobile phones, but because of the very limited demand for consumers, not only e-book devices but even common devices such as mobile devices are valuable. The reality is that expensive devices for the visually impaired should be used.
  • the stimulus is relatively insignificant, and there is a disadvantage in that the stimulus is blurred at the boundary of each point.
  • the stimulus is easily fatigued, and thus, the recognition of the pattern is difficult.
  • a braille information terminal based on RF communication is a technology in which two or more vibrators contact a body part (finger, waist, and arm) of a visually impaired person to transmit braille information through a braille type vibration.
  • Braille information terminal based on RF communication is convenient to deliver 6 Brailles by applying vibration stimulation directly to the body, but complex vibration pattern gives several vibration stimulation at the same time, so it is difficult for the disabled to distinguish practically. There is a problem that can be difficult to distinguish between complex braille patterns.
  • Korean Patent Registration No. 10-1360828 discloses a glove type vibrating braille output device.
  • Armored vibration braille output device is a technology that allows the user to conveniently recognize the six braille through the vibration tactile by mounting six vibration units on the back of the hand or palm of the glove.
  • Armored type vibration type braille output device is a simple vibration method, so it is difficult to distinguish complex braille patterns, and the tactile surface has a problem that the sensitivity of the tactile sense decreases because the area is wider than the fingertips.
  • the present invention provides a vibration braille system and a touch screen-based vibration braille implementation method that can easily express the braille of various patterns according to the number of vibrations, the length or the presence of vibration by controlling the operation of the vibration unit embedded in the electronic device It aims to do it.
  • the vibration braille system applicable to a touch screen-based electronic device corresponds to a braille consisting of six dots decoded in the order of one row to three rows in one column, and then one row to three rows in two columns.
  • a matching unit configured to preset a vibration pattern source and match the file text to the vibration pattern source when the file text is recognized by the electronic device; Vibration unit for outputting the vibration according to the vibration pattern source to the touch screen; And a motion sensing unit configured to detect a first touch motion in contact with the touch screen and a second touch motion continuous to the first touch motion, wherein the first touch motion is braille depending on whether or not vibration occurs in contact with the touch screen.
  • This motion detects the presence or absence of dots in the first row, and the second touch motion senses the presence or absence of vibration in contact with the touch screen, the presence or absence of vibration in the second and third lines of the braille according to the length of the vibration and the number of vibrations.
  • the vibration pattern source is vibrated when there is a point in the corresponding position according to the decoding order of the braille, and when there is no point in the corresponding position, it is vibrated. It is preferable that the vibration signal is long and vibrates when there are three lines, and there are dots on three lines and no dots on two lines.
  • the vibration pattern source if there is a dot in one row and there are no dots in two rows and three rows, there is a short vibration in the first touch motion, and in the second touch motion If there is no vibration, there are no points in one row and there are points in two rows and three rows, if there is no vibration in the first touch motion and there are two short vibrations in the second touch motion, there are points in one and three rows and there are no points in two rows, If there is one short vibration in one touch motion, and one long vibration in the second touch motion, and there are no dots in one row and three rows, and there are dots in two rows, it is vibration-free in the first touch motion and short vibration in the second touch motion 1 If there are no dots in 1 to 3 rows, the first touch motion and the second touch motion are vibrationless, and if there are no dots in the 1 and 2 rows and there are dots on the 3 rows, the first touch motion is vibration-free and the second touch It is preferable that the vibration signal is
  • the vibration pattern source if there are dots in one row and two rows and there are no dots in three rows, the vibration pattern source is two short vibrations in the first touch motion, and rows 1 to 3 If there is a dot, it is preferable that the vibration signal is three short vibrations during the first touch motion.
  • the Braille decoding order is converted to the number 1 if there is a dot in the corresponding place, the number 0 if there is no dot in the place, 6-digit braille code consisting of a combination of number 0 and number 1 for each braille Further includes a preset conversion unit, and the 6-digit braille code is assigned to the first to third rows of rows 1 to 3 in units of braille columns, and the conversion unit automatically converts the file text into the braille code. desirable.
  • the vibration pattern source is oscillated at the number 1 of the braille code, oscillated at the number 0 of the braille code, and vibrated as short as the number of times arranged if the number 1 is arranged continuously, and the number 0 is continuous. If there is a first touch motion and a second touch motion, it is vibration-free, and if there is a number 1 in the first and third digits and the number 0 in the second digit, the first touch motion is one short vibration and the second touch motion is performed. If there is one long vibration, number 1 and 3 with the number 0 and number 2 with the number 1, then there is no vibration in the first touch motion and one short vibration in the second touch motion. If there is a number 0, and the number 1 in the third position, it is preferable that the vibration signal is vibrationless during the first touch motion, and one long vibration in the second touch motion.
  • the vibration signal is three short vibrations in the first touch motion.
  • the method of implementing a touch screen based vibration braille includes: A) an electronic device in which a vibration pattern source corresponding to the braille consisting of six dots that are decoded in the order of 1 to 3 rows of 1 column, and then 1 to 3 rows of 2 columns is preset. In which the file text is searched; B) matching the file text with the vibration pattern source; C) when the first touch motion and the second touch motion continuous to the first touch motion are detected on the touch screen, outputting the vibration of the vibrating unit to the touch screen according to the vibration pattern source; And D) if the first touch motion is not detected on the touch screen, the vibration of the vibrating unit according to the vibration pattern source is not output to the touch screen.
  • the motion of detecting the presence or absence of dots in one row of braille, and the second touch motion is the presence or absence of vibration in contact with the touch screen, the presence or absence of dots in two or three rows of braille depending on the length of the vibration and the number of vibrations.
  • the vibration pattern source is a vibration pattern source is vibrated if there is a point in the corresponding position according to the braille decoding order, if there is no point in the corresponding position, it is vibrated as short as the number of consecutive points. If the seat is 3 rows, there are dots on 3 rows, and there are no dots on 2 rows, it is preferable that the vibration signal be a long vibration.
  • the vibration pattern source if there is a dot in one row and there are no dots in two rows and three rows, there is a short vibration in the first touch motion, and in the second touch motion If there is no vibration, there are dots in one and three rows and there are no dots in two rows, there is one short vibration in the first touch motion, one long vibration in the second touch motion, and there are no dots in the first and third rows, If there is a point, there is no vibration in the first touch motion and one short vibration in the second touch motion, and if there are no points in the first to third lines, the point is vibrationless in the first touch motion and the second touch motion, and the points are in the first and second rows.
  • the vibration signal which is non-vibrating during the first touch motion and that is one long vibration during the second touch motion.
  • step (A) if the file text is not searched in the electronic device, it is preferable to further include the step of outputting voice information about the search impossible in the electronic device.
  • the electronic device is converted to the number 1 if there is a point in the corresponding position according to the decoding order of the braille, and the number 0 if there is no point in the place, 6 digits consisting of a combination of the number 0 and number 1 for each braille
  • the braille code of is set in advance, and the 6-digit braille code is assigned to the first to third digits of the first to third lines in column units of the braille.
  • the braille code is matched to the vibration pattern source, and the vibration pattern source is vibrated at number 1 of the braille code, is oscillated at number 0 of the braille code, and vibrates as short as the number of times arranged if the number 1 is arranged consecutively.
  • the first touch motion and the second touch motion are vibration-free even if there are the first touch motion and the second touch motion.
  • Long Jeans in 2nd Touch Motion If it is 1 time, there are number 0 in the 1st and 3rd digits, and the number 1 in the 2nd digit, there is no vibration in the 1st touch motion and 1 short vibration in the 2nd touch motion. If there is 0 and the number 1 is in the 3rd position, it is vibration-free in the first touch motion, there is one long vibration in the second touch motion, the number 1 is in the 1st and 2nd positions, the number 0 is in the 3rd position. If present, if the first touch motion is two short vibrations, and if the number 1 is consecutive to the first to third positions, it is preferable that the vibration signal is three short vibrations during the first touch motion.
  • visual information represented on a touch screen is represented by a physical tactile vibration braille so that a visually-impaired person can utilize a touch screen-based general purpose device.
  • the present invention can easily express the braille of various patterns according to the number of vibrations, length or period by controlling the operation of the vibration unit built in the electronic device, it is possible to fast signal transmission. Because of this, the present invention can help visually impaired people to recognize the visual information of the smartphone. As a result, the present invention can enable the use of a smartphone for the visually impaired.
  • the present invention can be useful for the public interest of society if it is used to introduce an electronic textbook for education of children or students with visual impairment by converting text such as e-book into Braille.
  • the present invention is applied to smart home systems, such as energy consumption devices (water, electricity, heating and heating), security devices (door locks, surveillance cameras, etc.), including home appliances, converts the visual information of the touch screen to vibrating braille, People with disabilities can also use general-purpose displays, improving the quality of life for the visually impaired.
  • energy consumption devices water, electricity, heating and heating
  • security devices door locks, surveillance cameras, etc.
  • home appliances converts the visual information of the touch screen to vibrating braille
  • People with disabilities can also use general-purpose displays, improving the quality of life for the visually impaired.
  • the present invention implements the vibration braille by adjusting the vibration motor existing in the smart watch, as a result, the visually impaired people to recognize the time or information displayed on the smart watch, so that even the visually impaired can use the smart watch. have.
  • the present invention is applied to the bank ATM machine, using the same touch screen as the general person, it is possible to recognize the information on the screen by vibrating stimulation that only the visually impaired people who touch the screen can reduce the risk of information leakage.
  • Figure 1 (a) is a braille table according to the letters
  • Figure 1 (b) shows the Braille reading order.
  • FIG. 2 schematically illustrates a configuration of a vibration braille system according to an embodiment of the present invention.
  • Figure 3 shows an example of the long and short, presence and frequency of the vibration according to the vibration pattern source.
  • FIG. 5 exemplarily illustrates how the present invention is expressed in a touch screen-based electronic device.
  • Figure 6 schematically illustrates the principle of braille code generation according to a preferred embodiment of the present invention.
  • FIG. 7 schematically illustrates a flowchart of a method of implementing a touch screen based vibration braille according to an embodiment of the present invention.
  • Figure 1 (a) shows the braille according to the letter.
  • Braille is 1, 2, and 3 points in the order of 1 row to 3 rows of 1 column, followed by 4, 5, and 3 points in the order of 1 row to 3 rows of 2 columns. 6 points will be awarded.
  • Braille decoding order is decoded from 1 to 6 points.
  • Braille is a blind character that is read with a finger on a raised point on the ground.
  • Vibration Braille system is to implement a braille in a vibration manner in a touch screen-based electronic device. That is, the present invention outputs the braille in a vibrating manner through the touch screen, so that even the visually impaired may use a touch screen-based electronic device.
  • Electronic devices based on touch screens can be applied to various products such as smartphones, tablet PCs, bank ATMs, smart watches, and home appliances.
  • the present invention includes a touch screen 110, a motion detection unit 120, a controller 130, a vibration unit 140, and a matching unit 150.
  • the motion detector 120 detects the first touch motion and the second touch motion over the entire area of the touch screen 110.
  • the motion detector 120 may detect a touch motion of the user, no matter what portion of the touch screen 110 the user touches.
  • the first touch motion is a motion for detecting the presence or absence of a dot in one row of braille according to the presence or absence of vibration in contact with the touch screen.
  • the second touch motion is a motion for detecting the presence or absence of vibrations in contact with the touch screen, the presence or absence of vibrations, the length of the vibrations, and the number of vibrations.
  • a drag operation may be taken as an example, but is not necessarily limited to the drag operation.
  • the vibrator 140 is a component embedded in the electronic device.
  • the vibrator 140 is configured to output a vibration to the touch screen 110.
  • the vibration unit 140 is vibrated according to the vibration pattern source.
  • the operation of the vibrator 140 is controlled by the controller 130.
  • the controller 130 controls the operation of the vibrator 140 when the first touch motion is sensed by the motion detector 120.
  • the vibration unit 140 outputs vibrations according to the vibration pattern source.
  • the controller 130 controls the vibrator 140 to not operate.
  • the matching unit 150 matches the file text with the vibration pattern source when the file text is recognized by the electronic device.
  • the matching unit 150 is set in braille and vibration pattern source corresponding to the character.
  • the vibration pattern source is realized by the presence or absence of vibration, the short and long duration of the vibration, and the number of vibrations in the order of decoding the first column of braille and then the second column.
  • the vibration pattern source is vibrated when there is a point in the corresponding position according to the decoding order of the braille, and is vibrated when there is no point in the corresponding position.
  • the vibration pattern source vibrates as short as the number of continuous points if there are continuous points in the corresponding position.
  • the vibration pattern source has a vibration pattern as follows according to the braille decoding order. 4 shows the number of cases of braille points.
  • the vibration pattern source is vibrated briefly in the first touch motion and long in the second touch motion. This corresponds to the vibration pattern source representing the second column (right) decoding order of the initial "j" in FIG. 1 (a).
  • the vibration pattern source is two short vibrations in the first touch motion. This corresponds to a vibration pattern source representing the first column (left) decoding order of the vowel " '"
  • the vibration pattern source is two short vibrations in the first touch motion.
  • the first vibration is a short vibration once in accordance with the basic principle, but since the braille is continuously underneath, there are two short vibrations in the first touch motion.
  • braille information up to # 3 can be recognized even if the second touch motion does not move downward, thereby enabling fast braille recognition.
  • the vibration pattern source when there are no dots in the first row of braille and there are dots in the second row and the third row, the vibration pattern source is vibrationless in the first touch motion and two short vibrations in the second touch motion. This corresponds to the vibration pattern source representing the two-column (right) decoding order of the initial "ts" of FIG. 1 (a).
  • the vibration pattern source is non-vibrating in the first touch motion, and two short vibrations in the second touch motion.
  • two braille points are present in the same manner as in FIG. 4 (b), but are present in 2, 3 instead of 1, and there is no vibration during the first touch motion, and the user touches the second touch motion. Only two consecutive short vibrations will come. Therefore, the user can know that two braille points are continuously present at the positions 2 and 3.
  • the vibration pattern source is one short vibration in the first touch motion and no vibration in the second touch motion. This corresponds to a vibration pattern source representing the first column (left) decoding order of the final "a" in FIG. 1 (a).
  • the vibration pattern source is vibrationless in the first touch motion and one short vibration in the second touch motion. This corresponds to the vibration pattern source representing the first column (left) decoding order of the initial "c" of FIG. 1 (a).
  • the vibration pattern source is vibrated in the first touch motion and vibrates long in the second touch motion. This corresponds to the vibration pattern source representing the second column (right) decoding order of the initial "s" of FIG. 1 (a).
  • FIG. 4 (e) and 4 (f) both have no braille in the 1 position, so there is no vibration during the first touch motion, and one vibration when the second touch motion is performed. However, in this single vibration, it can be confusing to find where braille is located in 2 or 3.
  • the present invention is divided into vibration lengths, and FIG. 4 (e) is set to one short vibration at position 2, and FIG. 4 (f) is set to one long vibration at position 3.
  • the vibration pattern source has a pattern in which three consecutive short vibrations are repeated during the first touch motion. This corresponds to a vibration pattern source representing the first column (left) decoding order of the vowel " '"
  • the vibration pattern source is vibration-free during the first touch motion and the second touch motion. This corresponds to the vibration pattern source representing the first column (left) decoding order of the initial "s" of FIG. 1 (a).
  • the present invention includes a touch screen 110, a motion detection unit 120, a matching unit 150, a vibration unit 140, and a control unit 130.
  • the touch screen 110, the motion detection unit 120, the vibration unit 140, and the control unit 130 according to the present embodiment may include the touch screen 110, the motion detection unit 120, and the vibration of the first embodiment.
  • the vibration braille system according to the present embodiment further includes a conversion unit.
  • the conversion unit automatically converts the file text into braille code.
  • the braille code is preset in the converter.
  • the Braille code is a 6-digit array consisting of a combination of numbers 0 and 1 in Braille.
  • the 6-digit braille code is assigned to the first to third digits in rows 1 to 3 in the unit of the braille column.
  • the braille code converted in the conversion unit is matched with the vibration pattern source.
  • the vibration pattern source is set to vibrate at number 1 of the braille code.
  • the vibration pattern source is set to be vibration-free at the number zero in the braille code.
  • the vibration pattern source is not vibrated even if there is a first touch motion and a second touch motion.
  • the vibration pattern source is set to vibrate as short as the number of times arranged when the number 1 is arranged continuously. If the vibration pattern source has the number 1 in the first and second digits and the number 0 in the third digit, it is set to two short vibrations in the first touch motion. The vibration pattern source is set to three short vibrations during the first touch motion when the number 1 is continuously present in positions 1 to 3.
  • the vibration pattern source When the vibration pattern source has the number 1 in the first and third digits and the number 0 in the second digit, the vibration pattern source is set to one short vibration in the first touch motion and one long vibration in the second touch motion. When the vibration pattern source has the number 0 in the first and third digits and the number 1 in the second digit, the vibration pattern source is set to one vibration in the first touch motion and one short vibration in the second touch motion. When the vibration pattern source has the number 0 in the first and second digits and the number 1 in the third digit, the vibration pattern source is set to one long vibration in the first touch motion and one long vibration in the second touch motion.
  • the vibration pattern source is vibration-free in the second touch motion once in a short vibration in the first touch motion. If the braille code is 110, the vibration pattern source is two short vibrations in the first touch motion. If the braille code is 111, three short vibrations are performed during the first touch motion.
  • the vibration pattern source is vibrationless in the first touch motion and two short vibrations in the second touch motion. If the braille code is 010, the vibration pattern source is non-vibrating in the first touch motion and one short vibration in the second touch motion. If the braille code 001, it is vibration-free in the first touch motion and a long vibration in the second touch motion.
  • the vibration pattern source is one short vibration in the first touch motion and one long vibration in the second touch motion. If the braille code is 000, the vibration pattern source is vibrated even with the first touch motion and the second touch motion.
  • the initial “a” in FIG. 1 (a) has only four points out of six points.
  • the braille code of the initial "a” is "000100".
  • the braille code 000100 is implemented with a vibration pattern source for 000 in a first touch motion, and then a vibration pattern source for 100 in a new first touch motion.
  • the vibration pattern source for the braille code 000 is vibrationless in both the first touch motion and the second touch motion, and the vibration pattern source for the braille code 100 is briefly vibrated once in the first touch motion and vibrationless in the second touch motion.
  • the initial “c” in FIG. 1 (a) has points at two and four points out of six points.
  • the braille code of the initial "c” is "010100".
  • the braille code 010100 is implemented with a vibration pattern source for 010 in a first touch motion, and then a vibration pattern source for 100 in a new first touch motion.
  • the vibration pattern source for the braille code 010 is vibrationless in the first touch motion and one short vibration in the second touch motion
  • the vibration pattern source for the braille code 100 is one short vibration in the first touch motion and the second touch motion City is vibration free.
  • the vowel “ ⁇ ” in FIG. 1 (a) has points at one, two and six points among six points.
  • the braille code of the initial " ⁇ " is "110001".
  • the vibration pattern source for the first touch motion 110 is implemented, and then the vibration pattern source for the new first touch motion 001 is implemented.
  • the vibration pattern source for the braille code 110 is two short vibrations in the first touch motion, and the vibration pattern source for the braille code 001 is one long vibration in the non-responsive second touch motion in the first touch motion.
  • the touch screen-based vibration braille implementation method is implemented in a touch screen-based electronic device.
  • the vibration pattern source corresponding to the braille is preset in the electronic device.
  • Braille consists of six dots that are read in row 1 to row 3, followed by row 1 to row 3 in column 2.
  • a file text desired by a user is searched for in an electronic device (S1). If the file text is not searched in the electronic device, voice information regarding the search impossible is output from the electronic device (S2).
  • the file text is converted into a braille code by the matching unit 150 of the electronic device, and then converted into a vibration pattern source in the braille code (S3).
  • the braille code is converted to the number 1 if there is a dot in the corresponding place, and the number 0 if there is no point in the braille code.
  • the vibration pattern source is vibrated at the number 1 of the braille code and is oscillated at the number 0 of the braille code.
  • the vibration pattern source is vibrated as short as the number of times when the number 1 is arranged in succession, and is oscillated even if there is the first touch motion and the second touch motion when the number 0 is continued.
  • the vibration pattern source has the number 1 in the first and third positions of the braille coat and the number 0 in the second position
  • the vibration pattern source is briefly vibrated in the first touch motion and long in the second touch motion.
  • the vibration pattern source has the number 0 in the first and third positions of the braille code and the number 1 in the second position
  • the vibration pattern source is vibrated in the first touch motion and briefly vibrated in the second touch motion.
  • the vibration pattern source has the number 0 in the first and second positions of the braille code and the number 1 in the third position of the braille code
  • the vibration pattern source is vibrated in the first touch motion and vibrates long in the second touch motion.
  • the first touch motion is detected by the motion detection unit 120 (S4).
  • the vibrator 140 outputs vibrations to the touch screen 110 according to the vibration pattern source by the controller 130 (S6).
  • the vibration unit 140 does not output the vibration according to the vibration pattern source to the touch screen (S5).
  • the vibration unit 140 embedded in the smart phone of the present invention By controlling the vibration unit 140 embedded in the smart phone of the present invention, by converting the file text into a vibration pattern source corresponding to the braille code, the visually impaired to the vibration implemented on the touch screen 110 of the smartphone by tactile sense It can be detected. Because of this, the present invention can help visually impaired people to recognize the visual information of the smartphone. As a result, the present invention can enable the use of a smartphone for the visually impaired.
  • the present invention can be applied to an e-book reader.
  • Many of the Braille books in Korea are occupied by literary works such as novels, and the proportion of educational books or major books for students is very small.
  • the present invention can be useful for the public interest of society if it is used to introduce an electronic textbook for education of children or students with visual impairment by converting text such as e-book into Braille.
  • the present invention may be applied to a smart home system.
  • Smart home system refers to a technology that connects and controls all devices in the house such as home appliances, energy consumption devices (water, electricity, heating and cooling), security devices (door locks, surveillance cameras, etc.).
  • IOT Internet of Things
  • the present invention is applied to the smart home system, by converting the visual information of the touch display to vibrating braille, so that the visually impaired can also use a general-purpose display, it is possible to improve the quality of life of the visually impaired.
  • the present invention may be applied to a smart watch.
  • Smartwatch is a touch display-based device that can be linked with a smartphone, and the general public can conveniently receive time, messages, and information.
  • smart watches are touch-based devices, they cannot be used by the visually impaired and are discriminated against by convenience or quality of life.
  • the present invention implements the vibration braille by adjusting the vibration motor existing in the smart watch, as a result, the visually impaired people to recognize the time or information displayed on the smart watch, so that even the visually impaired can use the smart watch. have.
  • the present invention can be applied to a bank ATM.
  • Current bank ATMs provide voice guidance services or enlarged screens for the visually impaired or those with low vision.
  • the voice guidance service informs people around their personal information without plugging in earphones, and the low vision quotation screen also has a problem of leaking personal financial information because the font size is larger than the general screen.
  • the present invention is applied to the bank ATM machine, using the same touch display as the general person, it is possible to recognize the information on the screen by vibrating stimulation that only the visually impaired people who touch the screen can reduce the risk of information leakage.
  • the present invention can be applied to all electronic devices based on the touch display with a built-in vibration motor, the utilization is very high.
  • the present invention allows the visually impaired to use a touch screen-based electronic device more easily by inputting the braille keyboard between the visually impaired and the normal person and outputting the system using the vibration braille system.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Selon un mode de réalisation de la présente invention, un système de lecture braille par vibrations, applicable à un dispositif électronique à écran tactile, comprend : une unité de mise en correspondance dans laquelle une source de motif de vibrations correspondant à un texte en braille à six points, qui sont déchiffrés dans l'ordre de la première à la troisième rangées d'une première colonne, puis de la première à la troisième rangée d'une seconde colonne, est prédéfinie, et un texte sur fichier est mis en correspondance avec la source de motif de vibrations lorsque le dispositif électronique reconnaît le texte sur fichier ; une unité de vibration pour envoyer à un écran tactile des vibrations d'après la source de motif de vibrations ; et une unité de détection de mouvement pour détecter un premier mouvement de toucher d'après un contact avec l'écran tactile et un second mouvement de toucher consécutif au premier mouvement de toucher, le premier mouvement de toucher étant un mouvement pour détecter la présence/l'absence d'un point sur la première rangée du texte en braille en fonction de la présence/absence de vibrations pendant le contact avec l'écran tactile, le second mouvement de toucher étant un mouvement pour détecter la présence/l'absence de points sur les deuxième et troisième rangées du texte en braille selon la présence/l'absence de vibrations, la longueur de vibrations, et la fréquence des vibrations pendant le contact avec l'écran tactile. Il est préférable que la source de motif de vibrations soit un signal de vibration qui, selon un ordre d'interprétation de braille, vibre lorsqu'un point existe sur un point correspondant, ne vibre pas lorsqu'aucun point n'existe sur le point correspondant, vibre de façon aussi courte que le nombre de points consécutifs lorsque les points consécutifs existent sur un point correspondant, et vibre de façon longue lorsqu'un point correspondant est la troisième rangée, qu'un point existe sur la troisième rangée et qu'un point n'existe pas sur la deuxième rangée.
PCT/KR2017/014803 2016-12-28 2017-12-15 Système de lecture braille par vibrations, et procédé d'implémentation de système de lecture braille par vibrations basés sur un écran tactile Ceased WO2018124564A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2016-0180691 2016-12-28
KR1020160180691A KR101848184B1 (ko) 2016-12-28 2016-12-28 진동점자시스템 및 터치스크린 기반 진동점자 구현방법

Publications (1)

Publication Number Publication Date
WO2018124564A1 true WO2018124564A1 (fr) 2018-07-05

Family

ID=61975925

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/014803 Ceased WO2018124564A1 (fr) 2016-12-28 2017-12-15 Système de lecture braille par vibrations, et procédé d'implémentation de système de lecture braille par vibrations basés sur un écran tactile

Country Status (2)

Country Link
KR (1) KR101848184B1 (fr)
WO (1) WO2018124564A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111144138A (zh) * 2019-12-17 2020-05-12 Oppo广东移动通信有限公司 一种同声传译方法及装置、存储介质
CN114740981A (zh) * 2022-04-25 2022-07-12 腾讯科技（深圳）有限公司 信息处理方法、装置、可读介质、电子设备及程序产品
WO2024012357A1 (fr) * 2022-07-14 2024-01-18 腾讯科技（深圳）有限公司 Procédé de rappel par vibration, dispositif associé et support de stockage informatique

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113160666B (zh) * 2021-05-12 2022-08-30 咪咕数字传媒有限公司 盲文阅读方法、电子设备及存储介质
CN119682680B (zh) * 2024-11-25 2025-12-16 岚图汽车科技股份有限公司 一种车辆防晕车控制方法、装置、介质、车辆

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010245795A (ja) * 2009-04-06 2010-10-28 Shigeru Ota 通信端末、通信サーバーおよび通信システム
US20120070805A1 (en) * 2010-09-21 2012-03-22 Sony Corporation Text-to-Touch Techniques
US20120218091A1 (en) * 2011-02-25 2012-08-30 Reagan Inventions Llc Device, system and method for mobile devices to communicate through skin response
KR20120136900A (ko) * 2011-06-10 2012-12-20 삼성전자주식회사 터치 스크린을 구비한 기기에서 점자 입력을 위한 장치 및 방법
JP2013214220A (ja) * 2012-04-03 2013-10-17 Sharp Corp 点字表記出力装置、点字表記出力方法、プログラム及び記憶媒体

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101610714B1 (ko) 2014-11-28 2016-04-08 포항공과대학교 산학협력단 점자 입출력 장치 및 이를 이용한 점자 입출력 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010245795A (ja) * 2009-04-06 2010-10-28 Shigeru Ota 通信端末、通信サーバーおよび通信システム
US20120070805A1 (en) * 2010-09-21 2012-03-22 Sony Corporation Text-to-Touch Techniques
US20120218091A1 (en) * 2011-02-25 2012-08-30 Reagan Inventions Llc Device, system and method for mobile devices to communicate through skin response
KR20120136900A (ko) * 2011-06-10 2012-12-20 삼성전자주식회사 터치 스크린을 구비한 기기에서 점자 입력을 위한 장치 및 방법
JP2013214220A (ja) * 2012-04-03 2013-10-17 Sharp Corp 点字表記出力装置、点字表記出力方法、プログラム及び記憶媒体

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111144138A (zh) * 2019-12-17 2020-05-12 Oppo广东移动通信有限公司 一种同声传译方法及装置、存储介质
CN114740981A (zh) * 2022-04-25 2022-07-12 腾讯科技（深圳）有限公司 信息处理方法、装置、可读介质、电子设备及程序产品
CN114740981B (zh) * 2022-04-25 2023-06-30 腾讯科技（深圳）有限公司 信息处理方法、装置、可读介质、电子设备及程序产品
WO2024012357A1 (fr) * 2022-07-14 2024-01-18 腾讯科技（深圳）有限公司 Procédé de rappel par vibration, dispositif associé et support de stockage informatique

Also Published As

Publication number Publication date
KR101848184B1 (ko) 2018-04-11

Similar Documents

Publication Publication Date Title
WO2018124564A1 (fr) Système de lecture braille par vibrations, et procédé d'implémentation de système de lecture braille par vibrations basés sur un écran tactile
JP7331245B2 (ja) 対象位置調整方法及び電子機器
WO2016208808A1 (fr) Dispositif d'affichage
JP7414986B2 (ja) 情報表示、送信方法及び電子機器
EP2901251A1 (fr) Dispositif d'affichage et son procédé de commande
WO2018056571A1 (fr) Clavier iot bluetooth capable d'un mappage de clavier personnalisé pour chaque utilisateur
CN101539969A (zh) 指纹感测装置及其操作模式切换方法和电子装置
KR101087640B1 (ko) 촉감 제시장치를 이용한 점자 교육 상호작용 시스템 및 그 방법
CN108475476B (zh) 通过布莱叶点字法发送和接收信息的手套形式的设备和方法
CN101620500A (zh) 汉字输入设备及其方法
WO2015115691A1 (fr) Terminal de communication mobile et boîtier pour terminal de communication mobile
WO2016133312A1 (fr) Procédé d'affichage de caractères pour personne atteinte de déficience visuelle au moyen d'un modèle haptique, écran tactile auquel est appliqué ce procédé, et dispositif d'affichage l'utilisant
CN108710483A (zh) 显示端的双向操作系统
KR20160135072A (ko) 이동 단말기 및 그 제어방법
JP2012156607A (ja) 視覚障がい者向け携帯端末装置
KR20100015165A (ko) 터치스크린 패드를 이용하는 사용자 입력 장치
KR102032196B1 (ko) 점자 인식이 가능한 하이브리드 워치
SE521283C2 (sv) Anordning för inmatning av styrsignaler till en elektronisk apparat
CN101179785A (zh) 包括可操作按键且能提示按键触碰的电子系统及控制方法
KR101819022B1 (ko) 시각장애인용 터치스크린 기반 점자입출력장치 및 이에 의한 점자입출력방법
CN101281564A (zh) 可携式保密装置
Pooja et al. Smart gloves for hand gesture recognition in Kannada
Mithun et al. (SHWASI) Smart Hand Wearable Aid for Speech Impaired: Sign Language Communication using Flex Sensor-based Finger Spelling
Kala et al. Development of device for gesture to speech conversion for the mute community
WO2015163500A1 (fr) Système d'ensemble de dispositifs électroniques comprenant un dispositif d'entrée assistée et dispositif électronique de traitement d'entrée l'utilisant

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17888389

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17888389

Country of ref document: EP

Kind code of ref document: A1