[go: up one dir, main page]

WO2016006949A1 - Systeme et procede pour le traitement de donnees au moyen d'un dispositif portable - Google Patents

Systeme et procede pour le traitement de donnees au moyen d'un dispositif portable Download PDF

Info

Publication number
WO2016006949A1
WO2016006949A1 PCT/KR2015/007132 KR2015007132W WO2016006949A1 WO 2016006949 A1 WO2016006949 A1 WO 2016006949A1 KR 2015007132 W KR2015007132 W KR 2015007132W WO 2016006949 A1 WO2016006949 A1 WO 2016006949A1
Authority
WO
WIPO (PCT)
Prior art keywords
wearable device
user
type wearable
pattern information
glass type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2015/007132
Other languages
English (en)
Korean (ko)
Inventor
한성철
엄정한
김진영
이경현
김대중
김석기
유철현
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nexsys Co ltd
Original Assignee
Nexsys Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020150042548A external-priority patent/KR101629758B1/ko
Application filed by Nexsys Co ltd filed Critical Nexsys Co ltd
Publication of WO2016006949A1 publication Critical patent/WO2016006949A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/36—User authentication by graphic or iconic representation

Definitions

  • the present invention relates to an information processing system and method using a wearable device, and more particularly, to a system and method for information processing data acquired during the activity of a user having a wearable device.
  • the present invention relates to a system, method and program for unlocking a glass type wearable device in an information processing system and method using a wearable device, and more particularly, to unlock a user by using a glass type wearable device.
  • An unlocking system and method thereof are provided.
  • the head mounted display device is mainly made of a safety glasses or a helmet type device to see the screen in front of the eyes, and was developed to realize virtual reality.
  • Glass-type wearable devices generally have a small display such as a liquid crystal installed at a position close to both eyes (both eyes) to project an image.
  • the wearable device is for use in space development, nuclear reactors, military institutions, and medical institutions.
  • Various developments for games and the like are in progress.
  • a glass type wearable device according to the prior art is also disclosed in US Pat. No. US8,427,396.
  • glass wearable devices Although various types of glass wearable devices have been researched and emerged, methods or services that wearers can conveniently utilize in daily life are very limited, and UI (User Interface) or UX (User Experience) suitable for glass wearable devices is very limited. Neither is it being developed. In addition, recently, glass-type wearable devices that can perform most functions by themselves, as well as glass-type wearable devices used in conjunction with mobile terminals such as smartphones, have been developed. Different from the mobile terminal of the need for a service suitable for the characteristics of the glass-type wearable device.
  • UI User Interface
  • UX User Experience
  • the lock is released by a user authentication by drawing a lock pattern on the display unit or a fingerprint recognition method, but the glass type wearable device There is no unlocking method suitable for the characteristics of.
  • An object of the present invention is to compare the pre-stored user authentication pattern information and input user authentication pattern information according to various types of user authentication method, and to unlock the glass type wearable device to unlock the system, method and program In providing.
  • a method of unlocking a glass type wearable device comprising: receiving input pattern information by the glass type wearable device; And releasing a device lock state by comparing the input pattern information with setting pattern information, wherein the input pattern information is obtained by a glass type wearable device from a user or by an external device, and the glass type wearable device.
  • the pattern information is transmitted to the pattern information, and the setting pattern information is pattern information previously stored in the glass type wearable device.
  • the pattern information may be a combination of at least one of a voice pattern, an iris pattern, an eye blink pattern, a heartbeat pattern, a pulse pattern, a palm pattern, a hand gesture pattern, and a head movement pattern.
  • the method may further include listing one or more user authentication schemes on the screen.
  • the method may further include selecting a specific user authentication method from the user.
  • the method may further include granting limited use rights to functions provided in the glass type wearable device according to the user authentication method.
  • the function provided by the glass type wearable device Granting limited usage rights may further include.
  • the method may further include applying, by the glass type wearable device, a setting state corresponding to the authenticated user when two or more users have stored the setting pattern information, and the setting state is different according to the user.
  • the setting state may include at least one of a using application, a user interface type, logged in account information, and stored data.
  • the method may further include: notifying the registered user through wireless communication when the user authentication approval fails more than a predetermined number of times.
  • the performing of the notification may include transmitting the current location information of the glass type wearable device.
  • the method may further include: obtaining a first outline from a specific input gesture in the input pattern information when the pattern information is a hand gesture pattern; Calculating a similarity degree by comparing the first outline with a second outline of a set gesture in the set pattern information; And determining the input gesture as the set gesture when the similarity corresponds to a specific value or more.
  • a difference between the first input gesture acquired at a specific time point and the second input gesture acquired before a specific time from the specific time point may be identified to recognize a change in the hand gesture input from the user.
  • the unlocking program for a glass-shaped wearable device executes the above-described unlocking method in combination with hardware and is stored in a medium.
  • the present invention it is possible to prevent others from using the glass-type wearable device without the user's consent.
  • the user can easily unlock the glass type wearable device. That is, the user can easily release the lock state when worn in a manner such as a head movement, an iris recognition, etc. in accordance with the characteristics of the glass type wearable device.
  • the security level can be set differently for each user authentication method.
  • the user may be given different usage rights according to the user, and thus, a plurality of users may provide convenience in using a single glass type wearable device.
  • the registered user can be notified of the failure to unlock by SMS or e-mail, and the location information of the glass wearable device can also be provided, thereby preventing the loss of the glass wearable device.
  • FIG. 1 is a block diagram of a glass type wearable device system according to an exemplary embodiment of the present invention.
  • FIG 2 is an exemplary view of a glass type wearable device related to one embodiment of the present invention.
  • FIG. 3 is a flowchart illustrating a method of releasing a glass type wearable device according to an exemplary embodiment of the present invention.
  • FIG. 4 is an exemplary screen of a glass type wearable device to which a unlocking method using voice recognition is applied according to an embodiment of the present invention.
  • FIG. 5 is a glass-type wearable device example screen to which a unlocking method is applied using a user's hand gesture pattern information recognition method according to an embodiment of the present invention.
  • FIG. 6 is a glass-type wearable device example screen to which the unlocking method using the user's moving pattern information recognition according to an embodiment of the present invention is applied.
  • 1 is a block diagram of a glass type wearable device system according to an exemplary embodiment of the present invention.
  • 2 is an exemplary view of a glass type wearable device related to one embodiment of the present invention.
  • 3 is a flowchart illustrating a method of releasing a glass type wearable device according to an exemplary embodiment of the present invention.
  • 4 is an exemplary screen of a glass type wearable device to which a unlocking method using voice recognition is applied according to an embodiment of the present invention.
  • 5 is a glass-type wearable device example screen to which a unlocking method is applied using a user's hand gesture pattern information recognition method according to an embodiment of the present invention.
  • 6 is a glass-type wearable device example screen to which the unlocking method using the user's moving pattern information recognition according to an embodiment of the present invention is applied.
  • the glass type wearable device 10 the input unit 100, the user input unit 110, the keyboard 111, the touch pad 112, the camera unit 120, the first camera 121, and the first 2 camera 122, the third camera 123, the sensing unit 130, gyro sensor 131, acceleration sensor 132, pressure sensor 133, iris sensor 134, heart rate detection sensor 135 , EMG sensor 136, voice input unit 140, control unit 210, voice recognition unit 220, situation evaluation module 230, voice-to-text conversion module 240, wireless communication unit 250, memory 260 ), An interface unit 270, an output unit 300, a display unit 310, an audio output unit 320, an alarm unit 330, and a haptic module 340 are illustrated.
  • FIG. 1 is a block diagram of a glass type wearable device system 10 according to an embodiment of the present invention.
  • the glass type wearable device system 10 may include an input unit 100, a user input unit 110, a keyboard 111, a touch pad 112, and a camera unit 120.
  • the components shown in FIG. 1 are not essential, so a glassy wearable device with more or less components may be implemented.
  • FIG 2 is an exemplary view of a glass type wearable device related to one embodiment of the present invention.
  • the components may be provided inside or on one side of the glass type wearable device as shown in FIG. 2.
  • the input unit 100 is for inputting an audio signal, a video signal, a user's manipulation signal, a biosignal, and the like.
  • the input unit 100 includes a user input unit 110, a camera unit 120, a sensing unit 130, and a voice input unit 140.
  • the user input unit 110 generates key input data input by the user for controlling the operation of the device.
  • the user input unit 110 may include a keypad, a keyboard 111, a dome switch, a touch pad (static pressure / capacitance) 112 (hereinafter, may also be referred to as a touch unit), a jog wheel, a jog Switch, finger mouse, or the like.
  • a touch pad static pressure / capacitance 112
  • the camera 120 is for inputting a video signal or an image signal, and two or more cameras 120 may be provided according to a configuration aspect of the device.
  • the camera 120 processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a photographing mode.
  • the processed image frame may be displayed on the display 310.
  • the image frame processed by the camera 120 may be stored in the memory 260 or transmitted to the outside through the wireless communication unit 250.
  • the control unit 210 transmits the image signal and the video signal.
  • the camera unit 120 may include one or more cameras according to the direction or purpose of the captured image.
  • the first camera 121 may be provided at one side of the glass type wearable device to capture an image of the front side.
  • the second camera 122 may be provided at one side of the glass type wearable device to acquire an image or an image in an eyeball direction.
  • the third camera 123 may be provided at the rear or side of the glass type wearable device 10 to acquire an image or an image of the rear or side.
  • the sensing unit 130 generates a sensing signal for controlling the operation of the device by detecting the current state of the device, such as whether the user wears the glass-shaped wearable device 10 or the position of the device.
  • the sensing unit 130 may perform a function of an input unit receiving an input signal for information processing of the device, and may perform various sensing functions such as whether an external device is connected or not.
  • the sensing unit 130 includes a proximity sensor, a pressure sensor 133, a motion sensor, a fingerprint recognition sensor, an iris recognition sensor 134, a heart rate detection sensor 135, a skin temperature sensor, a skin resistance sensor and an electrocardiogram sensor. And various sensors.
  • the proximity sensor can detect the presence or absence of an approaching object or an object present in the vicinity without mechanical contact.
  • the proximity sensor can detect a proximity object by using a change in an alternating magnetic field or a change in a static magnetic field, or by using a change rate of capacitance.
  • Two or more proximity sensors may be provided according to the configuration aspect.
  • the pressure sensor 133 may detect whether the glass type wearable device 10 is pressed, the magnitude of the pressure, and the like.
  • the pressure sensor 133 may be installed at a portion of the glass type wearable device 10 that requires the detection of pressure according to the use environment. If the pressure sensor 133 is installed in the display 310, a touch input through the display 310 and a greater pressure than the touch input are applied according to the signal output from the pressure sensor 133. The pressure touch input can be identified. In addition, according to the signal output from the pressure sensor 133, it is also possible to know the magnitude of the pressure applied to the display 310 when the pressure touch input.
  • the motion sensor includes one or more of sensors such as a gyro sensor 131, an acceleration sensor 132, and a geomagnetic sensor, and detects the position or movement of the glass type wearable device 10 using the same.
  • the acceleration sensor 132 that can be used for a motion sensor is a device that converts an acceleration signal in one direction into an electrical signal, and is widely used with the development of micro-electromechanical systems (MEMS) technology.
  • MEMS micro-electromechanical systems
  • the gyro sensor 131 is a sensor for measuring the angular velocity, and may sense a direction returned to the reference direction.
  • the heart rate detection sensor 135 measures the change in the light blood flow rate according to the change in blood vessel thickness due to the heartbeat.
  • the skin temperature sensor measures the skin temperature as the resistance value changes in response to the temperature change.
  • Skin resistance sensors measure the electrical resistance of the skin.
  • the iris recognition sensor 134 performs a function of recognizing a person using iris information of an eye having unique characteristics for each person.
  • the human iris is completed after 18 months of age, and then the circular iris pattern, which is raised near the inner edge of the iris, is almost unchanged once determined. Therefore, iris recognition is the application of security authentication technology by informatizing the characteristics of different iris for each person. In other words, it is an authentication method developed as a means of identifying people by analyzing the shape and color of the iris and the morphology of the retinal capillaries.
  • the iris recognition sensor 134 codes and compares the iris pattern with an image signal, and determines the comparison.
  • the general operation principle is as follows. First, when the user's eyes are focused on the mirror in the center of the iris recognizer at a certain distance, the infrared camera adjusts the focus through the zoom lens. Then, the iris camera images the user's iris into a photograph, and the iris recognition algorithm analyzes the iris contrast patterns by area to generate a unique iris code. Finally, a comparison search is performed as soon as the iris code is registered in the database.
  • the iris recognition sensor 134 may be provided inside the second camera 122 disposed in the eye direction, and in this case, the second camera 122 may perform a function of the iris recognition sensor.
  • the distance sensor includes a distance measurement method between two points, a triangulation method (infrared ray type, natural light type), and ultrasonic type.
  • a triangulation method infrared ray type, natural light type
  • ultrasonic type As in the conventional triangulation principle, the distance between two points is displayed when the measured objects from the two paths are reflected by the right angle prism and incident on the two image sensors so that the relative positions match.
  • the ultrasonic method is a method in which the distance is measured by transmitting an ultrasonic wave having a sharp directivity to the object to be measured and receiving a reflected wave conveyed from the object to be measured.
  • the receiving sensor uses a piezoelectric element.
  • the Doppler radar is a radar that utilizes a phase change of the reflected wave, that is, a Doppler effect of the wave.
  • the doppler radar includes a continuous wave radar that transmits and receives a sine wave which is not pulse modulated, and a pulse radar that uses pulse modulated radio waves as an electromagnetic wave signal waveform.
  • Continuous wave radar is unsuitable for long range radar because modulating frequency is relatively high in order to obtain the performance of Doppler frequency filter. There are features that can be.
  • the pulse radar measures the distance to the target by the time from pulse transmission to reflection echo reception.
  • the voice input unit 140 is for inputting a voice signal and may include a microphone.
  • the microphone receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes it into electrical voice data.
  • the processed voice data may be converted into a form transmittable to the mobile communication base station through the wireless communication unit 250 and output in the call mode.
  • various noise canceling algorithms may be used to remove noise generated while receiving an external sound signal.
  • the output unit 300 is for outputting an audio signal, an image signal, a video signal or an alarm signal.
  • the output unit 300 may include a display unit 310, a sound output unit 320, an alarm unit 330, and a haptic module 340.
  • the display 310 displays and outputs information processed by the device. For example, when the device is in a call mode, the device displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the device is in a video call mode or a photographing mode, the captured or received images may be displayed at the same time or simultaneously, and the UI and the GUI may be displayed.
  • UI user interface
  • GUI graphic user interface
  • the display unit 310 may be used as an input device in addition to the output device. If the display unit 310 is configured as a touch screen, the display unit 310 may include a touch screen panel and a touch screen panel controller.
  • the display unit 310 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. It may include at least one of (3D display).
  • two or more display units 310 may exist according to the implementation form of the device. For example, the external display unit 310 and the internal display unit 310 may be simultaneously provided in the device.
  • the display unit 310 may be implemented as a head up display (HUD), a head mounted display (HMD), or the like.
  • HMD Head mounted Display
  • a head up display (HUD) is an image display device for projecting a virtual image onto glass in a user's visible area.
  • the sound output unit 320 outputs audio data received from the wireless communication unit or stored in the memory 260 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like.
  • the sound output module 320 outputs a sound signal related to a function performed in the device, for example, a call signal reception sound and a message reception sound.
  • the sound output module 320 may include a speaker, a buzzer, and the like.
  • the alarm unit 330 outputs a signal for notifying occurrence of an event of the device. Examples of events occurring in the device include call signal reception, message reception, and key signal input.
  • the alarm unit 330 outputs a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration.
  • the alarm unit 330 may output a signal to notify the call signal when the call signal is received or a message is received. Also.
  • the key signal is input, the alarm unit 330 may output the signal as a feedback to the key signal input. The user may recognize the occurrence of an event through the signal output from the alarm unit 330.
  • the signal for notifying the event occurrence in the device may also be output through the display 310 or the sound output unit.
  • the haptic module 340 generates various haptic effects that a user can feel.
  • a representative example of the haptic effect generated by the haptic module 340 is a vibration effect.
  • the haptic module 340 When the haptic module 340 generates vibration by the tactile effect, the intensity and pattern of the vibration generated by the haptic module 340 may be converted, and may be output by combining different vibrations or sequentially.
  • the wireless communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless internet module, a short range communication module, and a location information module.
  • the broadcast receiving module receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel.
  • the broadcast channel may include a satellite channel, a terrestrial channel, and the like.
  • the broadcast management server may mean a server that generates and transmits at least one of a broadcast signal and broadcast related information, or a server that receives at least one of the pre-generated broadcast signal and broadcast related information and transmits the same to a terminal.
  • the broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider.
  • the broadcast related information may also be provided through a mobile communication network, and in this case, may be received by the mobile communication module.
  • Broadcast related information may exist in various forms.
  • the broadcast receiving module may receive a broadcast signal using various broadcast systems, and receive a digital broadcast signal using a digital broadcast system.
  • the broadcast receiving module may be configured to be suitable for all broadcast systems providing broadcast signals as well as such digital broadcast systems.
  • the broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in the memory 260.
  • the mobile communication module transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network.
  • the wireless signal may include various types of data according to voice call signal, video call signal, or text / multimedia message transmission and reception.
  • the wireless internet module refers to a module for wireless internet access, and the wireless internet module may be embedded or external to the device.
  • Wireless Internet technologies include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), long term evolution (LTE), LTE-A Long Term Evolution-Advanced and the like can be used.
  • the short range communication module refers to a module for short range communication.
  • Beacon, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used as a short range communication technology.
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wideband
  • ZigBee ZigBee
  • the location information module refers to a module that receives the positioning signal and measures the position of the glass type wearable device.
  • the position information module may correspond to a Global Position System (GPS) module, and the positioning signal may correspond to a GPS signal.
  • GPS Global Position System
  • the Global Position System (GPS) module receives position information from a plurality of GPS satellites.
  • the memory 260 may store a program for processing and controlling the controller 210, and may perform a function for temporarily storing input or output data (eg, a message, a still image, a video, etc.). It may be.
  • input or output data eg, a message, a still image, a video, etc.
  • the memory 260 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM
  • the storage medium may include at least one type of storage medium.
  • the device may operate a web storage that performs a storage function of a memory on the Internet.
  • the memory 260 may be referred to as a storage 260 hereinafter.
  • the interface unit 270 serves as an interface with all external devices connected to the device. Examples of external devices that connect to the device include wired / wireless headsets, external chargers, wired / wireless data ports, memory cards, card sockets such as Subscriber Identification Module (SIM) or User Identity Module (UIM) cards, Audio I / O (Input / Output) terminals, video I / O (Input / Output) terminals, earphones, and the like.
  • SIM Subscriber Identification Module
  • UIM User Identity Module
  • the interface unit 270 may receive data from such an external device or receive power and transfer the data to each component within the device, and may transmit data within the device to the external device.
  • the controller 210 typically controls the operation of each unit to perform a function of controlling the overall operation of the device. For example, perform related control and processing for voice calls, data communications, and the like. In addition, the controller 210 performs a function of processing data for multimedia reproduction. In addition, it performs a function of processing the data received from the input unit 100 or the sensing unit 130.
  • the controller 210 performs face detection and face recognition for face recognition. That is, the controller 210 may include a face detection module and a face recognition module for face recognition.
  • the face detection module may extract only the face area from the camera image acquired by the camera unit 120. For example, the face detection module extracts a face region by recognizing feature elements in the face such as eyes, nose, and mouth.
  • the face recognition module may generate a template by extracting feature information from the extracted face region, and recognize a face by comparing a template with face information data in a face database.
  • the controller 210 may perform a function of extracting and recognizing a character from an image or an image acquired by the camera unit 120. That is, the controller 210 may include a character recognition module for character recognition.
  • Optical character recognition may be applied as a character recognition method of the character recognition module.
  • OCR Optical character recognition
  • the OCR method converts a typeface image of a document written by a person who can be obtained by an image scan or printed by a machine into a format such as a computer code that can be edited by a computer, and can be implemented by software.
  • the OCR method may compare several standard pattern letters and input characters prepared in advance and select the most similar to the standard pattern letters as the corresponding letters.
  • the character recognition module includes standard pattern letters of various languages, it is possible to read printed characters of various languages. Such a method is called a pattern matching method among the OCR methods, and the OCR method is not limited thereto, and various methods may be applied. In addition, the character recognition method of the character recognition module is not limited to the OCR method, various methods for recognizing the character on the offline already printed may be applied.
  • the controller 210 may perform a function of recognizing a gaze direction based on an eyeball image or an image acquired by the second camera 122. That is, the controller 210 may include a gaze analysis module that performs gaze direction recognition. The direction of the user's gaze and the gaze may be measured and then calculated by synthesis to determine the user's direction.
  • the gaze direction may mean a direction of the face of the user and may be measured by the gyro sensor 131 or the acceleration sensor 132 of the sensing unit 130. The gaze direction may be grasped by the gaze analysis module in a direction viewed by the user's pupil.
  • the gaze analysis module may detect a movement of a pupil through analysis of a real-time camera image, and apply a method of calculating a direction of a gaze based on a fixed position reflected by the cornea. For example, through the image processing method, the position of the corneal reflected light by the center of the pupil and the illumination may be extracted and the gaze position may be calculated through the positional relationship thereof.
  • the controller 210 may be represented by the information processor 210.
  • the power supply unit receives an external power source and an internal power source under the control of the controller 210 to supply power for operation of each component.
  • the speech recognition unit 220 performs a function of identifying linguistic meaning content from the speech by automatic means. Specifically, the process of identifying a word or word sequence and extracting meaning by inputting a speech waveform is classified into five categories: speech analysis, phoneme recognition, word recognition, sentence interpretation, and meaning extraction.
  • the voice recognition unit 220 may further include a voice evaluation module for comparing whether the stored voice and the input voice are the same.
  • the voice recognition unit 220 may further include a voice-to-text conversion module 240 for converting an input voice into text or converting a text into voice.
  • the EEG signal generation unit generates an EEG signal having a frequency and a waveform for tuning human EEG. That is, the EEG signal generator transmits the vibration of the EEG frequency to the skull to perform the function of tuning the EEG.
  • EEG is the flow of electricity that occurs when a cranial nerve signal is transmitted. These brain waves are delta waves, which are very slow when you sleep, beta waves, which are fast when you are active, and alpha waves, which are medium speeds when you meditate. Therefore, the EEG signal generator may induce alpha waves and theta waves to exert the effects of learning assistance and mental concentration.
  • FIG. 3 is a flowchart illustrating a method of releasing a glass type wearable device according to an exemplary embodiment of the present invention.
  • the method for unlocking a glass type wearable device may include: receiving input pattern information by the glass type wearable device (S100); And releasing the device lock state by comparing the input pattern information with the setting pattern information (S200).
  • the unlocking method according to an embodiment of the present invention will be described in order.
  • the glass type wearable device 10 receives input pattern information (S100).
  • the pattern information may include at least one of a voice pattern, an iris pattern, an eye blink pattern, a heartbeat pattern, a pulse pattern, a palm pattern, a gesture pattern as illustrated in FIG. 5, or a head movement pattern as illustrated in FIG. 6. It is a combination.
  • the pattern information is not limited to the user authentication method described above, and any user authentication method that can be implemented by various input information through the sensing unit 130 and the user input unit 110 of the glass type wearable device 10. It may include.
  • the input pattern information is pattern information that the glass type wearable device 10 is obtained from a user or obtained by an external device and transmitted to the glass type wearable device.
  • the glass type wearable device 10 releases the device lock state by comparing the input pattern information with setting pattern information (S200).
  • the setting pattern information is pattern information previously stored in the glass type wearable device 10.
  • the glass type wearable device 10 releases the lock state so that the user can use the glass type wearable device 10 when the input pattern information matches the pre-stored set pattern information. Can be.
  • the glass type wearable device 10 may receive a high motion from a user and display the recognized high motion direction on the display 310. The user may check whether the head movement direction input by the user through the display 310 is properly input.
  • the glass type wearable device 10 may display a specific input sentence on the display 310 to request a user to read the input sentence by voice. Thereafter, the controller 210 of the glass type wearable device 10 may compare the pre-stored voice pattern with the input voice pattern, and release the lock state if the two match.
  • the glass type wearable device 10 may sequentially receive a hand gesture pattern formed by a combination of one or more hand gestures through the first camera 121. Thereafter, the glass type wearable device 10 may determine whether to release the locked state by comparing the input hand gesture pattern information with previously stored hand gesture pattern information. When the input hand gesture pattern information and the pre-stored hand gesture pattern information match, the glass type wearable device 10 may release the lock state so that the user can utilize various functions.
  • the method may further include listing one or more user authentication schemes on the screen. And selecting a specific user authentication method from the user.
  • the user may identify and select a user authentication method for using the glass type wearable device 10 through the display 310.
  • the method may further include granting limited use authority to a function provided by the glass type wearable device 10 according to the user authentication method. Since some user authentication methods can be easily recognized by others, it is necessary to restrict the use of some functions by granting only limited use rights when unlocking the user authentication method. For example, the eye blink pattern information can be easily recognized and stolen by other persons than the registered user, compared to the iris recognition information. Therefore, the use of a function including personal information can be restricted when authenticating the user by the eye blink pattern information. have.
  • the glass type wearable device 10 when more than one user stores the setting pattern information, when the user corresponding to the specific setting pattern information corresponds to a user whose use authority of the glass type wearable device 10 is limited, the glass type wearable device 10
  • the step of granting limited use rights for the functions provided in the; may further include. That is, when the lock state is released by setting pattern information for user authentication of a specific user among registered users, the usable function of the glass type wearable device may be limited.
  • the method may further include the step of applying, by the glass type wearable device 10, a setting state corresponding to the authenticated user when two or more users have stored the setting pattern information, and the setting state is different according to the user.
  • the setting state may include at least one of a user application, a user interface (UI) type, logged in account information, and stored data. That is, when more than one user stores setting pattern information for user authentication, the data stored in the glass type wearable device 10 is different for each user, and the function of the glass type wearable device 10 used may be different. have.
  • stored data such as personal information for each user should not be disclosed to other users. Accordingly, the glass type wearable device 10 may load data from the storage unit 260 according to the user who stores the setting pattern information, and the user may apply a user function and a UI set by the user.
  • the method may further include: notifying the registered user through wireless communication when the user authentication approval fails more than a predetermined number of times.
  • the notification method through wireless communication may include a notification SMS or an e-mail. Through this, the registered user can recognize the fact that someone attempts to unlock the device, thereby preventing the loss of the glass type wearable device 10.
  • the performing of the notification may include transmitting the current location information of the glass type wearable device. If the glass type wearable device is lost, the location information of the device may be transmitted to the registered user according to a user authentication failure, thereby helping to find the lost device.
  • the glass type wearable device 10 extracts a first outline and a second outline, which are outlines of the input gesture and the set gesture, calculates similarity between the first outline and the second outline, and determines whether the input gesture and the set gesture match. You can judge.
  • the change of the input gesture may be recognized by calculating a difference between a first input gesture acquired at a specific time point and a second input gesture acquired before a specific time from the specific time point. That is, when the lock pattern is configured with a plurality of input gestures, the pattern information may be sequentially received only when the change of the hand gesture is recognized. Therefore, the glass type wearable device 10 compares the first input gesture acquired in real time with the second input gesture acquired before a specific time to determine a difference, and if the difference value is equal to or greater than a specific value, the second input gesture is determined. It may be recognized as changed to the first input gesture. Through this, the glass type wearable device 10 may receive the input gestures in order and release the lock state through the gesture pattern.
  • an embodiment of the present invention may further include displaying on the display 310 whether the user authentication is approved. That is, the user may check whether the user authentication is approved by the input pattern information through the display 310. In addition, the user may attempt to authenticate the user again through a user authentication failure message displayed on the display 310.
  • the unlocking system of the glass type wearable device includes an authentication information input unit 100 and a control unit 210.
  • the authentication information input unit performs a function of receiving user authentication pattern information according to a user authentication method.
  • the authentication information input unit includes a sensing unit 130, a user input unit 110, a voice input unit 140, and the camera unit 120. That is, the authentication information input unit motion sensor and heart rate detection sensor 135 of the user input unit 110, the first camera 121 and the second camera 122 of the camera unit 120, the sensing unit 130. ), And may include at least one of the voice input unit 140.
  • the voice input unit 140 receives the voice information of the user to be compared with the preset voice information of the user.
  • Motion sensors such as the acceleration sensor 132 or gyro sensor 131 receives the user's moving pattern.
  • the heartbeat detection sensor 135 receives the heartbeat pattern information of the user.
  • the first camera 121 is coupled to one side of the front portion of the glass type wearable device to receive a user's hand gesture pattern.
  • the second camera 122 is coupled to the glass type wearable device in the direction of the user's eye and includes an iris recognition sensor 134 to receive the user's iris pattern information and eye blink pattern information.
  • the controller 210 determines whether the input user authentication pattern information matches the stored user authentication pattern information. For example, as shown in FIG. 6, when the high motion pattern information is inputted by the motion sensor, the controller 210 compares the high motion pattern information with the stored motion pattern information, and determines whether there is a match. When the hand gesture pattern information is input by comparison, the hand gesture pattern information is compared with the stored hand gesture pattern information.
  • the controller 210 may include a voice recognition unit 220 to compare the input voice pattern information with the stored voice pattern information.
  • the controller 210 performs a function of instructing the glass type wearable device 10 to operate normally when the input user authentication pattern information matches the stored user authentication pattern information.
  • the controller 210 may perform a function of granting limited use authority to a function provided by the glass type wearable device 10 according to a user authentication method.
  • the controller 210 may classify the user authentication method according to the user's setting, and limit the use of some functions by restricting the use right of the glass type wearable device 10 when authenticating the user according to a specific user authentication method.
  • the eye blink pattern information may be easily recognized and stolen by other persons than the registered user, compared to the iris recognition information, so that the controller 210 may personalize the personal information according to the user's setting when authenticating the user by the eye blink pattern information. You can limit the use of the included functions.
  • the controller 210 corresponds to a user whose usage authority of the glass type wearable device is limited as a result of the user authentication. Can perform a function that grants limited permissions.
  • the controller 210 may limit the usable functions of the glass type wearable device 10.
  • an embodiment of the present invention may further include a display unit 310 for displaying a user authentication method, a user authentication process, and a user authentication result to be input to the user.
  • the display unit 310 functions to display a screen. As shown in FIGS. 4 to 6, the display unit 310 displays a user authentication method to be input, and if the user authentication pattern information is input, compares with the previously stored user authentication pattern information. In addition, when the glass type wearable device receives a user's moving pattern information or hand gesture pattern information, the display unit 310 displays the recognized pattern information to confirm whether the received pattern information is correctly recognized by the device. To perform the function.
  • the touch unit 112 may provide a direction and a selection interface to allow a user to select a specific user authentication method.
  • the touch unit 112 refers to a configuration capable of inputting a signal to the glass type wearable device 10 by a user's manipulation.
  • the touch unit 112 performs a function of allowing a user to select a user authentication method when at least one user authentication method is stored in the glass type wearable device 10.
  • the touch unit 112 may be combined with the display unit 310 to be implemented in the form of a touch screen.
  • the user may select a portion in which the user authentication method to be input is displayed and input pattern information of the corresponding user authentication method.
  • the touch unit 112 may be implemented in a manner of manipulating a specific portion of the glass type wearable device 10.
  • the glass type wearable device 10 includes the touch unit 112 at one side, and the user may change the touch unit 112 according to the number of times of operating the touch unit 112, a slide method, or a time of operating the touch unit 112. You can choose a user authentication method.
  • the touch unit 112 is not limited to the side portion, but may be provided at various positions of the glass type wearable device.
  • the method of selecting one of the one or more user authentication methods is not limited to the previously presented method, and various methods that can be implemented by the touch unit 112 and the touch unit 112 may be applied and implemented.
  • the voice input unit 140 may be characterized by receiving a voice command of the user so that the user can select a specific user authentication method.
  • the wireless communication unit 250 for transmitting an SMS or e-mail to the registered user may further include.
  • control unit 210 may be characterized by setting the number of user authentication failures for transmitting SMS or e-mail to a registered user. Since even the registered user may not recognize the pattern information properly and fail the user authentication, the controller 210 may set the number of consecutive user authentication failures allowed according to the user designation.
  • controller 210 may limit unlocking of the glass type wearable device 10 for a predetermined time when the user authentication fails a corresponding number of times.
  • the apparatus may further include a GPS signal unit that provides location information of the glass type wearable device to an SMS or an e-mail transmitted to a registered user.
  • the GPS signal unit performs a function of transmitting the location information of the device to a registered user according to the failure of unlocking the other person when the glass type wearable device is lost, and thus the user can identify the location of the device so that the device is lost. It helps to find.
  • the unlocking method using the glass-type wearable device according to the embodiment of the present invention described above is implemented as a program (or an application) to be executed in combination with the glass-type wearable device 10 which is hardware to be stored in a medium. Can be.
  • the processor CPU of the glassy wearable device 10 may execute the glassy wearable device ( 10) may include code coded in a computer language such as C, C ++, JAVA, or machine language that can be read through the device interface.
  • code may include functional code associated with a function or the like that defines the necessary functions for executing the methods, the execution of which is required for the processor of the glassy wearable device 10 to execute according to a predetermined procedure. Procedure-related control codes.
  • such code requires that additional information or media required to execute the functions by the processor of the glassy wearable device 10 is referred to at any position (address address) of the internal or external memory of the glassy wearable device 10. It may further include a memory reference code for whether or not.
  • the code may be configured to communicate with the communication module of the glass type wearable device 10. It may further include communication-related code, such as how to communicate with any other computer or server in the remote, what information or media should be transmitted and received during communication.
  • the stored medium is not a medium for storing data for a short time such as a register, a cache, a memory, but semi-permanently, and means a medium that can be read by the device.
  • examples of the storage medium include, but are not limited to, a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
  • the program may be stored in various recording media on various servers accessible by the glass type wearable device 10 or various recording media on the glass type wearable device 10 of the user.
  • the media may also be distributed over network coupled computer systems so that the computer readable code is stored in a distributed fashion.
  • the present invention it is possible to prevent others from using the glass-type wearable device without the user's consent.
  • the user can easily unlock the glass type wearable device.
  • the security level can be set differently for each user authentication method.
  • the user may be given different usage rights according to the user, thereby providing convenience for a plurality of users to use a single glass type wearable device.
  • the registered user can be notified of the failure to unlock by SMS or e-mail, and the location information of the glass wearable device can also be provided, thereby preventing the loss of the glass wearable device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention concerne un procédé et un programme pour libérer le verrou d'un dispositif portable à lunette. Le procédé pour libérer le verrou selon la présente invention comprend les étapes suivantes: la réception par le dispositif portable à lunette, d'une information de motif entré; et la libération de l'état verrouillé du dispositif en comparant l'information de motif entré avec l'information de motif configuré, et, ainsi, la présente invention peut fournir l'avantage d'empêcher l'utilisation par un étranger du dispositif portable de type lunettes, sans le consentement de l'utilisateur.
PCT/KR2015/007132 2014-07-11 2015-07-09 Systeme et procede pour le traitement de donnees au moyen d'un dispositif portable Ceased WO2016006949A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR20140087201 2014-07-11
KR10-2014-0087201 2014-07-11
KR1020150042548A KR101629758B1 (ko) 2014-07-11 2015-03-26 글라스형 웨어러블 디바이스의 잠금해제 방법 및 프로그램
KR10-2015-0042548 2015-03-26

Publications (1)

Publication Number Publication Date
WO2016006949A1 true WO2016006949A1 (fr) 2016-01-14

Family

ID=55064504

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/007132 Ceased WO2016006949A1 (fr) 2014-07-11 2015-07-09 Systeme et procede pour le traitement de donnees au moyen d'un dispositif portable

Country Status (1)

Country Link
WO (1) WO2016006949A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019045845A1 (fr) * 2017-08-31 2019-03-07 Microsoft Technology Licensing, Llc Octroi de privilège à facteurs multiples
US12346500B1 (en) 2023-04-17 2025-07-01 Snap Inc. EMG speech signal detection

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130069787A1 (en) * 2011-09-21 2013-03-21 Google Inc. Locking Mechanism Based on Unnatural Movement of Head-Mounted Display
KR20130030735A (ko) * 2011-09-19 2013-03-27 오베르뛰르 테크놀로지스 뷰잉 스테이션을 이용하는 사용자를 위한 통신 방법 및 안경 타입의 연관된 시스템
KR101286750B1 (ko) * 2011-12-23 2013-08-23 심광호 제스처를 이용한 패스워드 판단시스템
US20140010417A1 (en) * 2012-07-04 2014-01-09 Korea Advanced Institute Of Science And Technology Command input method of terminal and terminal for inputting command using mouth gesture
KR20140066258A (ko) * 2011-09-26 2014-05-30 마이크로소프트 코포레이션 투시 근안 디스플레이에 대한 센서 입력에 기초한 비디오 디스플레이 수정

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130030735A (ko) * 2011-09-19 2013-03-27 오베르뛰르 테크놀로지스 뷰잉 스테이션을 이용하는 사용자를 위한 통신 방법 및 안경 타입의 연관된 시스템
US20130069787A1 (en) * 2011-09-21 2013-03-21 Google Inc. Locking Mechanism Based on Unnatural Movement of Head-Mounted Display
KR20140066258A (ko) * 2011-09-26 2014-05-30 마이크로소프트 코포레이션 투시 근안 디스플레이에 대한 센서 입력에 기초한 비디오 디스플레이 수정
KR101286750B1 (ko) * 2011-12-23 2013-08-23 심광호 제스처를 이용한 패스워드 판단시스템
US20140010417A1 (en) * 2012-07-04 2014-01-09 Korea Advanced Institute Of Science And Technology Command input method of terminal and terminal for inputting command using mouth gesture

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019045845A1 (fr) * 2017-08-31 2019-03-07 Microsoft Technology Licensing, Llc Octroi de privilège à facteurs multiples
US12346500B1 (en) 2023-04-17 2025-07-01 Snap Inc. EMG speech signal detection

Similar Documents

Publication Publication Date Title
KR102173699B1 (ko) 안구 신호들의 인식 및 지속적인 생체 인증을 위한 시스템과 방법들
WO2020017706A1 (fr) Dispositif électronique et procédé pour le commander
KR101661555B1 (ko) 비콘을 이용한 글라스형 웨어러블 디바이스의 카메라 기능 제한방법 및 프로그램
WO2019125084A1 (fr) Systèmes et procédés d'authentification biométrique d'un utilisateur
WO2019013517A1 (fr) Appareil et procédé pour contexte de commande vocale
WO2016098950A1 (fr) Procédé pour mettre à jour un modèle de caractéristique biologique, et dispositif électronique associé
CN108206892B (zh) 联系人隐私的保护方法、装置、移动终端及存储介质
WO2018124633A1 (fr) Dispositif électronique et procédé de délivrance d'un message par celui-ci
WO2017034225A1 (fr) Appareil électronique et procédé de transformation de contenu associé
KR20160017593A (ko) 글라스형 웨어러블 디바이스를 이용한 탈출경로 제공방법 및 프로그램
WO2018080198A1 (fr) Dispositif électronique et procédé pour effectuer une authentification
KR101684264B1 (ko) 글라스형 웨어러블 디바이스의 버스도착 알림방법 및 이를 이용한 글라스형 웨어러블 디바이스용 프로그램
WO2016021907A1 (fr) Système de traitement d'informations et procédé utilisant un dispositif à porter sur soi
KR20160011302A (ko) 글라스형 웨어러블 디바이스의 영상 또는 이미지 처리시스템 및 처리방법
KR102251710B1 (ko) 글라스형 웨어러블 디바이스를 이용한 외부디바이스 내 콘텐츠 관리 시스템, 방법 및 컴퓨터로 독출 가능한 기록매체
KR20160015142A (ko) 글라스형 웨어러블 디바이스를 이용한 긴급시 비상연락방법 및 프로그램
WO2016010328A1 (fr) Système de traitement d'informations et procédé utilisant un dispositif portatif
KR101629758B1 (ko) 글라스형 웨어러블 디바이스의 잠금해제 방법 및 프로그램
KR101728707B1 (ko) 글라스형 웨어러블 디바이스를 이용한 실내 전자기기 제어방법 및 제어프로그램
WO2016006920A1 (fr) Système et procédé pour traiter des informations à l'aide d'un dispositif vestimentaire
WO2018021726A1 (fr) Dispositif électronique et procédé de commande d'activation d'un module de caméra
WO2018128357A1 (fr) Dispositif électronique de traitement de signal vidéo et support d'enregistrement lisible par ordinateur
WO2016006949A1 (fr) Systeme et procede pour le traitement de donnees au moyen d'un dispositif portable
JP2015062516A (ja) 管理方法及び管理システム
WO2016013858A2 (fr) Système et procédé de traitement d'informations à l'aide d'un dispositif portable

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15818301

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15818301

Country of ref document: EP

Kind code of ref document: A1