KR102224933B1 - Method for unlocking user equipment based on eye location, user equipment releasing lock based on eye location and computer readable medium having computer program recorded therefor - Google Patents

Abstract

The present invention discloses a user device that performs an unlock based on a pupil position, a method for unlocking a user device based on the pupil position, and a recording medium in which a computer program is recorded. That is, the present invention collects pupil position information input to the user device, compares the order of the direction in which the detected pupil position moves with the order of a preset direction to determine whether they match, and then determines whether the user device is You can decide whether to unlock or not. By using this method, it is possible to increase security as well as provide a more convenient and user-friendly environment than conventional key input.

Description

A user device that performs unlocking based on the pupil position, a method for unlocking user equipment based on eye location, and a recording medium in which a computer program is recorded. computer readable medium having computer program recorded therefor}

The present invention relates to a user device for performing an unlock based on the pupil position, a method for unlocking a user device based on the pupil position, and a recording medium in which a computer program is recorded, and in particular, to calculate a coordinate value based on the position of the pupil, The present invention relates to a user device for unlocking by using this, a method for unlocking a user device based on a pupil position, and a recording medium in which a computer program is recorded.

Mobile terminals, including mobile phones, are now indispensable to modern people. The mobile terminal, which appeared as a simple calling function, has evolved into a mobile communication terminal, that is, a camera phone, equipped with a camera that can take pictures on the fly and transmit them to a mobile phone thanks to rapid technological advancement. It is equipped. As the popularity of the camera phone is rapidly spreading as described above, the demand for the camera phone is also increasing rapidly, and the evolution of the camera phone is also rapidly progressing accordingly.

Smartphones can be equipped with various functions and applications, and as the range of use is wide, various personal information such as personal information or financial information of the user (owner) is stored, and personal information must be guaranteed accordingly. In the security method of setting a password or encryption key, it is difficult to ensure the safety of such personal information even though most smartphones are personal-only terminals.

Recently, with the development of smart phone technology using a camera, an unlocking technology using face recognition has been used, but there is a problem that this can be bypassed using a photo. Accordingly, there has been an improvement plan to check whether an eye blinks or an image that is not identical is continuously input, but there is a problem that it can be bypassed through video playback.

Korean Patent Laid-Open Patent No. 10-2006-0062117 [Name: Security management method using iris password of mobile communication terminal]

An object of the present invention is to provide a user device that performs unlocking based on the pupil position in order to prevent unauthorized use of a user device by a third party, a method of unlocking a user device based on the pupil position, and a recording medium in which a computer program is recorded. I have to.

Another object of the present invention is a user device that performs unlocking based on the pupil position without a separate touch to the terminal for unlocking so as to improve the convenience of unlocking the user device, and unlocking the user device based on the pupil position It is to provide a recording medium on which a method and a computer program are recorded.

Another object of the present invention is a user device that performs user authentication by combining the movement of the pupil and the user's face recognition to unlock based on the pupil position with improved security, a method for unlocking the user device based on the pupil position, and It is to provide a recording medium on which a computer program is recorded.

A user device for unlocking based on a pupil position according to an embodiment of the present invention includes: a camera unit for collecting pupil position information on the position of the user device to which the pupil of the user gazes; A position measuring unit sequentially detecting a direction in which the position of the pupil moves based on the pupil position information; And a control unit configured to compare the order of the direction in which the detected pupil position moves with the order of the preset direction to determine whether they match or not, and then release the lock according to the result.

As an example related to the present invention, the control unit may be implemented to further perform facial recognition of the user and release a lock according to the result.

As an example related to the present invention, the control unit may be implemented to release a lock according to a result of consideration of the movement length and position information of the pupil.

According to an embodiment of the present invention, a method for unlocking a user device based on a pupil position may include a display step of displaying a cryptographic component at different positions on a display; A detection step of sequentially detecting a direction in which the position of the display that the pupil gazes on by identifying the pupil of the user gazing at the display; And a release step of comparing the order of the direction in which the measured pupil position moves with the order of the preset direction to determine whether they match or not, and then releasing the lock according to the result.

As an example related to the present invention, the display step may be characterized in that the cryptographic component is displayed in an arbitrary arrangement on the display.

As an example related to the present invention, the password component may be characterized in that it includes at least one of a symbol, a picture, a figure, a number, a letter, and a symbol.

As an example related to the present invention, the display step may be characterized in that a plurality of password elements are set, and the plurality of password elements are set to different passwords.

As an example related to the present invention, the password may be characterized in that the password is set in an input order of a password element or a movement pattern of the pupil.

As an example related to the present invention, the unlocking step may be implemented to further perform facial recognition of the user and unlock the lock according to the result.

As an example related to the present invention, the detection step may be implemented to realize feedback on an input by a pupil gazing at the display.

A computer program for performing the method according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

The present invention uses a method of recognizing the position of a person's pupils in order to unlock a user device, and thus provides a user-friendly environment and enhances security compared to an existing key input-based unlocking method.

In addition, the present invention has an effect of improving security by performing user authentication by combining the movement of the pupil and the user's face recognition.

1 is a conceptual diagram illustrating an authentication method based on a pupil position according to an embodiment of the present invention.
2 is a conceptual diagram illustrating a user's eye photographing screen to which an XY coordinate system is applied according to an embodiment of the present invention.
3 is a conceptual diagram illustrating a pupil descriptor for detection of a pupil position according to an embodiment of the present invention.
4 is a conceptual diagram showing a user device according to an embodiment of the present invention.
5 is a flowchart illustrating a method of unlocking a user device based on a pupil position according to an embodiment of the present invention.
6 is a conceptual diagram illustrating an authentication method based on a pupil position according to another embodiment of the present invention.

It should be noted that the technical terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as generally understood by those of ordinary skill in the technical field to which the present invention belongs, unless otherwise defined in the present invention. It should not be construed as a meaning or an excessively reduced meaning. In addition, when a technical term used in the present invention is an incorrect technical term that does not accurately express the spirit of the present invention, it should be replaced with a technical term that can be correctly understood by those skilled in the art. In addition, general terms used in the present invention should be interpreted as defined in the dictionary or according to the context before and after, and should not be interpreted as an excessively reduced meaning.

In addition, the singular expression used in the present invention includes a plurality of expressions unless the context clearly indicates otherwise. In the present invention, terms such as “consisting of” or “comprising” should not be construed as necessarily including all of the various components or steps described in the invention, and some components or some steps may not be included. It should be construed that it may or may further include additional components or steps.

In addition, terms including ordinal numbers such as first and second used in the present invention may be used to describe the elements, but the elements should not be limited by the terms. The terms are used only to distinguish one component from another. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted.

In addition, in describing the present invention, when it is determined that a detailed description of a related known technology may obscure the subject matter of the present invention, a detailed description thereof will be omitted. In addition, it should be noted that the accompanying drawings are only for easily understanding the spirit of the present invention and should not be construed as limiting the spirit of the present invention by the accompanying drawings.

Hereinafter, in an embodiment of the present invention, a method of unlocking a user device based on a pupil position is disclosed. For convenience of explanation, a method of unlocking a user device based on the pupil position is disclosed. However, the unlocking method based on the pupil position according to an embodiment of the present invention performs another identity authentication procedure or operation of the device required for the user device. It can also be used to control.

1 is a conceptual diagram illustrating an authentication method based on a pupil position according to an embodiment of the present invention.

Hereinafter, in an embodiment of the present invention, a user device may be referred to by various terms. For example, a user equipment (UE) may be fixed or mobile, and may be a mobile station (MS), a mobile terminal (MT), a user terminal (UT), a subscriber station (SS), or a wireless device. ), a personal digital assistant (PDA), a wireless modem, a handheld device, and a wireless terminal.

As shown in FIG. 1, the user device 100 may be implemented to be used after releasing the locked state through identity authentication. The user device 100 may perform identity authentication by receiving a location signal of the user's pupil 200. For example, the user inputs the movement of the pupil 200 gazing at the password component 120 in a preset order in order to unlock the user device 100, and the user device 100 analyzes it and locks it. Whether to cancel the state can be determined.

According to an embodiment of the present invention, the user device 100 compares the order of the direction of movement of the received pupil 200 with the order of the preset pupil direction that must be input to unlock the user device 100. You can decide whether or not to release the lock state. The predetermined order of the direction of movement of the pupils may be the order of the direction of the pupils moving according to the order of characters or figures, or may be the order of the direction of the pupils moving sequentially through a specific area of the screen regardless of characters or figures. .

As shown, the user device 100 includes a camera unit 130. The camera unit 130 performs a function of collecting image information from the outside. The camera unit 130 may collect eye movement information of the user and image information for facial recognition of the user.

A screen required to drive and use the user device 100 may be displayed on the display 105 of the user device 100.

A cryptographic component 120 for unlocking it in a locked state may be displayed on the display 105. The encryption component 120 may be composed of image symbols (symbols, photos, figures, numbers, letters, symbols, etc.) used for setting a password. The encryption component 120 may be arranged at a certain position, and may be arranged at different positions at random each time on the lock screen. In addition, symbols, photographs, figures, numbers, letters, and symbols used as image symbols may be used in combination of a plurality of forms.

The password input screen 110 may be displayed on the display 105. The password may be set in an input order of the password component or a movement pattern of the pupil. When the password is set as the input order of the password element, the lock is released when the input order of the password element 120 input by the pupil 200 matches a preset order. When the password is set as the movement pattern of the pupil, the lock is released when the movement pattern of the pupil matches a preset order.

The password component 120 input for security does not display the specific content entered on the password input screen 110, or the content of the password component 120 entered last is displayed on the password input screen 110 for a certain period of time. After being displayed, the input content may be set not to be displayed after a certain period of time has elapsed.

Vibration, light, and sound can be used as feedback on the input. Feedback on the input may not be used depending on the setting.

In the embodiment of FIG. 1, when the password for unlocking is 3457, the user can unlock the lock by staring at the numbers 3, 4, 5, and 7 sequentially in the order of the password. At this time, the user's pupils move in the order of upper left, lower right, left, and upper right, starting with the central area. The camera unit 130 may collect the user's pupil movement information, and release the lock when the collected user's pupil movement information matches a preset order for unlocking the user device 100.

The password component 120 may be arranged in an arbitrary order whenever the lock screen is displayed. That is, if the password for unlocking is 3457, since the position of each number is changed, the user's pupil movement information required for unlocking may be correspondingly changed.

Alternatively, the order of movement of the user's pupils required for unlocking is fixed, and the password component 120 may be arranged in an arbitrary order each time the lock screen is displayed. When the user's eye movement order required for unlocking is upper left, lower right, upper left, and upper right, regardless of the arrangement of the password component 120, the user moves the pupil to the upper left, lower right, left, and upper right of the user device 100. You can unlock it.

Hereinafter, in an embodiment of the present invention, a method of determining whether to release the lock setting of the user device 100 by receiving the pupil movement information and analyzing the received pupil movement information is disclosed in detail. do.

FIG. 2 is a conceptual diagram illustrating a user's pupil photographing screen to which an XY coordinate system is applied according to an exemplary embodiment of the present invention, and FIG. 3 is a conceptual diagram illustrating a pupil descriptor for detecting a pupil position according to an exemplary embodiment of the present invention. An XY coordinate system may be applied to a photographing screen in which the user's pupils are photographed through the camera unit 130. In the XY coordinate system, the origin may be the center of the display 105 or may be a predetermined point of the display 105 according to the user's selection.

As shown in FIG. 2, when the XY coordinate system is applied to the photographing screen, the coordinates of the point where the user's pupil 200 is located is calculated based on the origin of the XY coordinate system. In order to calculate the coordinates, the X-axis and the Y-axis may each have coordinate values at regular intervals. For example, the user's pupil 200 may have an X-axis coordinate value (x1) of -4 and a Y-axis coordinate value (y1) of 4. In this case, the coordinate value of the point where the user's pupil 200 is located may be calculated as (-4,4).

Using the coordinate value of the point where the user's pupil 200 is located, it is possible to determine where the user's pupil 200 is among nine areas (for example, R1 to R9 divided into nine) on the display 105. have.

Specifically, when the X-axis coordinate value (x1) of the position of the pupil 200 is less than -3, the position of the user's pupil 200 may be determined to be on the left by dividing it into three based on the X-axis, In this case, it can be determined that it is the center based on the X-axis, and if it is 3 or more, it can be determined that it is the right side of the X-axis. In addition, when the Y-axis coordinate value (y1) of the position of the pupil 200 is less than -3, it can be determined that the position of the user's pupil 200 is at the bottom of the Y-axis, and if it is more than -3 and less than 3, the Y-axis is referenced. It can be determined to be the center, and if it is 3 or more, it can be determined to be the upper end based on the Y-axis.

This is described as an example, and may be set differently according to the number of divisions of the area and the size of the display 105.

In this way, according to the determination result of the X-axis coordinate value and the Y-axis coordinate value of the position of the pupil 200, the user's pupil 200 is selected from among nine areas (R1 to R9 divided into nine) on the display 105. You can judge cognition. As shown in FIG. 1, when the password is 3457, the lock is released only when the user's pupil 200 is moved in the order of R1, R9, R7, and R3. When the password is 3457 and the position of each number is changed, the position of the pupil 200 for unlocking is also changed according to the order of the regions corresponding to the changed positions of 3, 4, 5, and 7.

Regardless of the password, when the user's eye movement information required for unlocking is top left, bottom right, left, top right, in addition to the order of R1, R9, R7 and R3, (R5, R9, R7, R3), (R1, R5, The lock can also be unlocked in other order, such as R4, R2), (R5, R9, R8, R6). To prevent this, when the lock is unlocked with the user's pupil movement information regardless of the password, the movement length and the position of the pupil 200 in addition to the movement direction may be simultaneously considered in the user's pupil movement information.

In addition, in order to determine that a corresponding region has been input according to the movement of the pupil 200, an input that continues for a predetermined time or longer is required for the same region. As a feedback on this, when the user's pupil 200 gazes at a specific area, a loading bar (not shown) indicating a time required to be recognized as an input may be displayed. The loading bar may be displayed on the display 105 corresponding to the position of the user's pupil 200, but it is preferable to be displayed on a specific area of the screen for security and accurate input, and may not be displayed depending on settings.

If the position of the pupil 200 continues for a certain period of time in which the position of the pupil is recognized as an input, and the password component 120 located in the corresponding area is recognized as being input, the user can be notified of this through vibration, light, sound, etc. have.

4 is a conceptual diagram showing a user device according to an embodiment of the present invention. Referring to FIG. 4, the user device 100 may include a camera unit 130, a pupil position measurement unit 140, a storage unit 150, a user setting unit 160, and a control unit 170.

The camera unit 130 may capture and collect an external image, and may recognize the pupil 200. In order to photograph the user's pupils 200, the camera unit 130 may photograph the user's face as the center. When users use the user device 100, most of the user devices 100 face each other at a position close to their face, so that the camera unit 130 can photograph the user with the user's pupils as the center. The camera unit 130 continuously photographs the user in order to track the position of the pupil 200 in real time.

In addition, the camera unit 130 may recognize a user's face. Accordingly, even if the password is known, the lock cannot be unlocked unless the identity authentication through face recognition is completed, so security can be improved by releasing the lock by interlocking with the user's face recognition.

The pupil position measuring unit 140 measures the position of the user's pupil 200 required to release the lock and converts it into data.

The pupil position measuring unit 140 calculates the geometrical pupil position from the camera unit 130 by using the angle in the direction of both eyes and the distance between the eyes. In addition, the pupil position measuring unit 140 outputs pupil position data for the calculated actual geometric eye position.

The pupil position measuring unit 140 sets a predetermined reference point of the photographing screen including the user's pupils photographed from the camera unit 130 as the origin, and sets the center point position of the photographed user's pupils 200 as the origin. , The X-axis coordinate value and Y-axis coordinate value of the pupil are calculated based on the origin.

The origin may be set as the center of the pupil 200 when the user gazes at a specific point on the display 105 as a reference point, and the specific point may be the center of the display 105. Specifically, a reference point may be set as the user gazes at a specific area displayed in the center area of the display 105 on the initial screen for unlocking for a certain period of time, and the X-axis coordinate value of the pupil 200 using the reference point And Y-axis coordinate values are calculated to measure the position of the pupil 200. The reference point may be used as initially set by the user, and may be changed as necessary.

The storage unit 150 may store a password set by the user setting unit 160, and the control unit 170 includes a camera unit 130, a pupil position measurement unit 140, a storage unit 150, and a user setting unit. It may be implemented to control the operation of 160.

In addition, the controller 170 may be implemented to release the locked state of the user device 100 when information on the position of the pupil inputted as a result of the analysis of the pupil position measurement can unlock the user device 100. I can. Conversely, if the information about the position of the pupil inputted as a result of the analysis of the pupil position measurement cannot unlock the user device 100, the user's device does not unlock the user device 100 It may be implemented to instruct to re-enter information about the pupil position.

5 is a flowchart illustrating a method of unlocking a user device based on a pupil position according to an embodiment of the present invention.

1, the user device 100 displays the cryptographic component 120 on the display 105 to unlock the lock (S100). The encryption component 120 is an image symbol used for setting a password, and may include symbols, photos, figures, numbers, letters, symbols, and the like, and may be displayed as a combination thereof.

The cryptographic elements 120 may be arranged on the display 105 in a series of order, or may be arranged in any order. For example, it may be displayed in an ordinal number starting from the upper left of the display 105 toward the lower right, and may be displayed in an arbitrary order as shown in FIG. 1. Movement information of the user's pupil 200 required for unlocking may be correspondingly changed according to the arrangement order of the encryption elements 120 displayed on the display 105.

Next, the camera unit 130 collects location information of the pupil 200 (S200). The collecting of the location information of the pupil 200 is a step of applying an XY coordinate system to the photographing screen by setting a predetermined reference point as an origin, and determining the X-axis coordinate value and the Y-axis coordinate value of the photographed user's pupil 200 position. It includes the step of calculating.

Next, by comparing the position information of the pupil 200 collected by the camera unit 130 with the position of the pupil required for unlocking, it is determined whether it matches the password (S300), and the user device 100 is locked according to the determination result. It is determined whether to cancel the state (S400). In the step of determining whether to release the locked state, in addition to information related to the position of the pupil, a user's facial recognition authentication procedure may be further provided.

The password may be set in an input order of the password component or a movement pattern of the pupil. When the password is set to the input order of the password element, the lock is released when the input order of the password element 120 input by the pupil 200 matches a preset order. When the password is set as the movement pattern of the pupil, the lock is released when the movement pattern of the pupil matches a preset order.

In addition, when the location information of the pupil 200 is compared with the location of the pupil required for unlocking and does not match the password, the locked state of the user device 100 may not be released and the determination step may be terminated.

6 is a conceptual diagram illustrating an authentication method based on a pupil position according to another embodiment of the present invention. The encryption component 120 displayed on the display 105 may be set in plural. That is, it may be set as the first cryptographic component 120-1, the second cryptographic component 120-2, and the third cryptographic component 120-3. Each cryptographic component can be set with a different password. For example, the password of the first cryptographic component 120-1 may be set to 1674, the password of the second cryptographic component 120-2 may be set to 8194, and the third cryptographic component 120 In the password of -3), the movement of the pupil may be set to right, up, left, or down based on the shape of a star in which the movement pattern of the pupil is displayed in the center.

The first cryptographic component 120-1, the second cryptographic component 120-2, and the third cryptographic component 120-3 may be distinguished by a color of the display 105, a page display, and the like. For example, when the display 105 is blue, it can be unlocked by inputting the password of the first password component 120-1, and when the display 105 is red, the second password component 120 It can be unlocked by entering the password of -2), and when the display 105 is yellow, it can be unlocked by entering the password of the third password component 120-3.

When the display 105 is blue, the password of the first password component 120-1 is 1674, so the user can unlock the pupil 200 by moving the pupil 200 in the order of 1674. In the drawing, the first cryptographic component 120-1 is sequentially displayed, but may be displayed in an arbitrary order like the second cryptographic component 120-2. Even in this case, the user may unlock the first password component 120-1 by inputting 1674, which is a password.

When the display 105 is red, the password of the second password component 120-2 is 8194, so the user can unlock the eye 200 by moving the pupil 200 in the order of 8194.

When the display 105 is yellow, the password of the third password component 120-3 is the right, upper, left, and lower based on the shape of the star displayed in the center of the pupil movement pattern. You can unlock the lock by moving it in the order of right, up, left, and down.

In this way, the password is set differently according to each password component, so that security can be improved.

By using such a biometric recognition technology, a method of recognizing the movement of a person's pupil position, it is possible to provide a more convenient and user-friendly environment than conventional key input, as well as increase security. In addition, by using an interface based on the pupil position, the range of the user can be widened.

A user device that performs unlocking based on a pupil position according to an embodiment of the present invention may be used to unlock various devices.

A method of unlocking a user device based on a pupil position according to an embodiment of the present invention can be written in a computer program, and codes and code segments constituting the computer program can be easily inferred by a computer programmer in the art. In addition, the computer program is stored in a computer readable media, and is read and executed by a computer or a user device according to an embodiment of the present invention, thereby implementing a method of unlocking a user device. have.

The information storage medium includes a magnetic recording medium, an optical recording medium, and a carrier wave medium. A computer program that implements the method of unlocking a user device according to an embodiment of the present invention may be stored and installed in an internal memory such as a user device. Alternatively, an external memory such as a smart card storing and installing a computer program that implements a method of unlocking a user device according to an embodiment of the present invention may be mounted on a terminal or the like through an interface.

The above-described contents may be modified and modified without departing from the essential characteristics of the present invention by those of ordinary skill in the technical field to which the present invention pertains. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

The present invention may determine whether to unlock the user device by determining whether the location information of the pupil inputted to the user device matches the password. This method can be utilized in user devices to provide a more convenient user-friendly environment than existing key inputs, and to increase the security of the user device.

In addition, the present invention allows the user to determine the degree of security by using the user's facial recognition authentication process in addition to the pupil location information to unlock the user device, so that the user device can adaptively set whether to unlock the user device according to the situation. Can be applied to

100: user device 105: display
110: password input screen 120: password component
130: camera unit 140: pupil position measuring unit
150: storage unit 160: user setting unit
170: control unit 200: pupil

Claims (11)

A camera unit that collects pupil location information on the location of the user device to which the user's pupils gaze;
A position measuring unit sequentially detecting a direction in which the position of the pupil moves based on the pupil position information; And
A control unit configured to compare the order of the direction in which the detected pupil position moves with the order of directions according to a password preset as a password component to determine whether they match or not, and then release the lock according to the result, and
The pupil, characterized in that the pupil is notified by feedback including at least one of light, vibration, and sound when the position of the pupil continues for a certain period of time in which the position of the pupil is recognized as input and the encryption component corresponding to the position of the pupil is recognized as being input. User devices that perform location-based unlocking. delete delete A display step of displaying the cryptographic component at different locations on the display;
A detection step of sequentially detecting a direction in which the position of the display that the pupil gazes on by identifying a pupil of the user gazing at the display; And
A release step of comparing the order of the direction in which the position of the display gazed by the pupils is moved and the order of directions according to a password preset with the password component to determine whether they match or not, and then unlocking the lock according to the result; Includes,
In the detecting step, when the position of the pupil is recognized as being input for a certain period of time and the encryption component corresponding to the position of the pupil is recognized as input, a feedback including at least one of light, vibration, and sound is notified. A method of unlocking a user device based on a pupil position, further comprising the step of. delete delete The method of claim 4,
In the displaying step, a plurality of the password elements are set, and the plurality of set password elements are set to different passwords, respectively. The method of claim 7,
The password is set as an input order of the password component or a movement pattern of the pupil. The method of claim 4,
The unlocking step is implemented to further perform facial recognition of the user and unlock the lock according to a result thereof. delete delete

Images