KR102841966B1 - Method for log in and unlock a user of a extended reality device using an image that appears in the palm of your hand - Google Patents

Abstract

The present invention relates to a method for user login and unlocking of an XR device using an image appearing at a palm position, and more particularly, to a method for user login and unlocking of an XR device using an image appearing at a palm position, the method comprising: (1) a step of the XR device recognizing a preset palm of a user through a camera in a login or unlock situation; (2) a step of the XR device augmenting an image pattern for user login or unlocking at the user's palm position recognized through the step (1); (3) a step of the XR device detecting a pattern drawn by the user for login or unlocking from the augmented image pattern on the user's palm through the step (2); and (4) a step of the XR device comparing the detected pattern drawn by the user through the step (3) with a preset pattern for login or unlocking, and logging in or unlocking the XR device if they match.
According to the user login and unlock method of an XR device using an image appearing at the palm position proposed in the present invention, the XR device recognizes a preset palm of the user through a camera in a login or unlock situation, augments an image pattern for the user's login or unlock at the user's palm position, detects a pattern drawn by the user for login or unlock from the augmented image pattern on the user's palm, and compares the detected pattern drawn by the user with the preset pattern for login or unlock, and configures the XR device to be able to be logged in or unlocked if they match, thereby augmenting an image pattern that can be covered by the palm in an XR device that provides extended reality while taking into account the gaze of others, thereby enabling login or unlocking through hand tracking or eye tracking.
In addition, according to the user login and unlocking method of the XR device using an image appearing at the palm position of the present invention, by augmenting an image pattern that can be covered with a palm in an XR device that provides extended reality while taking into account the gaze of others, login or unlocking is possible through hand tracking or eye tracking, thereby providing a universal login method for use in e-commerce, virtual platforms, asset transactions, etc. when XR devices become popular in the future, and thereby increasing the convenience and efficiency of use as an essential element in device management of the XR device, and further improving the security stability of the device.

Description

{METHOD FOR LOG IN AND UNLOCK A USER OF A EXTENDED REALITY DEVICE USING AN IMAGE THAT APPEARS IN THE PALM OF YOUR HAND}

The present invention relates to a user login and unlock method of an XR (Extended Reality) device using an image appearing at a palm position, and more particularly, to a user login and unlock method of an XR device using an image appearing at a palm position, which allows login or unlocking through hand tracking or eye tracking by augmenting an image pattern that can be covered by a palm in an XR device that provides extended reality while taking into account the gaze of others.

The content described in this section merely provides background information for one embodiment of the present invention and does not constitute prior art.

With the trend toward lighter and smaller digital devices, various wearable devices are being developed. Head-mounted displays (HMDs), a type of wearable device, refer to various devices that users wear on their heads to access multimedia content. Here, the HMD is worn on the user's body and provides images to the user in various environments as the user moves. These HMDs are categorized into see-through and see-closed types. See-through types are primarily used for augmented reality (AR), while see-closed types are primarily used for virtual reality (VR).

In this way, while virtual reality (VR) is a technology that allows you to experience a new reality based on 360-degree images, augmented reality (AR) displays information and content on top of real objects through computer graphics (CG). Although augmented reality (AR) and virtual reality (VR) are separate technologies, the two technologies are complementing each other's shortcomings and evolving together.

Meanwhile, extended reality (XR) provides an expanded reality by freely selecting the individual or combined use of virtual reality and augmented reality technologies. In this way, XR devices that provide extended reality must provide a user login environment, just like PCs or mobile devices. Currently, commonly used methods for logging in and unlocking include fingerprint recognition, pattern recognition, and password input. However, mixed reality (MR) headsets and AR glasses do not provide a touch panel, making it difficult to log in using existing methods. Some XR devices can log in and unlock using fingerprint sensors, cameras, or facial recognition. However, there are limitations such as increased unit price, low recognition rate, and inconvenience in input, and there is currently no defined method for convenient unlocking. Republic of Korea Patent Publication No. 10-1392565 is disclosed as a prior art document.

The background technology described above is technical information that the inventor possessed for the purpose of deriving the present invention or acquired in the process of deriving the present invention, and cannot necessarily be said to be publicly known technology disclosed to the general public prior to the application for the present invention.

The present invention has been proposed to solve the above-mentioned problems of the existing proposed methods, and the purpose of the present invention is to provide a user login and unlock method of an XR device using an image appearing at the palm position, by recognizing a preset user's palm through a camera in a login or unlock situation, augmenting an image pattern for the user's login or unlock at the user's palm position, detecting a pattern drawn by the user for login or unlock from the augmented image pattern on the user's palm, and comparing the detected pattern drawn by the user with the preset pattern for login or unlock, and enabling the login or unlock of the XR device if they match, thereby augmenting an image pattern that can be covered by the palm in an XR device that provides extended reality while taking into account the gaze of others, and enabling login or unlock through hand tracking or eye tracking.

In addition, the present invention provides a method for user login and unlocking of an XR device using an image that appears at the palm position, which provides extended reality by taking into account the gaze of others and augmenting an image pattern that can be covered with a palm to enable login or unlocking through hand tracking or eye tracking, thereby providing a universal login method for use in e-commerce, virtual platforms, asset transactions, etc. when XR devices become popular in the future, and thereby increasing convenience and efficiency of use as an essential element in device management of the XR device, and further improving the security and stability of the device. Another object of the present invention is to provide a method for user login and unlocking of an XR device using an image that appears at the palm position, which allows for further improving the security and stability of the device.

However, the technical problems to be solved by the present invention are not limited to the technical problems described above, and other technical problems may exist.

A method for user login and unlocking of an XR device using an image appearing at a palm position according to the features of the present invention to achieve the above-mentioned purpose is as follows.

A method for user login and unlocking of an XR device using an image appearing at the palm position,

(1) A step in which the XR device recognizes a preset user's palm through a camera in a login or unlock situation;

(2) A step in which the XR device augments the image pattern for user login or unlocking at the user's palm location recognized through the step (1);

(3) a step in which the XR device detects a pattern drawn by the user for logging in or unlocking from the augmented image pattern on the user's palm through the above step (2); and

(4) The XR device is characterized in that it includes a step of comparing the detected pattern drawn by the user through the above step (3) with a preset pattern for logging in or unlocking, and if they match, logging in or unlocking the XR device.

Preferably, in the step (1),

The XR device may recognize a preset user's palm through the camera in a login or unlock situation, but the login or unlock situation may include when the XR device is worn and running, when a payment is made through the XR device, when personal information held by the XR device is checked, and when a locked application is running.

Preferably, in the above step (2),

The XR device may augment an image pattern for logging in or unlocking the user at the user's palm position, but the augmented image pattern may be fixed in place relative to the XR device.

More preferably, in the step (2),

An XR device may augment an image pattern for logging in or unlocking a user at the location of the user's palm, but the augmentation may be disabled when the palm is moved out of the range where the image pattern is located.

Even more preferably, in the step (3),

An XR device can detect a pattern drawn by a user for logging in or unlocking from an augmented image pattern on the user's palm, and can detect a pattern drawn by connecting three or more dots using a finger of the opposite hand while maintaining the hand that augmented the image pattern.

Even more preferably, in the step (3),

An XR device can detect a pattern drawn by a user for logging in or unlocking from an augmented image pattern on the user's palm, and can detect a pattern drawn by connecting three or more dots by eye tracking using pupil tracking of the user's eyes while wearing the XR device while maintaining the hand with the augmented image pattern intact.

Even more preferably, in the step (4),

The XR device compares the detected pattern drawn by the user with a preset pattern for logging in or unlocking, and if they match, the XR device is logged in or unlocked. However, the preset pattern can be registered through the same pattern registration process as the login method or by linking the XR device with a mobile device or PC to register the pattern.

According to the user login and unlock method of an XR device using an image appearing at the palm position proposed in the present invention, the XR device recognizes a preset palm of the user through a camera in a login or unlock situation, augments an image pattern for the user's login or unlock at the user's palm position, detects a pattern drawn by the user for login or unlock from the augmented image pattern on the user's palm, and compares the detected pattern drawn by the user with the preset pattern for login or unlock, and configures the XR device to be able to be logged in or unlocked if they match, thereby augmenting an image pattern that can be covered by the palm in an XR device that provides extended reality while taking into account the gaze of others, thereby enabling login or unlocking through hand tracking or eye tracking.

In addition, according to the user login and unlocking method of the XR device using an image appearing at the palm position of the present invention, by augmenting an image pattern that can be covered with a palm in an XR device that provides extended reality while taking into account the gaze of others, login or unlocking is possible through hand tracking or eye tracking, thereby providing a universal login method for use in e-commerce, virtual platforms, asset transactions, etc. when XR devices become popular in the future, and thereby increasing the convenience and efficiency of use as an essential element in device management of the XR device, and further improving the security stability of the device.

In addition, the various advantageous advantages and effects of the present invention are not limited to the above-described contents, and will be more easily understood in the process of explaining specific embodiments of the present invention.

FIG. 1 is a diagram illustrating the configuration of an XR device as a functional block for a method of user login and unlocking of an XR device using an image appearing at a palm position according to one embodiment of the present invention.
FIG. 2 is a diagram illustrating a flow of a user login and unlocking method of an XR device using an image appearing at a palm position according to one embodiment of the present invention.
FIG. 3 is a diagram schematically illustrating an example of a user's palm recognition process in a user login and unlocking method of an XR device using an image appearing at a palm position according to one embodiment of the present invention.
FIG. 4 is a diagram schematically illustrating an example of a 9-point pattern augmentation process on a palm in a user login and unlocking method of an XR device using an image appearing at a palm position according to one embodiment of the present invention.
FIG. 5 is a diagram schematically illustrating an example of a login process using hand tracking in a method for user login and unlocking of an XR device using an image appearing at a palm position according to one embodiment of the present invention.
FIG. 6 is a diagram schematically illustrating an example of a login process using eye tracking in a user login and unlocking method of an XR device using an image appearing at a palm position according to one embodiment of the present invention.
FIG. 7 is a diagram illustrating a specific example of a configuration of a pattern augmentation process in a user login and unlocking method of an XR device using an image appearing at a palm position according to one embodiment of the present invention.
FIG. 8 is a diagram illustrating an example of maintaining pattern enhancement and releasing pattern enhancement during a pattern enhancement process in a method for user login and unlocking an XR device using an image appearing at a palm position according to one embodiment of the present invention.
FIG. 9 is a diagram illustrating an example of a pattern drawing process in a user login and unlocking method of an XR device using an image appearing at a palm position according to one embodiment of the present invention.
FIG. 10 is a diagram illustrating a specific example of a configuration of a pattern setting process in a user login and unlocking method of an XR device using an image appearing at a palm position according to one embodiment of the present invention.
FIG. 11 is a diagram illustrating a specific example of a configuration of a pattern unlocking and login process in a user login and unlocking method of an XR device using an image appearing at a palm position according to one embodiment of the present invention.
FIG. 12 is a diagram illustrating an example configuration of a pattern generation failure in a user login and unlocking method of an XR device using an image appearing at a palm position according to one embodiment of the present invention.

Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement them. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, irrelevant parts have been omitted for clarity of description, and similar reference numerals have been used throughout the specification to indicate similar parts.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected" but also the case where it is "indirectly connected" with another element in between. Furthermore, when a part is said to "include" a component, this should be understood to mean that, unless specifically stated to the contrary, it may include other components rather than excluding them, and does not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

The following examples are provided as detailed explanations to aid understanding of the present invention and do not limit the scope of the invention. Therefore, inventions with the same scope and function as the present invention are also within the scope of the present invention.

In addition, each configuration, process, procedure or method included in each embodiment of the present invention may be shared within a scope that is not technically inconsistent with each other.

FIG. 1 is a diagram illustrating a configuration of an XR device for a method of user login and unlocking of an XR device using an image appearing at a palm position according to an embodiment of the present invention, as a functional block diagram. As illustrated in FIG. 1, an XR device (100) for user login and unlocking of an XR device using an image appearing at a palm position according to an embodiment of the present invention may be configured to include an HMD frame (110), an optical display unit (120), a camera (130), a tracking pattern detection unit (140), and a control unit (150), and may further include a sensor unit (160) and a communication unit (170). Here, the XR device (100) is a device that provides an extended reality by freely selecting individual or mixed use of virtual reality (VR) and augmented reality (AR) technologies. That is, although the glasses are transparent, when augmented reality (AR) is required, information is displayed on the glasses, and when virtual reality (VR) is required, the glasses become opaque, allowing information to be displayed completely through the entire field of view.

The HMD frame (110) is a configuration that can be worn on the user's head. This HMD frame (110) can be configured in a helmet shape, a goggle shape, etc., having a frame structure that allows light to enter while the user is wearing it on the head. Here, the optical display unit (120) can be connected to the HMD frame (110) so that the optical display unit (120) is positioned in front of both eyes of the wearer when the XR device (100) is worn.

The optical display unit (120) is configured to be positioned in front of both eyes of a wearer wearing an HMD frame (110) to provide virtual reality (VR), augmented reality (AR), and extended reality (XR). This optical display unit (120) may be configured to include a display that outputs image light so that image information can be provided to a wearer wearing an XR device (100), and an optical system that is positioned in front of both eyes of a wearer wearing an XR device (100) to provide augmented reality by combining real-world light and image light. Here, the display outputs image light so that image information can be provided to the wearer, and outputs image light that is coupled to the optical system and transmitted toward the wearer's eyes by the optical system, and is configured as a pair of displays for binocular display, and may be configured in various ways such as OLED and LCoS (Liquid Crystal on Silicon).

In addition, the optical system can transmit at least a portion of the light of the real world through the field of view of a wearer wearing the XR device (100) and transmit the image light output from the display toward the wearer's eyes to provide augmented reality or extended reality. That is, the optical system can be configured so that a wearer wearing the XR device (100) can experience extended reality. This optical system is composed of a plurality of lenses and mirrors, and can be implemented in various ways, for example, it can be implemented in an optical diffraction method, a beam splitter method, a pin mirror method, etc.

The camera (130) is installed on one side of the front of the HMD frame (110) and is configured to capture external images along the line of sight of a wearer wearing the XR device (100). This camera (130) can capture and record the world viewed by the wearer wearing the XR device (100), and can include a user palm object recognition function for pattern augmentation of the XR device (100).

The tracking pattern detection unit (140) is configured to detect an augmented image pattern at the user's palm location recognized by the camera (130). This tracking pattern detection unit (140) can detect a pattern drawn by the user through hand tracking that tracks the user's hand or eye tracking that tracks the user's pupil. Here, the tracking pattern detection unit (140) can be implemented as a tracking camera applied to the XR device (100).

The control unit (150) controls the overall operation of the XR device (100), and performs a function of comparing the detected pattern output from the tracking pattern detection unit (140) with a preset pattern and, if they match, performing a function of logging in or unlocking the XR device (100), and outputting a failure of logging in or unlocking the XR device (100) if the detected pattern does not match the preset pattern. The control unit (150) can perform overall control of the operation process for user login and unlocking of the XR device (100). Here, the control unit (150) is a configuration for overall operation control of the XR device (100), and an application for overall control of the XR device (100) can be loaded and executed.

The sensor unit (160) may include at least one sensor, and more specifically, may include an iris recognition sensor or the like. According to an embodiment, the control unit (150) matches the IPD information adjusted by the wearer with the user authentication information and stores it, and when the wearer authenticates the user by holding the optical display unit (120) of the XR device (100) against the face, the control unit may automatically control the IPD adjustment unit so that the stored IPD is obtained using the IPD information matched with the user authentication information. At this time, the user authentication may use an iris recognition sensor or the like included in the sensor unit (160).

The communication unit (170) is installed on one side of the XR device (100) and can transmit and receive various signals and data with other XR devices or servers, etc. Here, the network used by the communication unit (170) can be implemented as a wired network such as a Local Area Network (LAN), a Wide Area Network (WAN), or a Value Added Network (VAN), or any type of wireless network such as a mobile radio communication network, a satellite communication network, Bluetooth, Wibro (Wireless Broadband Internet), HSDPA (High Speed Downlink Packet Access), LTE (Long Term Evolution), 3/4/5/6G (3/4/5/6th Generation Mobile Telecommunication), etc.

FIG. 2 is a diagram illustrating a flow of a method for user login and unlocking of an XR device using an image appearing at a palm position according to an embodiment of the present invention. As illustrated in FIG. 2, the method for user login and unlocking of an XR device using an image appearing at a palm position according to an embodiment of the present invention may be implemented including a step (S110) in which the XR device recognizes a preset palm of a user through a camera in a login or unlock situation, a step (S120) in which the XR device augments an image pattern for login or unlocking the user at the recognized palm position, a step (S130) in which the XR device detects a pattern drawn by the user for login or unlocking from the augmented image pattern on the user's palm, and a step (S140) in which the XR device compares the detected pattern drawn by the user with the preset pattern for login or unlocking and, if they match, logs in or unlocks the XR device.

FIG. 3 is a diagram schematically illustrating an example of a user's palm recognition process in a user login and unlocking method of an XR device (100) using an image appearing at a palm position according to an embodiment of the present invention, FIG. 4 is a diagram schematically illustrating an example of a 9-point pattern augmentation process on a palm in a user login and unlocking method of an XR device (100) using an image appearing at a palm position according to an embodiment of the present invention, FIG. 5 is a diagram schematically illustrating an example of a login process using hand tracking in a user login and unlocking method of an XR device (100) using an image appearing at a palm position according to an embodiment of the present invention, FIG. 6 is a diagram schematically illustrating an example of a login process using eye tracking in a user login and unlocking method of an XR device (100) using an image appearing at a palm position according to an embodiment of the present invention, and FIG. 7 is a diagram specifically illustrating a pattern augmentation process in a user login and unlocking method of an XR device (100) using an image appearing at a palm position according to an embodiment of the present invention. This is a drawing showing an example of a configuration, and FIG. 8 is a drawing showing an example of pattern enhancement maintenance and pattern enhancement release during a pattern enhancement process in a user login and unlock method of an XR device (100) using an image appearing at a palm position according to an embodiment of the present invention, and FIG. 9 is a drawing showing an example of a pattern drawing process in a user login and unlock method of an XR device (100) using an image appearing at a palm position according to an embodiment of the present invention.

According to one embodiment of the present invention, a method for user login and unlocking of an XR device (100) using an image appearing at a palm position may be performed in each step by a control unit (150) of an XR device (100) for providing extended reality, as illustrated in FIG. 1. In the following, for convenience of explanation, the subject performing each step may be omitted.

In step S110, the XR device (100) recognizes the preset palm of the user through the camera (130) in a login or unlock situation. In this step S110, the XR device (100) recognizes the preset palm of the user through the camera (130) in a login or unlock situation. The login or unlock situation may include when the XR device (100) is worn and running, when payment is made through the XR device (100), when personal information held by the XR device (100) is confirmed, and when a locked application is running. Here, it can be understood that the login or unlock situation of the XR device (100) can be applied to all situations in which login or unlocking was applied in existing smartphones.

Additionally, in step S110, as illustrated in FIG. 3, the user's palm can be recognized through the camera (130) of the XR device (100).

In step S120, the XR device (100) augments an image pattern for user login or unlocking at the user's palm position recognized through step S110. In this step S120, the XR device (100) augments an image pattern for user login or unlocking at the user's palm position, but the augmented image pattern is fixed so as not to move relative to the XR device (100). Here, in step S120, the XR device (100) augments an image pattern for user login or unlocking at the user's palm position, but the augmentation can be released when the palm is moved out of the range where the image pattern is located.

Additionally, in step S120, a nine-point pattern can be augmented on the user's palm, as illustrated in FIG. 4. Here, the nine-point pattern is merely an example and is not limited thereto.

In addition, in step S120, as illustrated in FIGS. 7 and 8, when the user's palm is recognized by the XR device (100) camera (130), a bounding box is generated through palm object recognition, a 9-point pattern augmentation area is set in a square shape within the generated bounding box range, and a 9-point pattern is augmented within the pattern augmentation area. At this time, the augmented pattern is augmented in a square shape in the positive direction to the user of the XR device (100) aligning with the center of the palm, and once augmented, the pattern is fixed without moving based on the XR device (100), and during pattern registration or unlocking, if the bounding box of the palm moves out of the augmented pattern by moving the palm with the augmented pattern or moving the head, the augmentation is released.

In step S130, the XR device (100) detects a pattern drawn by the user for logging in or unlocking from the augmented image pattern on the user's palm through step S120. In this step S130, the XR device (100) detects a pattern drawn by the user for logging in or unlocking from the augmented image pattern on the user's palm, and can detect a pattern by drawing three or more points by connecting them using the fingers of the opposite hand while maintaining the hand that has the augmented image pattern intact through hand tracking. Here, the pattern drawing of the hand tracking utilizes the hand tracking function of the XR device (100), as illustrated in FIG. 9, and when the coordinates of the augmented 9-point pattern and the tip of the hand tracking finger overlap, the pattern drawing is executed, and the augmented 9-point pattern is positioned under the hand drawing the pattern to increase realism, and when the tip of the finger goes outside the augmented 9-point pattern, the pattern drawn so far is initialized, and at least three or more points must be connected to be stored as a pattern for logging in or unlocking.

In addition, in step S130, the XR device (100) detects a pattern drawn by the user for logging in or unlocking from an image pattern augmented on the user's palm, and while maintaining the hand augmented with the image pattern, the pattern drawn by connecting three or more points can be detected by eye tracking using pupil tracking of the eyes of the user wearing the XR device (100).

In step S140, the XR device (100) compares the detected pattern drawn by the user through step S130 with a preset pattern for logging in or unlocking, and if they match, the XR device (100) is logged in or unlocked. In step S140, the XR device (100) compares the detected pattern drawn by the user with a preset pattern for logging in or unlocking, and if they match, the XR device (100) is logged in or unlocked. However, the preset pattern may be registered through a pattern registration process identical to the login method or a process of registering a pattern by linking the XR device (100) with a mobile device or a PC.

FIG. 10 is a diagram illustrating a specific example of a pattern setting process in a user login and unlocking method of an XR device (100) using an image appearing at a palm position according to an embodiment of the present invention. As illustrated in FIG. 10, when the XR device (100) is first run, a notification is provided that requires pattern lock setting for security, and when the pattern lock setting button is clicked on the lock setting screen, a setting of the hand to be used for pattern augmentation, i.e., the right or left hand, appears. Next, a guidance is output, saying, "Please position the hand so that the palm of the hand set is visible to the camera (130) of the XR device (100), the user's palm is recognized through the camera (130), and a 9-point pattern is augmented according to the bounding box, and the augmented 9-point pattern is fixed based on the XR device (100), and if the palm is not recognized by the camera (130), the pattern augmentation is released. Meanwhile, the pattern setting process is completed when the hand on which the pattern is augmented is maintained as it is and three or more points are connected using the fingers of the opposite hand to save the pattern. These pattern settings can be linked to a PC or smartphone, so that the pattern of the XR device (100) can be set on a PC or smartphone as well.

FIG. 11 is a diagram illustrating a specific example of a pattern unlocking and login process in a user login and unlocking method of an XR device (100) using an image appearing at a palm position according to an embodiment of the present invention. As illustrated in FIG. 11, in a situation where unlocking and logging in to the XR device (100) are required, a notification is provided and pattern augmentation guidance is output. Next, when the user's palm is recognized and a 9-point pattern is augmented to fit the bounding box, the augmented 9-point pattern is fixed with respect to the XR device (100), and if the palm is not recognized by the camera, the pattern augmentation is released. Meanwhile, the augmented 9-point pattern is drawn using a finger while being fixed with respect to the XR device (100), and if it is compared with a preset pattern and does not match, an unlocking and login failure is output, and if it matches, the unlocking and login are successful.

FIG. 12 is a diagram illustrating an exemplary configuration of a pattern generation failure in a user login and unlocking method of an XR device (100) using an image appearing at a palm position according to an embodiment of the present invention. As illustrated in FIG. 12, a pattern generation failure of the XR device (100) may be indicated if the user's palm is too far away or too close to the camera (130) of the XR device (100). In addition, if the palm is removed during pattern registration or unlocking, pattern augmentation may be released and a pattern generation failure may be indicated. In addition, a pattern generation failure may be indicated if the palm recognized for pattern augmentation is different from a preset palm.

As described above, a method for user login and unlocking of an XR device using an image appearing at a palm position according to an embodiment of the present invention comprises the steps of: the XR device recognizes a preset palm of a user through a camera in a login or unlock situation, augments an image pattern for the user's login or unlock at the user's palm position, detects a pattern drawn by the user for login or unlock from the augmented image pattern on the user's palm, and compares the detected pattern drawn by the user with the preset pattern for login or unlock, and if they match, the XR device is configured to be logged in or unlocked, thereby enabling login or unlocking through hand tracking or eye tracking by augmenting an image pattern that can be covered by the palm in an XR device that provides extended reality considering the gaze of others; and in particular, by augmenting an image pattern that can be covered by the palm in an XR device that provides extended reality considering the gaze of others, thereby enabling login or unlocking through hand tracking or eye tracking, a universal login method for use in e-commerce, virtual platforms, asset transactions, etc., when XR devices become popular in the future, and thereby serving as an essential element for device management of XR devices. Not only will convenience and efficiency be increased, but the security and stability of the device will also be further improved.

The foregoing description of the present invention is for illustrative purposes only, and those skilled in the art will readily appreciate that the present invention can be readily modified into other specific forms without altering the technical spirit or essential characteristics of the present invention. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. For example, each component described as a single entity may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined manner.

The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention.

100: XR device according to one embodiment of the present invention
110: HMD frame
120: Optical display section
130: Camera
140: Tracking pattern detection unit
150: Control unit
160: Sensor section
170: Communications Department
S110: Step of recognizing a preset user's palm through the camera in a login or unlock situation of the XR device.
S120: Step of augmenting an image pattern for user login or unlocking at the recognized palm position of the XR device
S130: Step of the XR device detecting a pattern drawn by the user for logging in or unlocking from an augmented image pattern on the user's palm.
S140: A step for the XR device to compare the detected pattern drawn by the user with the preset pattern for logging in or unlocking and, if they match, to log in or unlock the XR device.

Claims (7)

A method for user login and unlocking of an XR device (100) using an image appearing at the palm position,
(1) A step in which the XR device (100) recognizes a preset user's palm through a camera (130) in a login or unlock situation;
(2) A step in which the XR device (100) augments an image pattern for user login or unlocking at the user's palm position recognized through the step (1);
(3) A step in which the XR device (100) detects a pattern drawn by the user for logging in or unlocking from the image pattern augmented on the user's palm through the above step (2); and
(4) A step of comparing the detected pattern drawn by the user through the above step (3) with a preset pattern for logging in or unlocking the XR device (100) and, if they match, logging in or unlocking the XR device (100) is included.
In the above step (3),
A method for user login and unlocking of an XR device using an image appearing at the palm position, characterized in that the XR device (100) detects a pattern drawn by a user for login or unlocking from an image pattern augmented on the user's palm, and detects a pattern drawn by connecting three or more points using a finger of the opposite hand while maintaining the hand augmented with the image pattern, through hand tracking.
In the first paragraph, in the step (1),
A method for user login and unlocking of an XR device using an image appearing at the palm position, characterized in that the XR device (100) recognizes a preset user's palm through a camera (130) in a login or unlock situation, and the login or unlock situation includes when the XR device (100) is worn and running, when payment is made through the XR device (100), when personal information held by the XR device (100) is confirmed, and when a locked application is running.
In the first paragraph, in the step (2),
A method for user login and unlocking of an XR device using an image appearing at the palm position, characterized in that the XR device (100) augments an image pattern for user login or unlocking at the user's palm position, and the augmented image pattern is fixed without moving relative to the XR device (100).
In the third paragraph, in the step (2),
A method for user login and unlocking of an XR device using an image appearing at a palm position, characterized in that the XR device (100) augments an image pattern for user login or unlocking at a user's palm position, and the augmentation is released when the palm is moved out of the range where the image pattern is located.
delete In the fourth paragraph, in the step (3),
A method for user login and unlocking of an XR device using an image appearing at the palm position, characterized in that the XR device (100) detects a pattern drawn by a user for login or unlocking from an image pattern augmented on the user's palm, and detects a pattern drawn by connecting three or more points by eye tracking using pupil tracking of the eye of a user wearing the XR device (100) while maintaining the hand augmented with the image pattern intact.
In the fourth paragraph, in the step (4),
A method for user login and unlocking of an XR device using an image appearing at the palm position, characterized in that the XR device (100) compares a detected pattern drawn by a user with a preset pattern for login or unlocking and, if the pattern matches, logs in or unlocks the XR device (100), but the preset pattern is registered through a pattern registration process identical to the login method or a process of registering a pattern by linking the XR device (100) with a mobile device or PC.