KR20230070990A - A wearable device that communicates with at least one counterpart device according to a trigger event and a control method thereof - Google Patents

Abstract

A wearable device that performs communication with at least one counterpart device according to a trigger event and a control method thereof are disclosed. A wearable device according to an embodiment of the present document includes a display module and at least one processor, and the at least one processor controls the display module to display at least one graphic object in a display area. identify whether the user's body part is located in the first region, identify a group corresponding to the first region based on the user's body part being located in the first region, and identify the user's body part Identifying whether a trigger event by the user is detected while a part is located in the first area, and based on the detection of the trigger event, at least one counterpart device included in the identified group It can be set to perform a function corresponding to the trigger event for.

Description

A wearable device that communicates with at least one counterpart device according to a trigger event and a control method thereof

This document relates to a wearable device that communicates with at least one counterpart device according to a trigger event and a control method thereof.

Various services and additional functions provided through electronic devices, for example, portable electronic devices such as smart phones, are gradually increasing. In order to increase the utility value of these electronic devices and satisfy the needs of various users, communication service providers or electronic device manufacturers are competitively developing electronic devices to provide various functions and to differentiate themselves from other companies. Accordingly, various functions provided through electronic devices are becoming increasingly sophisticated.

Recently, glass-type wearable devices are being used for various purposes. For example, cases of holding a meeting or holding a lecture using a glass-type wearable device are rapidly increasing. However, in the case of performing a specific task (eg, conducting a meeting) using a glasses-type wearable device, the existing glasses-type wearable device only displays a virtual object related to the specific task (eg, the screen of the other party attending the meeting). Performs a specific function according to a trigger event (eg, detecting a "heart gesture") by a part of the user's body (eg, hand) It does not provide any function or operation to send a representation). In addition, the existing glasses-type wearable device does not have a glasses-type wearable device and provides a first user (eg, a user performing a specific task through the wearable device) and a user (eg, a second user) performing a specific task. As for the glass-type wearable device, a function or operation of providing information related to a virtual object provided through the wearable device to the second user is not provided at all.

According to an embodiment of the present document, a specific function (eg, expression of emotion related to a “heart gesture” to the other party's device) according to a trigger event (eg, “heart gesture” detection) by a user's body part (eg, hand) A wearable device capable of improving usability of the wearable device by performing transmission) may be provided.

According to an embodiment of the present document, information related to a virtual object provided through a wearable device and/or a trigger event by the first user even for a user who does not have a wearable device and performs a specific task with the first user A wearable device capable of providing functions may be provided.

A wearable device according to an embodiment of the present document includes a display module and at least one processor, and the at least one processor controls the display module so that at least one graphic object is displayed in a display area. , Identifying whether the user's body part is located in the first region, identifying a group corresponding to the first region based on the user's body part being located in the first region, and identifying the user's body part While is located in the first area, it identifies whether a trigger event by the user is detected, and based on the detection of the trigger event, at least one counterpart device included in the identified group is configured to perform a function corresponding to the trigger event for each device, and the function may be a function commonly performed for the at least one counterpart device.

A method for controlling a wearable device according to an embodiment of the present document includes an operation of controlling a display module of the wearable device so that at least one graphic object is displayed in a display area, and a part of a user's body in a first area identifying whether the user's body part is located in the first region, and based on the user's body part being located in the first region, identifying a group corresponding to the first region; and the user's body part is located in the first region. an operation of identifying whether a trigger event by the user is detected while located at ; and, based on the detection of the trigger event, the trigger for at least one counterpart device included in the identified group. An operation of performing a function corresponding to an event may be included, and the function may be a function commonly performed for the at least one counterpart device.

According to an embodiment of the present document, a specific function (eg, expression of emotion related to a “heart gesture” to the other party's device) according to a trigger event (eg, “heart gesture” detection) by a user's body part (eg, hand) A wearable device capable of improving the usability of the wearable device by performing transmission) may be provided.

According to an embodiment of the present document, information related to a virtual object provided through a wearable device and/or a trigger event by the first user even for a user who does not have a wearable device and performs a specific task with the first user A wearable device capable of providing functions may be provided.

Effects according to various embodiments are not limited to the effects described above, and it is obvious to those skilled in the art that various effects are inherent in the present disclosure.

1 is an exemplary diagram for describing a glass-type wearable device according to an embodiment of the present document.
2A is an exemplary diagram for explaining the structure of a glass-type wearable device according to an embodiment of the present document.
2b and 2c are exemplary diagrams for explaining a connection relationship of a glass-type wearable device according to an embodiment of the present document.
3 is an exemplary diagram for explaining a function or operation in which a glasses-type wearable device performs a specific function according to a trigger event according to an embodiment of the present document.
4 is an exemplary diagram for explaining at least one graphic object displayed by a glasses-type wearable device according to an embodiment of the present document.
5A is an exemplary diagram for explaining at least one radius set based on a glass-type wearable device according to an embodiment of the present document.
5B is a method for determining whether a part of a user's body is located within at least one radius according to an embodiment of the present document, and is an exemplary view for explaining at least one area set within a display area.
5C is a function or operation for determining that the user's body part is located in the first radius by the glasses-type wearable device when it is detected that the user's body part is located in the first area according to an embodiment of the present document. It is an exemplary drawing for explaining.
5D and 5E show that, when it is detected that the user's body part is located within a space set based on the first area according to an embodiment of the present document, the user's body part moves within a first radius by the glass-type wearable device. These are exemplary drawings for explaining functions or operations determined to be located in .
5F is an exemplary diagram for explaining a case in which at least one radius is set according to another embodiment of the present document.
5G and 5H illustrate a function or operation of detecting that a part of a user's body is located within at least one radius by a glasses-type wearable device when at least one radius is set according to another embodiment of the present document. These are exemplary drawings for
5I is an exemplary diagram for explaining a case in which at least one radius is set according to another embodiment of the present document.
6A and 6B are exemplary diagrams for explaining a preset group to correspond to at least one radius according to an embodiment of the present document.
7A and 7B are exemplary diagrams for describing a trigger gesture according to an embodiment of the present document.
8 is an exemplary diagram for explaining a function or operation in which a specific function is performed by a glasses-type wearable device according to a trigger event (eg, detection of a trigger gesture) according to an embodiment of the present document.
9 illustrates communication with at least one counterpart device according to reception of a communication signal from an external electronic device operatively connected to the glasses-type wearable device by the glasses-type wearable device according to an embodiment of the present document (example : It is an exemplary diagram for explaining a function or operation of transmitting a text message).
10A, 10B, and 10C are exemplary diagrams for explaining the function or operation described in FIG. 9 from the viewpoint of a graphic user interface.
11 is an exemplary diagram for explaining a function or operation of sharing at least one content with at least one counterpart device when a glasses-type wearable device detects a sharing gesture according to an embodiment of the present document.
12A, 12B, and 12C are exemplary diagrams for describing the function or operation described in FIG. 11 from the viewpoint of a graphic user interface.
13 is an example for explaining a function or operation of generating at least one counterpart device into a group corresponding to a specific radius when a glasses-type wearable device detects a group creation gesture according to an embodiment of the present document; it is a drawing
14a, 14b, 14c, and 14d are exemplary diagrams for explaining the function or operation described in FIG. 13 from the viewpoint of a graphic user interface.

1 is an exemplary diagram for explaining a glass-type wearable device 100 according to an embodiment of the present document. In this document, the glass-type wearable device 100 is described as an example, but is not limited thereto. For example, the various embodiments described in this document may be an accessory type (eg, a watch, ring, bracelet, anklet, necklace, glasses, contact lens, or a head mounted device (HMD) or a head mounted display device ( head mounted display (HMD)), fabric or clothing integral type (eg, electronic clothing), body attachment type (eg, skin pad or tattoo), or bio-implantable circuitry. The glass-type wearable device 100 according to an embodiment of the present document includes a first camera 111, a second camera 112, a third camera 113, a processor 120, a PMIC 130, a battery ( 135), a memory 140, a display module 150, an audio module 161, an audio input device 162, an audio output device 163, a communication circuit 170, and a sensor 180. can do.

According to an embodiment of the present document, an image acquired through the first camera 111 may be used for hand gesture detection by a user, head tracking of the user, and/or spatial recognition. According to an embodiment of the present document, the first camera 111 may include a global shutter (GS) camera. According to an embodiment of the present document, the first camera 111 may perform a simultaneous localization and mapping (SLAM) operation through depth imaging. According to an embodiment of the present document, the first camera 111 may perform spatial recognition for 6DoF. When the first camera 111 according to an embodiment of the present document is worn by the first user, it may be set to capture the real world corresponding to the gaze of the first user.

According to an embodiment of the present document, an image obtained through the second camera 112 may be used for detection and tracking of the user's pupil. According to one embodiment of this document, the second camera 112 may include a GS camera. According to an embodiment of the present document, the second cameras 112 may correspond to the left eye and the right eye, respectively, and the performance of the second cameras 112 may be the same or similar to each other. The second camera 112 according to an embodiment of the present document may be set to acquire an image of a user's facial expression. At least one processor 120 according to an embodiment of the present document may be configured to detect a change in the user's facial expression based on the image of the user's facial expression acquired by the second camera 112 .

According to one embodiment of the present document, the third camera 113 may include a higher resolution camera than the first camera 111 and the second camera 112 . According to an embodiment of the present document, the third camera 113 may perform an auto-focusing (AF) function and a shake correction function. According to an embodiment of the present document, the third camera 113 may include a GS camera or a rolling shutter (RS) camera. When the first camera 111 according to an embodiment of the present document is worn by the first user, it may be set to capture the real world corresponding to the gaze of the first user.

The processor 120 according to an embodiment of the present document may include components of the glass-type wearable device 100, for example, the first camera 111, the second camera 112, and the third camera 113 , PMIC 130, memory 140, display module 150, audio module 161, communication circuit 170, and sensor 180 can be controlled, and various data processing or calculations can be performed. . The processor 120 according to an embodiment of the present document, for example, executes software (eg, a program) to at least one other component (eg, a program) of the glass-type wearable device 100 connected to the processor 120. hardware or software components), and can perform various data processing or calculations. According to one embodiment of the present document, as at least part of data processing or operation, processor 120 transfers instructions or data received from other components (eg, sensor module 176 or communication module 190) to volatile memory. , process commands or data stored in volatile memory, and store resultant data in non-volatile memory. According to an embodiment of the present document, the processor 120 may include a main processor (eg, a central processing unit or an application processor) or a secondary processor (eg, a graphic processing unit, a neural network processing unit (NPU) that may operate independently of or together with the main processor) processing unit), image signal processor, sensor hub processor, or communication processor). For example, when the glasses-type wearable device 100 includes a main processor and an auxiliary processor, the auxiliary processor may use less power than the main processor or may be set to be specialized for a designated function. A secondary processor may be implemented separately from, or as part of, the main processor.

The PMIC 130 according to an embodiment of the present document converts the power stored in the battery 135 to have a current or voltage required by other components of the glass-type wearable device 100, so that the glass-type wearable device 100 Other components may be supplied.

The memory 140 according to an embodiment of the present document may store various data used by at least one component (eg, the processor 120 or the sensor module 180) of the glass-type wearable device 100. there is. The memory 140 according to an embodiment of the present document may include a volatile memory or a non-volatile memory.

The display module 150 according to an embodiment of the present document may display a screen to be provided to the user. The display module 150 according to an embodiment of the present document may output data (eg, RGB data) for expressing a virtual object (eg, an augmented reality guide). The display module 150 according to an embodiment of the present document includes a first display 251, a second display 252, one or more input optical members 253-1 and 253-2, and one or more transparent members 290-250. 1 and 290-2), and one or more screen display parts 254-1 and 254-2.

The audio module 161 according to an embodiment of this document is connected to the audio input device 162 and the audio output device 163, converts data input through the audio input device 162, and converts data input to the audio output device ( 163) can convert the data to be output. The audio input device 162 according to an embodiment of the present document may include at least one microphone, and the audio output device 163 may include at least one speaker and amplifier. The communication circuit 170 according to an embodiment of the present document may support establishment of a wireless communication channel with an external electronic device connected to the glasses-type wearable device 100 and communication through the established communication channel. The sensor 180 according to an embodiment of the present document may include a 6-axis sensor 181 , a magnetic sensor 182 , a proximity sensor 183 , and/or an optical sensor 184 .

2 is an exemplary diagram for explaining the structure of a glass-type wearable device 100 according to an embodiment of the present document.

Referring to FIG. 2 , the glass-type wearable device 100 may include one or more light emitting elements 214-1 and 214-2. The light emitting devices 214-1 and 214-2 according to an embodiment of the present document may be different from light sources to be described later, which radiate light to a screen output area of a display. According to an embodiment of the present document, the light emitting devices 214-1 and 214-2 detect and track the user's pupils through one or more second cameras 212-1 and 212-2. Light may be irradiated to facilitate detection. According to one embodiment of this document, each of the light emitting elements 214-1 and 214-2 may include an LED. According to one embodiment of this document, the light emitting devices 214-1 and 214-2 may emit light in the infrared region. According to an embodiment of the present document, the light emitting devices 214-1 and 214-2 may be attached to the periphery of the frame of the glass-type wearable device 100. According to one embodiment of this document, the light emitting elements 214-1 and 214-2 are located around one or more first cameras 211-1 and 211-2, and the glass-type wearable device 100 is used in a dark environment. When used, it may assist with gesture detection, head tracking, and spatial recognition by one or more of the first cameras 211-1, 211-2. According to an embodiment of the present document, the light emitting elements 214-1 and 214-2 are located around one or more third cameras 213, and when the glass-type wearable device 100 is used in a dark environment, one or more third Image acquisition by the camera 213 may be assisted.

According to one embodiment of this document, the glass-type wearable device 100 may include batteries 235-1 and 235-2. The batteries 235 - 1 and 235 - 2 may store power for operating the remaining components of the glass-type wearable device 100 .

According to one embodiment of this document, the glass-type wearable device 100 includes a first display 251, a second display 252, one or more input optical members 253-1 and 253-2, and one or more transparent members. 290-1 and 290-2, and one or more screen display parts 254-1 and 254-2. According to an embodiment of the present document, the first display 251 and the second display 252 may include, for example, a liquid crystal display (LCD), a digital mirror device (DMD), It may include a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED). According to one embodiment of the present document, when the first display 251 and the second display 252 are formed of one of a liquid crystal display, a digital mirror display, and a silicon liquid crystal display, the glass-type wearable device 100 is a display A light source for radiating light to the screen output area may be included. According to an embodiment of the present document, when the first display 251 and the second display 252 can generate light by themselves (eg, made of either an organic light emitting diode or a micro LED), a glass type wearable The device 100 may provide a relatively high-quality virtual image to a user even without a separate light source.

According to an embodiment of the present document, one or more transparent members 290-1 and 290-2 may be disposed to face the user's eyes when the user wears the glass-type wearable device 100. According to one embodiment of the present document, the one or more transparent members 290-1 and 290-2 may include at least one of a glass plate, a plastic plate, or a polymer. According to one embodiment of this document, a user may see the outside world through one or more transparent members 290-1 and 290-2 when wearing the glass-type wearable device 100. According to one embodiment of the present document, one or more input optical members 253-1 and 253-2 may guide light generated by the first display 251 and the second display 252 to the user's eyes. . According to one embodiment of this document, a first display 251 and a second display ( An image based on the light generated in step 252 is formed, and the user can see the image formed on one or more screen display parts 254-1 and 254-2.

According to one embodiment of this document, the glass-type wearable device 100 may include one or more optical waveguides (not shown). The optical waveguide according to an embodiment of the present document may transmit light generated by the first display 251 and the second display 252 to the user's eyes. The glass-type wearable device 100 may include one optical waveguide corresponding to each of the left and right eyes. According to one embodiment of the present document, the optical waveguide may include at least one of glass, plastic, or polymer. According to an embodiment of the present document, the optical waveguide may include a nanopattern formed on an inner or outer surface, for example, a polygonal or curved grating structure. According to an embodiment of the present document, the optical waveguide may include a free-form prism, and in this case, the optical waveguide may provide incident light to a user through a reflective mirror. According to an embodiment of the present document, the optical waveguide includes at least one of at least one diffractive element (eg, a diffractive optical element (DOE), a holographic optical element (HOE)) or a reflective element (eg, a reflective mirror), Display light emitted from a light source may be guided to the eyes of a user by using at least one diffractive element or reflective element included in the optical waveguide. According to one embodiment of this document, the diffractive element may include input/output optical elements. According to one embodiment of the present document, the reflective element may include a member that causes total internal reflection.

According to one embodiment of this document, the glass-type wearable device 100 includes one or more audio input devices 262-1, 262-2, and 262-3 and one or more audio output devices 263-1, 263-2. can include

According to one embodiment of this document, the glass-type wearable device 100 may include a first PCB 270-1 and a second PCB 270-2. The first PCB 270-1 and the second PCB 270-2 include a first camera 111, a second camera 112, a third camera 113, a display module 150, and an audio module 161. It may be set to transmit an electrical signal to components included in the glass-type wearable device 100, such as , and the sensor 180. According to one embodiment of this document, the first PCB 270-1 and the second PCB 270-2 may include a flexible printed circuit board (FPCB). According to one embodiment of the present document, the first PCB 270-1 and the second PCB 270-2 each include a first substrate, a second substrate, and an interface disposed between the first substrate and the second substrate. Posers may be included.

2B and 2C are exemplary diagrams for explaining a connection relationship of the glass-type wearable device 100 according to an embodiment of the present document.

Referring to FIG. 2B , the first user's glasses-type wearable device 100 according to an embodiment of the present document may be directly connected to an external electronic device (eg, the counterpart device 280) through a network. A network according to an embodiment of the present document is a first network (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (eg, a legacy cellular network, 5G network, a next-generation communications network, the Internet, or a telecommunications network such as a computer network (eg, a LAN or WAN). Alternatively, as shown in FIG. 2C , the glasses-type wearable device 100 of the first user according to an embodiment of the present document may be connected to the counterpart device 280 through a server. A server according to an embodiment of the present document may include an intelligent server using machine learning and/or neural networks. Although smart glasses are shown as an example of the counterpart device 280 in FIGS. 2B and 2C , the embodiment of the counterpart device 280 is not limited thereto. In this document, the term “counterpart device 280” is used as an example of an external electronic device, but it does not necessarily mean only a device owned by a user different from the owner of the glasses-type wearable device 100. According to various embodiments of this document, the “counter device 280” may include various types of devices owned by the owner of the glasses-type wearable device 100.

FIG. 3 is an exemplary diagram for explaining a function or operation in which the glasses-type wearable device 100 performs a specific function according to a trigger event according to an embodiment of the present document.

Referring to FIG. 3 , the glasses-type wearable device 100 according to an embodiment of the present document, in operation 310, generates at least one graphic object (eg, a first graphic object 410a and a second graphic object 410b). , the display module 150 may be controlled so that the third graphic object 410c and the fourth graphic object 420 are displayed in the display area 400 . 4 is an exemplary diagram for explaining at least one graphic object displayed by a glasses-type wearable device according to an embodiment of the present document. Referring to FIG. 4 , a display area 400 according to an embodiment of the present document includes at least one graphic object (eg, a first graphic object 410a, a second graphic object 410b, and a third graphic object 410c). ) and a region where the fourth graphic object 420) is set to be displayed as a virtual object. According to one embodiment of this document, the terms “field of view of the glass-type wearable device 100” and/or “field of view of the display module” refer to the size of the display area 400 itself (eg, the display It may be used as a term meaning the horizontal and vertical lengths of the area 400, the horizontal and vertical angular ranges (eg, 50 degrees horizontally and 30 degrees vertically), or the area of the display area 400 itself. In the display area 400 according to an embodiment of the present document, at least one graphic object (e.g., : The first graphic object 410a, the second graphic object 410b, and the third graphic object 410c) may be displayed. The glasses-type wearable device 100 according to an embodiment of this document may be configured to receive information of the counterpart device 280 through the first network, the second network, and/or the server. At least one graphic object (eg, the first graphic object 410a, the second graphic object 410b, and the third graphic object 410c) according to an embodiment of the present document is, for example, a first user ( Example: A user using the glasses-type wearable device 100) or a 3D avatar (eg, an augmented reality (AR) emoji) set by a second user (eg, a user of the other device 280), a video call It may include an execution screen, an execution screen of a voice call preset by a call application and/or a screen including a text message according to a format provided by a message application or a specific application (eg, an application for a conference). can In FIG. 4 , a state in which a specific session (eg, a conference) is in progress through a specific application (eg, an application for a conference) is illustratively illustrated. In FIG. 4 , the first graphic object 410a is a video call execution screen, the second graphic object 410b is a 3D avatar set by the other party's device 280, and the third graphic object 410c is a specific An embodiment displayed on a screen including a text message according to a format provided by an application is shown as an example. According to an embodiment of the present document, at least one graphic object (eg, a first graphic object 410a, a second graphic object 410b, and a third graphic object 410c) corresponding to at least one counterpart device 280 )) may be displayed after being modified according to a display format provided by a device used by the second user. For example, when the counterpart device 280 corresponding to the first graphic object 410a is a smart phone having a 2D flat display, at least one graphic object (eg, the second graphic object 410b and the second graphic object 410b). 3 graphic objects 410c) may be displayed on the other device 280 in two dimensions through a split screen (eg, a multi-window screen). In addition, when the counterpart device 280 corresponding to the first graphic object 410a is a wearable device (eg, the glasses-type wearable device 100), at least one graphic object (eg, the second graphic object 410b and As shown in FIG. 4 , the third graphic object 410c may be displayed as a virtual object in a 3D space. In addition, according to an embodiment of the present document, even when the counterpart device 280 is a smart phone having a 2D flat display, at least one graphic object (eg, the second graphic object 410b and the third graphic object 410b) is provided. (410c)) may be displayed as a 3D object. Also, according to an embodiment of the present document, even when the counterpart device 280 is a wearable device (eg, the glasses-type wearable device 100), at least one graphic object (eg, the second graphic object 410b and the second graphic object 410b) The 3 graphic object 410c) may be displayed as a 2D object. At least one graphic object (eg, the fourth graphic object 420) according to an embodiment of the present document may include an execution screen of a specific application (eg, a video providing application). In FIG. 4 , the execution screen of one video providing application is illustratively shown as the fourth graphic object 420, but the execution screens of a plurality of video providing applications may be displayed as the fourth graphic object 420, and different Execution screens of types of applications (eg, a gallery application and a video providing application) may be displayed on the display area 420 as the fourth graphic object 420 . According to an embodiment of the present document, at least one graphic object (eg, a first graphic object 410a, a second graphic object 410b, a third graphic object 410c, and a fourth graphic object 420) A position and/or order displayed in the display area 420 may be pre-specified. For example, as shown in FIG. 4 , the fourth graphic object 420 is displayed at the substantial center of the display area, and the fourth graphic object 420 is displayed in half from the top left of the display area 400 in the order of being connected to the glass-type wearable device 100. It can be displayed clockwise.

In operation 320, the glass-type wearable device 100 according to an embodiment of the present document moves a first body part of a user (eg, the first user) to a first area (eg, the first area 510a or the first area 510a). It is possible to identify whether or not it is located within the radius 510 . The glasses-type wearable device 100 according to an embodiment of the present document may compare a pre-stored template with an image obtained by the glasses-type wearable device 100 to identify a part of the user's body. Alternatively, according to another embodiment of the present document, a part of the user's body may be identified based on a result learned according to an artificial intelligence model. An artificial intelligence model according to an embodiment of the present document may include a plurality of artificial neural network layers. Artificial neural networks according to an embodiment of this document include a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), and a BRDNN. (bidirectional recurrent deep neural network), deep Q-networks, or a combination of two or more of the above, but is not limited to the above examples. FIG. 5A shows at least one radius region (eg, a first radius region 510, a second radius region 510) set to have the same center with respect to the glass-type wearable device 100 according to an embodiment of the present document. It is an exemplary diagram for explaining the radius area 520 and the third radius area 530 . FIG. 5B is a method for determining whether a first body part of a user is located within at least one radial area according to an embodiment of the present document, and is an exemplary view for explaining at least one area set within a display area. . At least one radius area (eg, a first radius area 510, a second radius area 520, and a third radius area 530) according to an embodiment of the present document are shown in FIG. 5A, for example. As such, it may refer to a 2D area or a 3D area set to have a specific angle with respect to the user's first body part (eg, the user's right hand). Also, according to another embodiment of the present document, at least one radius area (eg, the first radius area 510 , the second radius area 520 , and the third radius area 530 ) of the display module 160 It may refer to a 2-dimensional area or a 3-dimensional area divided into a plurality of areas based on a viewing angle. Although not shown, at least one radius area (eg, the first radius area 510 and the second radius area 520) may be set to have different centers (eg, right hand and left hand). In other words, the center of at least one radius area (eg, the first radius area 510 and the second radius area 520) may be changed according to whether the user's first body part is the right hand or the left hand. According to an embodiment of the present document, the glass-type wearable device 100 provides a user's first body part (eg, right hand) to a first region (eg, the first region 510a or the first radius region 510). 5b, at least one area (eg, a first area 510a, a second area 520a, and a third area 530a) with respect to the display area 400, as shown in FIG. )) may be set in advance. According to an embodiment of the present document, the size, area, or number of at least one region (eg, the first region 510a, the second region 520a, and the third region 530a) may be changed by a user setting. It may be changed. According to an embodiment of the present document, at least one area (eg, the first area 510a, the second area 520a, and the third area 530a) includes at least one graphic object (eg, the first graphic object). 410a, the second graphic object 410b, the third graphic object 410c, and the fourth graphic object 420 may be determined based on the displayed position and/or number. For example, when more graphic objects are displayed on the right side than the left side based on the user's position, at least one area (eg, the first area 510a, the second area) according to an embodiment of the present document 520a, the third area 530a) may be set so that the radius area set to the right of the user (eg, the third radius area 530) covers a larger area than other radius areas.

At least one area (eg, the first area 510a, the second area 520a, and the third area 530a) according to an embodiment of the present document may be set based on the coordinate values of the display area 400. can For example, when the horizontal coordinate value of the display area 400 is set to have a value from 0 to 1000, the first area 510a is formed from 0 to 200, and the second area 510b is from more than 200 to 800 or less. ), from more than 800 to less than 1000 may be designated as the third area 510c. At least one area (eg, the first area 510a, the second area 520a, and the third area 530a) designated as described above may include at least one radius area (eg, the first radius area 510, the second area 510, the second area 510a, the second area 510a, the second area 510a) It may correspond to the radius area 520 and the third radius area 530 . 5C , when it is detected that the user's first body part is located in the first area according to an embodiment of the present document, the user's first body part is located in the first radius area 510 by the glass-type wearable device. It is an exemplary diagram for explaining a function or operation determined to be located in . As shown in FIG. 5C , when the glass-type wearable device 100 according to an embodiment of the present document detects that the user's first body part (eg, right hand) is located in the first region 510a, , it may be identified that the user's first body part is located in the first radius area 510 . When the glasses-type wearable device 100 according to an embodiment of the present document detects that a part of the user's body is located in a specific area (eg, the first area 510a) greater than or equal to a preset critical area, the user's It may be detected that the body part is located in a specific region (eg, the first region 510a). For example, in the glass-type wearable device 100 according to an embodiment of the present document, when a part of the user's body (eg, the right hand) spans the second region 520a and the third region 530a, It may be detected (eg, determined) that the user's body part is located in an area including a larger area of the user's body part. The wearable device 100 according to an embodiment of the present document may identify a first body part of the user by using at least one camera (eg, the first camera 111). 5D and 5E show a case in which it is detected that a first body part of the user is located within a space set based on the first area 510a (eg, the first space 512) according to an embodiment of the present document. , These are exemplary drawings for explaining functions or operations in which the first body part of the user is determined to be located in the first radial region 510 by the glasses-type wearable device 100 . According to another embodiment of the present document, it is detected that the user's first body part is located in a space (eg, the first space 512) set in advance or according to the user's setting based on the first area 510a. In this case, the wearable device 100 according to an embodiment of the present document may identify that the user's first body part is located in at least one radius area (eg, the first radius area 510). In this case, as shown in FIG. 5E , even if the user's first body part is not included on the display area 400, it can be identified by the glass-type wearable device 100 as being located in the first radius area 510. there is. 5F illustrates a case in which at least one radius area (eg, a first radius area 510, a second radius area 520, and a third radius area 530) is set according to another embodiment of the present document. This is an example drawing for 5g and 5h show cases in which at least one radius area (eg, a first radius area 510, a second radius area 520, and a third radius area 530) is set according to another embodiment of the present document. , the user's first body part is located within at least one radius area (eg, the first radius area 510, the second radius area 520, and the third radius area 530) by the glass-type wearable device 100. These are exemplary drawings for explaining a function or operation in which location is detected. Referring to FIG. 5F , radial areas (eg, a first radius area 510, a second radius area 520, and a third radius area 530) according to an embodiment of the present document are shown in FIG. 5F. As such, it may be set in a form gradually moving away from the user (eg, horizontally based on the user's location). In this case, in the glasses-type wearable device 100 according to an embodiment of the present document, the user's second body part (eg, the elbow or the part where the arm is folded in the opposite direction to the elbow) is moved from the glass-type wearable device 100. Based on the spaced distance, the user's first body part (eg, right hand) is in a specific radius area (eg, the first radius area 510, the second radius area 520, or the third radius area 530). location can be determined. In other words, the glass-type wearable device 100 according to an embodiment of the present document may select different radius regions according to the extent to which the user's arm is extended (eg, arm length). For example, in the glass-type wearable device 100 according to an embodiment of the present document, within a range where the user's second body part (eg, elbow) is invisible, the user's first body part (eg, right hand) It can be determined that it is included in the first radius area 510 . According to this, in the embodiment illustrated in FIG. 5G , it may be identified by the glasses-type wearable device 100 that the user's body part (eg, right hand) is included in the first radius region 510 . The glasses-type wearable device 100 according to an embodiment of the present document detects a part of the user's body (eg, the elbow) within a distance where the elbow is moved by a predetermined distance from a position where the second body part (eg, elbow) of the user is detected. When the user's body part (eg, the right hand) is detected, it may be determined that the second radius area 520 includes the user's body part. According to this, in the embodiment illustrated in FIG. 5H , the glass-type wearable device 100 may identify that the user's first body part (eg, right hand) is included in the second radius area 520 . According to an embodiment of the present document, the user's first body part (eg, a body part that is a criterion for identifying that the user's body part is included in a radial area) and the user's second body part (eg, included in a radius area) A body part that is a criterion for determining whether or not the body part) may be designated in advance. Referring to FIG. 5I, radius areas (eg, a first radius area 510 and a second radius area 520) according to an embodiment of the present document are based on different centers as shown in FIG. 5I. may be set. Even in this case, a specific area (eg, the first area (eg, the first area (eg, the first area (eg, the first area (eg, the first area)) 510a) and the second area 520a) may be set in advance. Also, the shading effect shown in FIGS. 5G and 5H to indicate that a specific area is selected may not be visible to the user.

In operation 330, the glasses-type wearable device 100 according to an embodiment of the present document, based on the location of the user's body part (eg, the right hand) in the first area (eg, the first area 510a), A group corresponding to the first area (eg, the first area 510a) may be identified. 6A and 6B show at least one radius area (eg, a first radius area 510, a second radius area 520, and/or a third radius area 530) according to an embodiment of the present document. These are exemplary drawings for explaining groups preset to correspond. Referring to FIG. 6A , the glasses-type wearable device 100 according to an embodiment of the present document includes a counterpart device 280 corresponding to a first graphic object 410a and a counterpart device 280 corresponding to a second graphic object 410b. Devices 280 may be identified as being in the same group. A group according to an embodiment of the present document is set to correspond to at least one radius area (eg, a first radius area 510, a second radius area 520, and/or a third radius area 530) There may be. In FIG. 6A , the counterpart device 280 corresponding to the first graphic object 410a and the counterpart device corresponding to the second graphic object 410b belong to the same group by the user in advance (eg, a conference application is executed). before) is shown as an example. When the glass-type wearable device 100 according to an embodiment of the present document detects that the user's first body part (eg, right hand) is located within the first radius area 510, the first radius area 510 ), a visual effect (eg, a border) may be displayed around at least one graphic object (eg, the first graphic object 410a and the second graphic object 410b) belonging to the set first group. However, the glass-type wearable device 100 according to an embodiment of the present document provides an auditory effect (eg, a pre-specified sound) and/or a tactile effect (eg, a pre-specified intensity) in addition to/with a visual effect. vibration) may be provided through the glass-type wearable device 100 . In FIG. 6A , a case in which the first graphic object 410a and the second graphic object 410b according to an embodiment of the present document are set as one group corresponding to the first radius area 510 is illustratively illustrated. 6B, a case in which the first graphic object 410a according to an embodiment of the present document is set as one group corresponding to the first radius area 510 is illustrated as an example.

In operation 340, the glass-type wearable device 100 according to an embodiment of the present document receives a trigger event while a first body part of the user is located in a first area (eg, the first radius area 510). It can be identified whether it is detected or not. A trigger event according to an embodiment of the present document may include detection of a predetermined gesture (eg, trigger gesture) by a user's first body part (eg, right hand) or detection of a user's voice command. According to an embodiment of the present document, when the trigger event includes detection of a voice command, the location of the user's first body part may be in a state of being located in the first region. However, according to another embodiment of the present document, the position of the user's first body part may be in a state not located in the first region. 7A and 7B are exemplary diagrams for describing a trigger gesture according to an embodiment of the present document. In Fig. 7a, a heart gesture is shown as an example of a trigger gesture. In FIG. 7B , a gesture of moving a hand up and down with a thumb raised is shown as an example of a trigger gesture. According to another embodiment of the present document, the trigger event may include an event of detecting a change in facial expression of the user and/or a movement of the pupil. The glasses-type wearable device 100 according to an embodiment of the present document may change the user's facial expression and/or detect pupils by using the user's face image obtained through at least one camera (eg, the second camera 112). movement can be detected.

The glasses-type wearable device 100 according to an embodiment of the present document, in operation 350, based on the detection of the trigger event, performs a function corresponding to the trigger event on the counterpart device 280 included in the identified group. can be done 8 is an exemplary diagram for explaining a function or operation in which a specific function is performed by the glasses-type wearable device 100 according to a trigger event (eg, detection of a trigger gesture) according to an embodiment of the present document. In FIG. 8 , when a trigger gesture (eg, a heart gesture) is detected, the trigger gesture (detected by the glasses-type wearable device 100 according to an embodiment of the present document to the counterpart device 280 belonging to a specific group) Example: An embodiment in which a function corresponding to a heart gesture (eg, message transmission including a heart) is performed is shown as an example. A message corresponding to a trigger gesture according to an embodiment of the present document is displayed on the execution screen of a video call (eg, a meeting) when the counterpart device is participating in a corresponding session (eg, a meeting) through a video call using a smart phone. can be displayed in two dimensions). Alternatively, a message corresponding to a trigger gesture according to an embodiment of the present document may be displayed (eg, displayed in three dimensions) in the form of an emoticon 810 in a chat window provided in a specific application, as shown in FIG. 8 . may be Alternatively, a message corresponding to a trigger gesture according to an embodiment of the present document may be transmitted as an SMS message to the counterpart device 280 . Referring to FIG. 8 , a message corresponding to a trigger gesture according to an embodiment of the present document is sent to the counterpart device 280 (eg, the first graphic object) included in the group corresponding to the first radius area 510. It can be transmitted to both the counterpart device corresponding to (410a) and the counterpart device corresponding to the second graphic object (410b). The glasses-type wearable device 100 according to an embodiment of this document performs a function or operation of identifying a counterpart device 280 belonging to a specific group in order to transmit a message corresponding to a trigger gesture to the counterpart device 280. can be done According to an embodiment of the present document, after the visual effect 610 is displayed, even if the user places the first body part away from the first area (eg, the first radius area 510), the visual effect 610 ) may be maintained, and the counterpart device 280 (eg, the first radius area 510) in which a specific function according to the detection of the trigger event is included in the group corresponding to the first area (eg, the first radius area 510). It can be performed on both the counterpart device corresponding to the graphic object 410a and the counterpart device corresponding to the second graphic object 410b. Alternatively, after the visual effect 610 is displayed, if the user places the first body part away from the first area (eg, the first radius area 510), the visual effect 610 may no longer be displayed. Also, even when a trigger event is detected (eg, detection of a heart gesture), a specific function may be controlled not to be performed by the glasses-type wearable device 100 . According to another embodiment of the present document, when it is detected that the movement of the user's pupil moves by a predetermined distance or more or the change in the user's facial expression changes from the first state to the second state, the glasses-type wearable device 100 , can perform a specific function. According to an embodiment of the present document, the glasses-type wearable device 100 may use a facial expression template stored in the memory 140 to detect a change in the user's facial expression. The glass-type wearable device 100 according to an embodiment of the present document compares the user's facial expression in the template and the obtained image, and when the matching ratio is equal to or greater than a predetermined ratio, the user's facial expression is in a specific state (eg, a smiling state). can be judged to be in Alternatively, the function or operation of determining the user's facial expression may be learned by an artificial intelligence model.

9 illustrates communication with at least one counterpart device according to reception of a communication signal from an external electronic device operatively connected to the glasses-type wearable device by the glasses-type wearable device according to an embodiment of the present document (example : It is an exemplary diagram for explaining a function or operation of transmitting a text message).

Referring to FIG. 9 , the glasses-type wearable device 100 according to an embodiment of the present document, in operation 910, generates at least one graphic object (eg, a first graphic object 410a and a second graphic object 410b). , the display module 150 may be controlled so that the third graphic object 410c and the fourth graphic object 420 are displayed in the display area 400 . In operation 920, the glass-type wearable device 100 according to an embodiment of the present document moves a first body part of a user (eg, the first user) to a first area (eg, the first area 510a or the first area 510a). It is possible to identify whether it is located within the radius 510). The glasses-type wearable device 100 according to an embodiment of the present document, in operation 930, based on the location of the user's body part (eg, the right hand) in the first area (eg, the first area 510a), A group corresponding to the first area (eg, the first area 510a) may be identified. For the operations 910 to 930 according to an embodiment of the present document, since the description of the above-described operations 310 to 330 may be equally applicable, a detailed description thereof will be omitted.

In operation 940, the glasses-type wearable device 100 according to an embodiment of the present document displays the identified group (eg, the first graphic object 410a and the second graphic object 410a) from the external electronic device (eg, smart phone) 1000. 3) may receive a request for communication with the counterpart device 280 belonging to the graphic object 410c (eg, transmission of a text message input to a smart phone). In operation 950, the glasses-type wearable device 100 according to an embodiment of the present document may perform communication with a counterpart device based on the received request. 10A, 10B, and 10C are exemplary diagrams for explaining the function or operation described in FIG. 9 from the viewpoint of a graphic user interface. An external electronic device (eg, a smart phone) according to an embodiment of the present document may be operably connected to the glass-type wearable device 100 through wired or wireless communication. In the glass-type wearable device 100 according to an embodiment of the present document, a “send” button 1020 of an external electronic device (eg, a smart phone) is selected as shown in FIG. 10B from an external electronic device. When receiving a signal indicating that it has been received, the other device 280 that belongs to the identified group (eg, the first graphic object 410a and the third graphic object 410c) by receiving information on the input text from the external electronic device You can send text messages to According to an embodiment of the present document, after a text message is transmitted, as shown in FIG. 10C , the transmitted text 1030 may be displayed on the execution screen 1010 of an application (eg, a text message application). there is. According to another embodiment of the present document, a signal indicating that a “send” button 1020 of the external electronic device 1000 is selected is received from an external electronic device (eg, a smart phone) as shown in FIG. 10B. In one case, the external electronic device 1000 may be controlled so that a text message including input text (eg, Hello) is transmitted to the identified counterpart device 280 by controlling the external electronic device 1000 . According to an embodiment of the present document, while operations 940 and 950 are performed, the position of the user's first body part (eg, the right hand) is not maintained in the first area (eg, the first radial area 510). may not be In FIGS. 10B and 10C , after a specific group is identified according to the detection of the user's first body part (eg, right hand) as shown in FIG. 10A , the location of the user's first body part (eg, right hand) is determined. An embodiment not maintained in the first area (eg, the first radius area 510) is illustrated as an example. However, according to another embodiment of the present document, in operations 940 and 950, the location of the user's first body part (eg, right hand) from the time point at which operation 930 is performed is determined in a first area (eg, a first radius area ( 510)) may be performed.

FIG. 11 shows at least one content (eg, fifth content 1225) when the glasses-type wearable device 100 according to an embodiment of the present document detects a sharing gesture (eg, drag and drop). It is an exemplary diagram for explaining a function or operation shared with one counterpart device 280 . 12A, 12B, and 12C are exemplary diagrams for describing the function or operation described in FIG. 11 from the viewpoint of a graphic user interface.

Referring to FIG. 11 , in operation 1110, the glasses-type wearable device 100 according to an embodiment of the present document may receive a request for sharing at least one piece of content (eg, fifth content 1225). there is. According to an embodiment of the present document, a request for sharing at least one piece of content (eg, the fifth content 1225) may include, for example, a plurality of items displayed on the display area 400 (eg, the first content 1225). It may include a virtual touch input for any one item (eg, the second item 1214) among the item 1212, the second item 1214, and the third item 1216. In the glass-type wearable device 100 according to an embodiment of the present document, a plurality of images of a user's body part (eg, right hand) acquired using at least one camera (eg, the first camera 111) When it is determined that any one of the items (eg, the first item 1212, the second item 1214, and the third item 1216) overlaps with any one item (eg, the second item 1214), or , When a motion of a finger selecting any one item (eg, the second item 1214) is detected in an overlapping state, a virtual touch input for any one item (eg, the second item 1214) is It can be judged that it has been received. According to another embodiment of the present document, it is possible to determine whether a virtual touch is input through a separate device for determining a virtual touch (eg, a sensor provided on a user's hand). According to another embodiment of the present document, a coordinate in a space where a user's fingertip is located is recognized using a plurality of cameras, and the coordinate in the recognized space is an item (eg, the second item 1214). Whether or not a virtual touch is input may be determined according to whether the coordinates on the displayed space are matched. In addition, various algorithms (eg, artificial intelligence model algorithms) for determining that a virtual touch has been performed may be applied.

In operation 1120, the glasses-type wearable device 100 according to an embodiment of the present document may receive a selection input (eg, a virtual touch input) for at least one piece of content (eg, the fifth content 1225). there is. When the glasses-type wearable device 100 according to an embodiment of the present document receives a request for sharing at least one content (eg, the fifth content 1225) in accordance with operation 1110, a plurality of pieces of content to be shared are received. Two contents may be displayed on the display area 400 . In FIG. 12B, a plurality of images (eg, first content 1221, second content 1222, and third content 1223) are displayed according to a request for sharing at least one content (eg, fifth content 1225). ), the fourth content 1224, the fifth content 1225, and the sixth content 1226), an embodiment in which the execution screen 1220 of the gallery application is displayed is illustrated as an example. The glass-type wearable device 100 according to an embodiment of the present document includes a plurality of images (eg, first content 1221, second content 1222, third content 1223, and fourth content 1224). , the fifth content 1225, and the sixth content 1226) may receive (eg, identify) a virtual touch input for any one image (eg, the fifth content 1225). However, virtual touch input according to an embodiment of this document is an embodiment of selection input, and operation 1120 is performed through various devices (eg, a touch panel or sensor provided in the glass-type wearable device 100). may be performed.

In operation 1130, the glasses-type wearable device 100 according to an embodiment of the present document identifies a graphic object corresponding to a group set for an area where a part of the user's body is located (eg, the first radius area 510). can do. As shown in FIG. 12C , the glass-type wearable device 100 according to an embodiment of the present document displays the selected content (eg, the fifth content 1225) in a specific area (eg, the first radius area 510). ), a gesture (eg, a virtual drag gesture) may be detected. In this case, the selected content (eg, the fifth content 1225) may be displayed in the display area 400 as a thumbnail image until the user's gesture ends, as shown in FIG. 12C. 12C illustrates an embodiment in which the first graphic object 410a and the second graphic object 410b are determined as graphic objects corresponding to the first area (eg, the first radius area 510). . According to an embodiment of the present document, when it is detected that a part of the user's body enters the first area (eg, the first radius area 510), the glass-type wearable device 100 provides a visual effect 610. It can be displayed around the first graphic object 410a and the second graphic object 410b.

In operation 1140, the glasses-type wearable device 100 according to an embodiment of the present document may detect a sharing gesture. In operation 1150, the glasses-type wearable device 100 according to an embodiment of the present document transmits at least one piece of content (eg, a fifth Content 1225) may be transmitted. A sharing gesture according to an embodiment of the present document may include a virtual drop gesture for dropping a displayed thumbnail image. In order to determine a gesture of dropping a thumbnail image, the glasses-type wearable device 100 according to an embodiment of the present document includes at least a part of the function or operation of determining the virtual touch input described above, or the glasses-type wearable device ( 100), it may be determined whether the gesture of the user is a gesture of dropping a thumbnail image by using a template (eg, a template corresponding to a drop gesture) stored in advance. When a sharing gesture is detected, the glasses-type wearable device 100 according to an embodiment of this document transmits data about at least one content (eg, fifth content) stored in the glasses-type wearable device 100 to the other device ( 280) (eg, the counterpart device 280 corresponding to the first graphic object 410a and the counterpart device 280 corresponding to the second graphic object 410b).

13 illustrates a function of generating at least one counterpart device 280 into a group corresponding to a specific radius when the glasses-type wearable device 100 detects a group creation gesture according to an embodiment of the present document; It is an exemplary diagram for explaining the operation. 14a, 14b, 14c, and 14d are exemplary diagrams for explaining the function or operation described in FIG. 13 from the viewpoint of a graphic user interface.

Referring to FIG. 13 , the glasses-type wearable device 100 according to an embodiment of the present document may receive a request for creating a group in operation 1310 . A request for creating a group according to an embodiment of the present document is, as exemplarily shown in FIG. 14A , a plurality of items (eg, a first item 1212, It may include a virtual touch input for any one of the two items 1214 and the third item 1216 (eg, the first item 1212).

The glass-type wearable device 100 according to an embodiment of the present document, in operation 1320, includes at least one graphic object (eg, the first graphic object 410a and the third graphic object 410c) to belong to the same group. It is possible to receive selection input for. According to an embodiment of the present document, the selection input according to operation 1320 includes at least one specific graphic object (eg, a first graphic object 410a and a third graphic object 410c, as exemplarily shown in FIG. 14B ). )) may include a virtual touch input. However, virtual touch input according to an embodiment of this document is an embodiment of selection input, and operation 1320 is performed through various devices (eg, a touch panel or sensor provided in the glass-type wearable device 100). may be performed.

In operation 1330, the glasses-type wearable device 100 according to an embodiment of the present document may detect a group creation gesture (eg, drag and drop). In operation 1340, the glasses-type wearable device 100 according to an embodiment of the present document selects at least one graphic object (eg, a first graphic object 410a and a third graphic object 410c) according to a group creation gesture. )) can be determined as the same group. Referring to FIGS. 14C and 14D , the glass-type wearable device 100 according to an embodiment of the present document includes at least one selected graphic object (eg, a first graphic object 410a and a third graphic object 410c). ) to a first area (eg, the first radius area 510) or a second area (eg, the second radius area 520). The glass-type wearable device 100 according to an embodiment of the present document uses an image acquired by at least one camera (eg, the first camera 111) to detect a part of the user's body (eg, the user's finger). It is possible to identify whether the end portion) is located in the first area (eg, the first radius area 510) or the second area (eg, the second radius area 520). The glasses-type wearable device 100 according to an embodiment of the present document displays thumbnail images corresponding to at least one selected graphic object (eg, the first graphic object 410a and the third graphic object 410c) in a specific area. (Example: When detecting a virtual drop gesture for dropping to a first area (eg, the first radius area 510) or a second area (eg, the second radius area 520), the selected at least one graphic object ( Example: A specific area (eg, a first area (eg, the first radius area 510)) or a second area (eg, a second radius area (eg, the second radius area ( 520)) can be created as one group.

A wearable device (eg, the glass-type wearable device 100) according to an embodiment of the present document includes a display module (eg, the display module 150 of FIG. 1 ) and at least one processor (eg, the processor of FIG. 1 ). (120)), and at least one processor includes at least one graphic object (eg, the first graphic object 410a, the second graphic object 410b, and the third graphic object 410c of FIG. 4) The display module is controlled to be displayed in the display area (eg, the display area 400 of FIG. 4 ), and a part of the user's body is displayed in the first area (eg, the first radius area 510 and/or the first area 510a). ), identify a group corresponding to the first area based on the location of the user's body part in the first area, and identify the user while the user's body part is located in the first area. It may be configured to identify whether a trigger event is detected, and to perform a function corresponding to the trigger event for at least one counterpart device included in the identified group based on the detection of the trigger event.

A method for controlling a wearable device (eg, the glass-type wearable device 100) according to an embodiment of the present document includes at least one graphic object (eg, the first graphic object 410a of FIG. 4 and the second graphic object). (410b) an operation of controlling a display module of the wearable device so that a third graphic object (410c) is displayed in a display area, and an operation of identifying whether a part of the user's body is located in a first area; An operation of identifying a group corresponding to the first area based on a body part of the user being located in the first area, and a trigger event by the user while the user's body part is located in the first area and identifying whether or not the trigger event is detected, and performing a function corresponding to the trigger event for at least one counterpart device included in the identified group based on the detection of the trigger event. can

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numbers may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited. A (e.g., first) component is said to be "coupled" or "connected" to another (e.g., second) component, with or without the terms "functionally" or "communicatively." When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits. can be used as A module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document provide one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, the program 140) including them. For example, a processor (eg, the processor 120 ) of a device (eg, the electronic device 101 ) may call at least one command among one or more instructions stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-temporary" only means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store™) or on two user devices (e.g. It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

According to one embodiment of this document, each component (eg, module or program) of the components described above may include a single object or a plurality of entities, and some of the plurality of entities are separated from other components. It could be. According to an embodiment of the present document, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to one embodiment of this document, operations performed by modules, programs, or other components are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations are executed in a different order, or , may be omitted, or one or more other operations may be added.

Claims (20)

In the wearable device,
a display module; and
including at least one processor, wherein the at least one processor comprises:
Control the display module so that at least one graphic object is displayed in a display area;
identify whether the user's body part is located in the first region;
Identifying a group corresponding to the first region based on the location of the user's body part in the first region;
Identifying whether a trigger event by the user is detected while the user's body part is located in the first region;
Based on the detection of the trigger event, at least one counterpart device included in the identified group is configured to perform a function corresponding to the trigger event;
The wearable device, characterized in that the function is a function commonly performed for the at least one counterpart device. According to claim 1,
The wearable device of claim 1 , wherein the group includes a group previously designated to correspond to the first region. According to claim 1,
The at least one processor is further configured to provide a predetermined visual effect around the at least one graphic object belonging to the same group when it is detected that the user's body part is located in the first region. A wearable device that does. According to claim 1,
The first area is a display area designated in advance in the display area,
The at least one processor is further set to identify whether the user's body part is located in the first area by identifying whether the user's body part is located in the pre-designated display area. device. According to claim 1,
The trigger event includes a gesture by a part of the user's body or a change in facial expression of the user, the wearable device. According to claim 1,
The wearable device further includes a communication circuit configured to be connected to an external electronic device,
The trigger event may include a message transmission signal or a call origination signal received from the external electronic device through the communication module. According to claim 6,
The wearable device, characterized in that the function includes a message transmission function or a call origination function for the at least one counterpart device belonging to the same group. According to claim 1,
The wearable device further includes at least one memory,
The wearable device, characterized in that the at least one processor is further configured to receive a request for sharing the content stored in the at least one memory with the at least one counterpart device belonging to the same group. According to claim 8,
The wearable device of claim 1 , wherein the at least one processor is further configured to transmit the at least one content to the at least one counterpart device belonging to the same group upon reception of a sharing gesture from the user. According to claim 1,
The wearable device of claim 1 , wherein the at least one processor is further configured to determine the at least one graphic object as a group corresponding to the first area according to a group creation gesture from the user. A method for controlling a wearable device,
controlling a display module of the wearable device to display at least one graphic object in a display area;
identifying whether a user's body part is located in a first region;
identifying a group corresponding to the first region based on the location of the user's body part in the first region;
identifying whether or not a trigger event by the user is detected while the user's body part is located in the first region;
Based on the detection of the trigger event, performing a function corresponding to the trigger event for at least one counterpart device included in the identified group;
The method of controlling a wearable device, characterized in that the function is a function commonly performed for the at least one counterpart device. According to claim 11,
The method of controlling a wearable device of claim 1 , wherein the group includes a group previously designated to correspond to the first region. According to claim 11,
The method of controlling the wearable device may further include providing a predetermined visual effect around the at least one graphic object belonging to the same group when it is detected that the user's body part is located in the first region. A method of controlling a wearable device comprising: According to claim 1,
The first area is a display area designated in advance in the display area,
The method of controlling the wearable device further includes an operation of identifying whether the user's body part is located in the first region by identifying whether the user's body part is located within the predetermined display area. Characterized in, a method for controlling a wearable device. According to claim 11,
The trigger event may include a gesture by a part of the user's body or a change in facial expression of the user. According to claim 11,
The wearable device further includes a communication circuit configured to be connected to an external electronic device,
The trigger event may include a message transmission signal or a call origination signal received from the external electronic device through the communication module. According to claim 16,
The method of controlling a wearable device, characterized in that the function includes a message transmission function or a call origination function for the at least one counterpart device belonging to the same group. According to claim 11,
The wearable device further includes at least one memory,
The method of controlling the wearable device may further include receiving a request for sharing the content stored in the at least one memory with the at least one counterpart device belonging to the same group, characterized in that the control of the wearable device further comprises: How to. According to claim 18,
The method of controlling the wearable device further comprises an operation of transmitting the at least one content to the at least one counterpart device belonging to the same group in response to receiving a sharing gesture from the user. How to control your device. According to claim 11,
The method of controlling the wearable device may further include determining the at least one graphic object as a group corresponding to the first region according to a group creation gesture from the user. How to.

Images