[go: up one dir, main page]

WO2017010593A1 - Gesture recognition device - Google Patents

Gesture recognition device Download PDF

Info

Publication number
WO2017010593A1
WO2017010593A1 PCT/KR2015/007407 KR2015007407W WO2017010593A1 WO 2017010593 A1 WO2017010593 A1 WO 2017010593A1 KR 2015007407 W KR2015007407 W KR 2015007407W WO 2017010593 A1 WO2017010593 A1 WO 2017010593A1
Authority
WO
WIPO (PCT)
Prior art keywords
gesture
face
detection unit
motion
gesture detection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2015/007407
Other languages
French (fr)
Korean (ko)
Inventor
์ž„์ฑ„์—ด
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Center for Integrated Smart Sensors Foundation
Original Assignee
Center for Integrated Smart Sensors Foundation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Center for Integrated Smart Sensors Foundation filed Critical Center for Integrated Smart Sensors Foundation
Priority to PCT/KR2015/007407 priority Critical patent/WO2017010593A1/en
Publication of WO2017010593A1 publication Critical patent/WO2017010593A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present invention relates to a gesture recognition device, and more particularly to a gesture recognition device for minimizing power consumption for gesture recognition.
  • the present invention minimizes power consumption by performing a gesture recognition operation only when a user's motion and a face are recognized before the gesture operation, and in a preferred embodiment, when the face is recognized
  • the present invention relates to a gesture recognition apparatus for minimizing the amount of computation for gesture detection by recognizing a gesture only in a certain region (a region of a face or a region having a predetermined size spaced apart from the face region) based on a face position.
  • a gesture recognition device for recognizing a gesture of an object to be operated by an operator is combined with a display device such as a television receiver, a personal computer, or a tablet terminal.
  • a display device such as a television receiver, a personal computer, or a tablet terminal.
  • the operator does not need to wear special jewelry such as a data glove, and the operator can use his or her hand or fingers to perform the operation on the display device smoothly and smoothly.
  • a gesture recognizing apparatus for recognizing a gesture to be performed.
  • gesture recognition using the Hidden Markov Model (HMM), continuous dynamic programming (DP), or the like is performed in the gesture recognition apparatus.
  • Such systems may perform a gesture recognition operation while maintaining a power-on state to recognize a gesture at all times. Therefore, even if there is no gesture input, the system performs a gesture recognition operation so that unnecessary power is excessively consumed.
  • the present invention has been made to solve the above problems, it is possible to minimize the total amount of power consumed for gesture detection by detecting whether the user's gesture detection with low power, and the gesture detection module only when necessary to detect the gesture.
  • Another object of the present invention is to provide a gesture recognition device.
  • the present invention provides a gesture recognition device that minimizes the amount of calculation for gesture detection / recognition by setting the area for detecting the gesture to a part of the image area instead of the entire image area, thereby reducing the amount of power consumed for gesture recognition. To provide.
  • a gesture detection device including a motion detector, a face detector, a gesture detector, and a result output unit may detect a user's motion (motion) and, upon detecting a motion, first wake up to the face detector.
  • a motion detector for transmitting a wake up signal;
  • the device When the first wake-up signal is received from the motion detection unit, the device operates in the second state for a predetermined time, detects a user's face, returns to the first state, and detects a face to the gesture detection unit.
  • a face detector for transmitting a second wake-up signal; When the second wake-up signal is received from the face detection unit, the device operates in the second state for a predetermined time, detects the user's gesture, returns to the first state, and detects the gesture.
  • a gesture detector for outputting a corresponding operation signal; And a result output unit configured to perform an operation corresponding to the operation signal received from the gesture detector.
  • the first state may be an operating state that consumes less power than the second state.
  • the first state may be a power off state or a sleep state.
  • the face detection unit may determine that the user's face is detected only when the detected user's face direction is within a predetermined angle based on the face detection unit.
  • the face detector may determine that the user's face is detected only when the detected user's face size is greater than or equal to the first threshold and less than or equal to the second threshold.
  • the face detector when detecting a user's face, selects the detected face as a gesture detection target and additionally transmits the location information to the gesture detector, and the gesture detector detects a gesture detected by the face detector.
  • the gesture detection area of the user may be set based on the location information to perform gesture detection only on the gesture detection area.
  • the face detection unit selects one of the faces as a gesture detection target, and additionally transmits the location information to the gesture detection unit, and the gesture detection unit provides a gesture provided from the face detection unit.
  • a gesture detection area of a user may be set based on location information on a detection target to perform gesture detection only on the gesture detection area.
  • the face detector may select a face closest to the motion information detected by the motion detector as a gesture detection target.
  • the face detector may select a face that overlaps all or a part of the motion information detected by the motion detector as a gesture detection target.
  • the gesture detection unit may set an area within a predetermined range as a gesture detection area based on the position of the gesture detection target.
  • the gesture detecting unit may set a region having a predetermined size spaced apart from the position of the gesture sensing target as a gesture sensing region.
  • the gesture detector may detect a shape and a movement direction of a user's gesture and output an operation signal corresponding thereto.
  • Such a gesture detecting apparatus may further include an alarm unit configured to provide alarm information for a predetermined time when the gesture detecting unit detects a user's gesture when detecting a face through the face detecting unit.
  • a gesture detection device including a motion detector, a face / gesture detector, and a result output unit detects a user's motion (motion) and wakes up to the face / gesture detector when motion is detected. up) a motion detector for transmitting a signal; When the wake-up signal is received from the motion detection unit, the device operates in the second state for a predetermined time, detects a user's face, and detects a user's gesture for a predetermined time.
  • a face / gesture detection unit that outputs a corresponding operation signal and returns to a first state when a user's face is not detected or a gesture is not detected for a predetermined time; And a result output unit configured to perform an operation corresponding to the operation signal received from the face / gesture detector.
  • the first state may be an operating state that consumes less power than the second state.
  • the face / gesture detector may include: a face detector configured to detect a user's face for a predetermined time and select the detected face as a gesture detection target when receiving a wake-up signal from the motion detector; And a gesture detection unit configured to receive information on the selected gesture detection target from the face detection unit, set a user's gesture detection region based on the information on the gesture detection target, and perform gesture detection only on the gesture detection region. It can include;
  • the gesture detection unit may set an area within a predetermined range as a gesture detection area based on the position of the gesture detection target.
  • a gesture detection device including a motion / face detection unit, a gesture detection unit, and a result output unit detects a user's motion (motion), detects a user's face when detecting a motion, and detects a face.
  • a motion / face detector configured to transfer a wake up signal to the gesture detector; Operating in the first state When receiving the wake-up signal from the motion / face detection unit, the device operates in the second state for a predetermined time, detects the user's gesture and returns to the first state, and detects the gesture when the gesture is detected.
  • a gesture detector for outputting a corresponding operation signal; And a result output unit configured to perform an operation corresponding to the operation signal received from the gesture detector.
  • the first state may be an operating state that consumes less power than the second state.
  • the motion / face detection unit selects a face detected when a user's face is detected as a gesture detection target, additionally transmits position information on the gesture detection target to the gesture detection unit, and the gesture detection unit detects the motion / face detection.
  • a gesture detection unit configured to set a user's gesture detection area based on the location information of the gesture detection target received from the unit, and perform gesture detection only on the gesture detection area.
  • the gesture detection unit may set an area within a predetermined range as a gesture detection area based on the position of the gesture detection target.
  • the gesture recognition apparatus detects the user's movement and face to determine whether the gesture input preparation is completed, and operates the gesture recognition module only when the gesture input preparation is completed, thereby reducing the total power consumption and the amount of calculation. It is effective to let.
  • the motion detection operation of the human being can be driven with low power, it is possible to detect a human motion (and face) at low power and determine whether to perform a gesture recognition operation that requires a relatively large amount of power. There is an effect that can be reduced.
  • a gesture can be detected (detected) by using only some image information instead of all image information. This has the effect of minimizing the amount of computation for gesture detection.
  • FIG. 1 is a view showing a gesture recognition device according to a first example of the present invention
  • FIG. 2 illustrates an example of determining that a face of a user is detected according to the present invention
  • FIG. 3 is a view illustrating an example of selecting one of the faces as a gesture detection target when detecting a plurality of faces according to the present invention
  • FIG. 5 illustrates an example of recognizing a gesture on an area spaced a predetermined distance from a detected face area according to the present invention
  • FIG. 6 is a view showing an example of the shape of the gesture detected in accordance with the present invention.
  • FIG. 7 is a view showing a gesture recognition device according to a second example of the present invention.
  • FIG. 8 is a diagram illustrating a gesture recognizing apparatus according to a third example of the present invention.
  • first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.
  • FIG. 1 is a diagram illustrating a gesture recognizing apparatus according to a first example of the present invention.
  • the gesture recognition apparatus may include a motion (motion) detecting unit 10, a face detecting unit 20, a gesture detecting unit 30, and a result output unit 40. Include. Hereinafter, each component will be described in detail.
  • the motion detector 10 detects a user's motion (motion).
  • a human body sensor or an image sensor may be applied to the motion detector 10.
  • the human body detection sensor information about the human body is acquired at regular intervals through an infrared passive method (PIR), near infrared active method, ultrasonic waves, microwaves, and the like, and when it is determined that the difference between the acquired information is more than a predetermined level, It may be determined that the motion of the motion is detected.
  • PIR infrared passive method
  • NIR near infrared active method
  • ultrasonic waves ultrasonic waves
  • microwaves microwaves
  • CMOS complementary MOS
  • CCD charge-coupled device
  • IR image sensor IR image sensor
  • the image sensor may detect whether there is a motion (motion) of the user based on a difference value or a matching result of the image information acquired at a predetermined interval.
  • the motion detection unit 10 When the motion detection unit 10 detects a motion through the various methods as described above, the motion detection unit 10 transmits a wake up signal to the separate face detection unit 20.
  • the face detector 20 normally operates in a first state.
  • the face detector 20 receives a wake up signal from the motion detector 10, the face detector 20 operates in a second state for a predetermined time and detects a user's face.
  • the face detecting unit 20 detects the user's face in a certain region for a predetermined time, and then returns to the first state.
  • a sleep state, a power off state, or the like may be applied to the first state, and a normal operating state may be applied to the second state.
  • the first state may mean an operating state that consumes a smaller amount of power than the second state.
  • the power off state means that power to all components is turned off.
  • the sleep state controls only some components to operate and the other components are turned off to consume the entire power. It means a state that minimizes the amount of power.
  • the wake-up signal is received, power is supplied to all components to control all components to operate.
  • the face detector 20 may operate in a sleep state that cuts off power to other components in addition to the configuration of receiving a wake-up signal from the motion detector 10 as a first state. have. Subsequently, upon receiving the wake-up signal from the motion detection unit 10, power is supplied to other components (a module for detecting a user's face, etc.) to perform a user's face detection operation as a second state. do.
  • the face detector 20 all the components capable of detecting the shape of a human face may be applied.
  • a human body sensor and an image sensor may be applied.
  • the face detector 20 may determine that the user's face is detected only in the following cases.
  • the user's face is at an angle within
  • FIG. 2 is a diagram illustrating an example of determining that a face of a user is detected according to the present invention.
  • the face detector 20 may determine that the face of the user is detected only when the face of which the face of the user faces the front is detected. More specifically, the face detector 20 may determine that the face of the user is detected only when the detected direction of the face of the user is within a predetermined angle with respect to the face detector 20.
  • various face detection algorithms can be applied. For example, this may be implemented by learning a matching template for face recognition through a forward image.
  • the user's face may be detected by detecting the direction of the user's face based on the shape information of the face.
  • the face detecting unit 20 detects the overall direction of the face to determine whether the face is detected, calculates the position of the gaze in the image information, and calculates the gaze direction based on the overall calculation amount and This has the effect of reducing the amount of power consumed.
  • the face detector 20 may detect only a face of a user located within a certain distance.
  • the distance between the user and the face detector 20 may be measured by using a separate sensor, and the face detector 20 may be configured to perform a detection operation only when the distance value is within a predetermined range. .
  • the distance between the user and the face detection unit 20 is measured based on the face information detected by the face detection unit 20, and the face detection operation of the user is performed only when the distance value is within a predetermined range. You can do it.
  • the face detecting unit 20 may control to detect (detect) the user's face only when the number of pixels of the face according to the resolution is counted.
  • the face detector 20 may detect only a face of a user located within a predetermined range. In other words, the face detector 20 may detect only a face of a user spaced apart from the face detector by a minimum A distance or more and a maximum B distance or less.
  • the face detector 20 may determine that the user's face is detected only when the detected user's face size is greater than or equal to the first threshold and less than or equal to the second threshold. To this end, the face detector 20 may count the number of pixels of the face according to the resolution to control (detect) the user's face only when the number of pixels is within a predetermined number range.
  • the face detecting unit 20 provides the gesture detecting unit 30 with the position information on the detected face.
  • the gesture detection unit 30 may receive the gesture detection unit 30 and set the gesture detection area based on the position information. Through this, the gesture detector 30 may reduce the amount of calculation for detecting the gesture.
  • the gesture detector 30 will be described in detail with reference to the related description.
  • the face detector 20 may select the detected face as a gesture detection target and provide location information thereof to the gesture detector 30.
  • the face detector 20 may select one of the faces as a gesture detection target according to a predetermined rule and provide location information thereof to the gesture detector 30. have.
  • FIG. 3 is a diagram illustrating an example of selecting one of the faces as a gesture detection target when detecting a plurality of faces according to the present invention.
  • the face detector 20 may select a face closest to the motion information detected by the motion detector 10 as a gesture detection target. have.
  • the face detector 20 may select the face information closest to the specific direction as the gesture detection target based on the detected motion information.
  • 3 illustrates an example of selecting the face information located closest in the upward direction of the detected motion as a gesture detection target, but the face detection unit 20 according to the present invention is not limited to the above embodiment.
  • the face detector 20 may select a face that overlaps all or a part of the motion information detected by the motion detector 10 as a gesture detection target. In other words, when the detected motion information is detected on a specific face, the face detector 20 may select a corresponding face as a gesture detection target and provide the position information to the gesture detector 30.
  • the face detection unit 20 may select a gesture detection target, and the gesture detection unit 30 provided with the information may perform a gesture detection operation based on the information on the detection target. can do.
  • the gesture detector 30 normally operates in a first state.
  • the gesture detector 30 receives a wake up signal from the face detector 20, the gesture detector 30 operates in a second state for a predetermined time and detects a user's gesture. At this time, the gesture detector 30 detects the user's gesture with respect to the predetermined area for a predetermined time, and then returns to the first state.
  • a sleep state, a power off state, or the like may be applied to the first state, and a normal operating state may be applied to the second state.
  • the first state may mean an operating state that consumes a smaller amount of power than the second state.
  • the gesture detector 30 may operate in a sleep state that cuts off power to other components in addition to the configuration of receiving a wake-up signal from the face detector 20. Subsequently, when the wake-up signal is received from the face detector 20, the user's gesture detection may be performed by supplying power to other components (such as a module for detecting the user's gesture) to operate.
  • all the components capable of detecting the gesture of the user's hand may be applied to the gesture detecting unit 30.
  • a vision sensor may be applied to more accurately detect (detect) the user's gesture.
  • the gesture detecting unit 30 when the gesture detecting unit 30 receives the (location) information on the gesture detecting object from the face detecting unit 20, the gesture detecting unit 30 sets the gesture detecting region based on the information.
  • the gesture detection operation is performed only in the gesture detection area. That is, the gesture detector 30 may perform a gesture detection (detection) operation on only some of the regions without performing a gesture detection operation on all image information obtained to reduce the amount of computation and power consumption.
  • FIG. 4 illustrates an example of recognizing a gesture on a detected face area according to the present invention.
  • the gesture detector 30 may detect a gesture input on an area on a face selected as a gesture detection target. To this end, the gesture detection unit 30 may set an area within a predetermined range as a gesture detection area based on the position of the gesture detection target.
  • FIG. 5 is a diagram illustrating an example of recognizing a gesture on an area spaced a predetermined distance from a detected face area according to the present invention.
  • the gesture detector 30 may set a region having a predetermined size spaced apart from a position of the gesture sensing object as a gesture sensing region.
  • FIG. 5 illustrates an example in which a region spaced a predetermined distance downward in the downward direction based on the position of the gesture sensing object (face) is set as the gesture sensing region, but the present invention is not limited to the above embodiment.
  • the gesture detection unit 30 may optimize the amount of calculation required to calculate the gesture by setting the gesture detection area through various methods as described above and performing the gesture detection operation only in the area. Subsequently, when a gesture is detected, an operation signal corresponding to the detected gesture is output to the result output unit 40.
  • the gesture detector 30 may detect a shape and a movement direction of a user's gesture and output an operation signal corresponding thereto.
  • the gesture detector 30 may detect the shapes of various gestures shown in FIG. 6 through image analysis.
  • the gesture detection unit 30 may also detect a detected gesture direction of movement.
  • a moving direction of a hand may be detected using difference information between image data acquired at predetermined time intervals.
  • the motion direction of a hand may be detected by obtaining a block motion to obtain a motion vector of an individual block, and then calculating an average of all motion vectors.
  • the direction of the movement can be tracked by obtaining the optical flow and detecting which direction the optical flow is moving as a whole.
  • the present invention is not limited to the above embodiment, and other motion sensing methods may also be applied.
  • the result output unit 40 performs an operation corresponding to the operation signal received from the gesture detection unit 30.
  • the gesture detection unit 30 stores table information on the corresponding motion signal for each shape and movement direction of the detected gesture.
  • the gesture detection unit 30 uses the table information.
  • the signal may be provided to the result output unit 40.
  • the A gesture is set to change a channel of the TV (increase or decrease channel number)
  • the B gesture is to adjust the volume of the TV (increase or decrease volume)
  • the C gesture is set to correspond to the power on / off control operation of the TV. do.
  • the gesture detector 30 if the user's B gesture is detected by the gesture detector 30, the gesture detector 30 provides an operation signal for volume control (volume increase or decrease) to the result output unit 40. can do. As a result, the result output unit 40 may perform a corresponding operation.
  • the gesture sensing device may further include an alarm unit (not shown).
  • the alarm unit (not shown) allows the user to detect the user's gesture by the gesture detecting unit 30. You can provide an alarm message that you are ready to do so.
  • the alarm unit may provide information that the gesture detection unit 30 is ready to detect a gesture by providing alarm information for a predetermined time for detecting the user's gesture.
  • the gesture recognizing apparatus may include a motion detector 10, a face detector 20, and a gesture detector 30, each of which is distinguished.
  • the face detector 20 the gesture detector 30 normally operate in a first state (sleep state or power off state).
  • the gesture detection unit 30 operates in a second state for a while. Can return to the 1 state.
  • the user may determine whether the user prepares to input a gesture through the low-power motion detector 10, and when the user is ready, wakes up the face detector 20 and the gesture detector 30. Has the effect of being able to be driven with low power as a whole by performing the gesture sensing operation.
  • the amount of computation required for the gesture detection may be reduced.
  • the face detector 20 and the gesture detector 30 may operate as one component, and in another embodiment, the motion detector 10 and the face detector 20. Can operate as one component.
  • FIG. 7 is a diagram illustrating a gesture recognizing apparatus according to a second example of the present invention.
  • the face detector 20 and the gesture detector 30 of the first example may be integrated and operate as one component.
  • the PIR sensor may be applied to the motion detector 110, and the image sensor may be applied to the face / gesture detector 125.
  • the face / gesture detection unit 125 may be woken up only when a motion is detected, and thus may be implemented at low power.
  • FIG. 8 is a diagram illustrating a gesture recognizing apparatus according to a third example of the present invention.
  • the motion detector 10 and the face detector 20 of the first example may be integrated and operate as one component.
  • the PIR sensor may be applied to the motion / face detector 215 and the image sensor may be applied to the gesture detector 230.
  • the motion / face detection operation is performed by using the PIR sensor which can be driven at a low power, and can be realized at low power as a whole by waking up the gesture detector 230 only when a face is detected.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention relates to a gesture recognition device for minimizing power consumption for gesture recognition. More specifically, the present invention relates to a gesture recognition device for minimizing a power consumption amount by performing a gesture recognition operation only when a motion and the face of a user are recognized, and minimizing a computation amount for gesture detection by recognizing the gesture only for a predetermined region (a facial area or a predetermined-sized region formed to be spaced apart at a predetermined distance from the facial area) on the basis of a recognized face position when the face is recognized.

Description

์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜Gesture recognition device

๋ณธ ๋ฐœ๋ช…์€ ์ œ์Šค์ณ(gesture) ์ธ์‹ ์žฅ์น˜์— ๊ด€ํ•œ ๊ฒƒ์œผ๋กœ, ์ œ์Šค์ณ ์ธ์‹์„ ์œ„ํ•œ ์ „๋ ฅ ์†Œ๋ชจ๋ฅผ ์ตœ์†Œํ™”ํ•˜๋Š” ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜์— ๊ด€ํ•œ ๊ฒƒ์ด๋‹ค.The present invention relates to a gesture recognition device, and more particularly to a gesture recognition device for minimizing power consumption for gesture recognition.

๋ณด๋‹ค ๊ตฌ์ฒด์ ์œผ๋กœ, ๋ณธ ๋ฐœ๋ช…์€ ์ œ์Šค์ณ ๋™์ž‘ ์ „ ์‚ฌ์šฉ์ž์˜ ์›€์ง์ž„(motion) ๋ฐ ์–ผ๊ตด(face)์ด ์ธ์‹๋œ ๊ฒฝ์šฐ์—๋งŒ ์ œ์Šค์ณ(gesture) ์ธ์‹ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•จ์œผ๋กœ์จ ์ „๋ ฅ ์†Œ๋ชจ๋Ÿ‰์„ ์ตœ์†Œํ™”ํ•˜๊ณ , ๋ฐ”๋žŒ์งํ•œ ์˜ˆ๋กœ ์–ผ๊ตด์ด ์ธ์‹๋œ ๊ฒฝ์šฐ ์ธ์‹๋œ ์–ผ๊ตด ์œ„์น˜๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์ผ์ • ์˜์—ญ(์–ผ๊ตด ์˜์—ญ ๋˜๋Š” ์–ผ๊ตด ์˜์—ญ๊ณผ ์ผ์ • ๊ฑฐ๋ฆฌ ์ด๊ฒฉ๋˜์–ด ํ˜•์„ฑ๋œ ์ผ์ • ํฌ๊ธฐ์˜ ์˜์—ญ)์— ๋Œ€ํ•ด์„œ๋งŒ ์ œ์Šค์ณ๋ฅผ ์ธ์‹ํ•จ์œผ๋กœ์จ ์ œ์Šค์ณ ๊ฒ€์ถœ์„ ์œ„ํ•œ ์—ฐ์‚ฐ๋Ÿ‰์„ ์ตœ์†Œํ™”ํ•˜๋Š” ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜์— ๊ด€ํ•œ ๊ฒƒ์ด๋‹ค.More specifically, the present invention minimizes power consumption by performing a gesture recognition operation only when a user's motion and a face are recognized before the gesture operation, and in a preferred embodiment, when the face is recognized The present invention relates to a gesture recognition apparatus for minimizing the amount of computation for gesture detection by recognizing a gesture only in a certain region (a region of a face or a region having a predetermined size spaced apart from the face region) based on a face position.

ํ…”๋ ˆ๋น„์ „ ์ˆ˜์ƒ๊ธฐ, ํผ์Šค๋„ ์ปดํ“จํ„ฐ, ๋˜๋Š” ํƒœ๋ธ”๋ฆฟ ๋‹จ๋ง ๋“ฑ์˜ ํ‘œ์‹œ ์žฅ์น˜์—, ์กฐ์ž‘์ž๊ฐ€ ๋™์ž‘์‹œํ‚ค๋Š” ์ธ์‹ ๋Œ€์ƒ๋ฌผ์˜ ์ œ์Šค์ณ๋ฅผ ์ธ์‹ํ•˜๋Š” ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋ฅผ ์กฐํ•ฉ์‹œํ‚จ ํ‘œ์‹œ ๊ธฐ๊ธฐ๊ฐ€ ๋“ฑ์žฅํ•˜๊ณ  ์žˆ๋‹ค. ์ด์™€ ๊ฐ™์€ ํ‘œ์‹œ ๊ธฐ๊ธฐ์—์„œ, ์กฐ์ž‘์ž๊ฐ€ ๋ฐ์ดํ„ฐ ๊ธ€๋กœ๋ธŒ ๋“ฑ์˜ ํŠน์ˆ˜ํ•œ ์žฅ์‹ ๊ตฌ๋ฅผ ์žฅ์ฐฉํ•  ํ•„์š”๊ฐ€ ์—†๊ณ , ๋˜ํ•œ ์กฐ์ž‘์ž๊ฐ€ ์ž์—ฐ์Šค๋Ÿฝ๊ณ  ์Šค๋ฌด์Šคํ•˜๊ฒŒ ์ž์‹ ์˜ ์กฐ์ž‘์„ ๋‹นํ•ด ํ‘œ์‹œ ๊ธฐ๊ธฐ์— ๋Œ€ํ•ด ํ–‰ํ•  ์ˆ˜ ์žˆ๋„๋ก, ์กฐ์ž‘์ž์˜ ์†์ด๋‚˜ ์†๊ฐ€๋ฝ ๋“ฑ์„ ์ด์šฉํ•˜์—ฌ ํ–‰ํ•˜๋Š” ์ œ์Šค์ณ๋ฅผ ์ธ์‹ํ•˜๋Š” ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๊ฐ€ ์š”๋ง๋˜๊ณ  ์žˆ๋‹ค. ๋˜ํ•œ, ์ตœ๊ทผ์˜ ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜์—์„œ๋Š”, HMM(Hidden Markov Model ; ์€๋‹‰ ๋งˆ๋ฅด์ฝ”๋ธŒ ๋ชจ๋ธ) ๋˜๋Š” ์—ฐ์† DP(Continuous Dynamic Programming) ๋“ฑ์„ ์ด์šฉํ•œ ์ œ์Šค์ณ ์ธ์‹์ด ํ–‰ํ•˜์—ฌ์ง€๊ณ  ์žˆ๋‹ค.BACKGROUND ART Display apparatuses in which a gesture recognition device for recognizing a gesture of an object to be operated by an operator is combined with a display device such as a television receiver, a personal computer, or a tablet terminal. In such a display device, the operator does not need to wear special jewelry such as a data glove, and the operator can use his or her hand or fingers to perform the operation on the display device smoothly and smoothly. There is a demand for a gesture recognizing apparatus for recognizing a gesture to be performed. In recent years, gesture recognition using the Hidden Markov Model (HMM), continuous dynamic programming (DP), or the like is performed in the gesture recognition apparatus.

์ด์™€ ๊ฐ™์€ ์‹œ์Šคํ…œ๋“ค์€ ํ•ญ์‹œ ์ œ์Šค์ณ๋ฅผ ์ธ์‹ํ•  ์ˆ˜ ์žˆ๋„๋ก ์ „๋ ฅ ์˜จ(ON) ์ƒํƒœ๋ฅผ ์œ ์ง€ํ•˜๋ฉฐ ์ œ์Šค์ณ ์ธ์‹ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•˜๊ฒŒ ๋œ๋‹ค. ๋”ฐ๋ผ์„œ ์ƒ๊ธฐ ์‹œ์Šคํ…œ์€ ์ œ์Šค์ณ ์ž…๋ ฅ์ด ์—†๋Š” ๊ฒฝ์šฐ์—๋„ ์ œ์Šค์ณ ์ธ์‹ ๋™์ž‘์ด ์ˆ˜ํ–‰๋˜์–ด ๋ถˆํ•„์š”ํ•œ ์ „๋ ฅ์ด ๊ณผ๋„ํ•˜๊ฒŒ ์†Œ๋ชจ๋˜๋Š” ๋ฌธ์ œ์ ์ด ์žˆ์—ˆ๋‹ค.Such systems may perform a gesture recognition operation while maintaining a power-on state to recognize a gesture at all times. Therefore, even if there is no gesture input, the system performs a gesture recognition operation so that unnecessary power is excessively consumed.

์ด์™€ ๊ฐ™์€ ๋ฌธ์ œ์ ์„ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•ด ์‚ฌ์šฉ์ž๊ฐ€ ์ง์ ‘ ์Šค์œ„์น˜๋ฅผ ์ž…๋ ฅํ•˜์—ฌ ์˜จ/์˜คํ”„ ์ƒํƒœ๋ฅผ ์ œ์–ดํ•˜๊ณ  ์˜จ ์ƒํƒœ์ธ ๊ฒฝ์šฐ์—๋งŒ ์ œ์Šค์ณ ์ธ์‹ ๋™์ž‘์„ ์ˆ˜ํ–‰์ผ€ ํ•จ์œผ๋กœ์จ ์ „๋ ฅ ์†Œ๋ชจ๋Ÿ‰์„ ๊ฐ์†Œ์‹œํ‚ค๋Š” ๊ธฐ์ˆ ์ด ๊ฐœ๋ฐœ๋˜์—ˆ๋‹ค. ๋‹ค๋งŒ, ์ƒ๊ธฐ ๊ธฐ์ˆ ์€ ์‚ฌ์šฉ์ž๊ฐ€ ๋ณ„๋„๋กœ ํ•ด๋‹น ์žฅ์น˜์˜ ์˜จ/์˜คํ”„ ์ƒํƒœ๋ฅผ ์ œ์–ดํ•˜๊ธฐ ์œ„ํ•ด ์ง์ ‘ ์žฅ์น˜๋ฅผ ์กฐ์ž‘ํ•ด์•ผ ํ•˜๋Š” ๋ฒˆ๊ฑฐ๋กœ์›€์ด ์žˆ์—ˆ๋‹ค.In order to solve this problem, a technology for reducing power consumption has been developed by allowing a user to directly input a switch to control an on / off state and perform a gesture recognition operation only in an on state. However, the above technology has been cumbersome for the user to directly manipulate the device in order to separately control the on / off state of the device.

๋ณธ ๋ฐœ๋ช…์€ ์ƒ๊ธฐ์™€ ๊ฐ™์€ ๋ฌธ์ œ์ ์„ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•ด ์•ˆ์ถœ๋œ ๊ฒƒ์œผ๋กœ, ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ ๊ฐ์ง€ ์—ฌ๋ถ€๋ฅผ ์ €์ „๋ ฅ์œผ๋กœ ๊ฐ์ง€ํ•˜๊ณ , ํ•„์š”์‹œ์—๋งŒ ์ œ์Šค์ณ ๊ฐ์ง€ ๋ชจ๋“ˆ์„ ์ž‘๋™์‹œ์ผœ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•จ์œผ๋กœ์จ ์ œ์Šค์ณ ๊ฐ์ง€๋ฅผ ์œ„ํ•ด ์†Œ๋ชจ๋˜๋Š” ์ด ์ „๋ ฅ๋Ÿ‰์„ ์ตœ์†Œํ™”ํ•  ์ˆ˜ ์žˆ๋Š” ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋ฅผ ์ œ๊ณตํ•˜๊ณ ์ž ํ•œ๋‹ค. The present invention has been made to solve the above problems, it is possible to minimize the total amount of power consumed for gesture detection by detecting whether the user's gesture detection with low power, and the gesture detection module only when necessary to detect the gesture. Another object of the present invention is to provide a gesture recognition device.

๋˜ํ•œ, ๋ณธ ๋ฐœ๋ช…์€ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•˜๋Š” ์˜์—ญ์„ ์ „์ฒด ์ด๋ฏธ์ง€ ์˜์—ญ์ด ์•„๋‹Œ ์ผ๋ถ€ ์ด๋ฏธ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•จ์œผ๋กœ์จ ์ œ์Šค์ณ ๊ฐ์ง€/์ธ์‹์„ ์œ„ํ•œ ์—ฐ์‚ฐ๋Ÿ‰์„ ์ตœ์†Œํ™”ํ•˜๊ณ , ์ด๋ฅผ ํ†ตํ•ด ์ œ์Šค์ณ ์ธ์‹์— ์†Œ๋ชจ๋˜๋Š” ์ „๋ ฅ๋Ÿ‰ ๋˜ํ•œ ๊ฐ์†Œ์‹œํ‚ฌ ์ˆ˜ ์žˆ๋Š” ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋ฅผ ์ œ๊ณตํ•˜๊ณ ์ž ํ•œ๋‹ค. In addition, the present invention provides a gesture recognition device that minimizes the amount of calculation for gesture detection / recognition by setting the area for detecting the gesture to a part of the image area instead of the entire image area, thereby reducing the amount of power consumed for gesture recognition. To provide.

๋ณธ ๋ฐœ๋ช…์˜ ์ผ ์ธก๋ฉด์— ๋”ฐ๋ผ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€, ์–ผ๊ตด ๊ฐ์ง€๋ถ€, ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€ ๋ฐ ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€๋ฅผ ํฌํ•จํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜๋Š”, ์‚ฌ์šฉ์ž์˜ ์›€์ง์ž„(๋ชจ์…˜)์„ ๊ฐ์ง€ํ•˜๊ณ , ์›€์ง์ž„ ๊ฐ์ง€์‹œ ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ ์ œ1 ์›จ์ดํฌ์—…(wake up) ์‹ ํ˜ธ๋ฅผ ์ „๋‹ฌํ•˜๋Š” ์›€์ง์ž„ ๊ฐ์ง€๋ถ€; ์ œ1 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋‹ค ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ œ1 ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ œ2 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋ฉฐ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•˜๊ณ  ๋‹ค์‹œ ์ œ1 ์ƒํƒœ๋กœ ๋ณต๊ท€ํ•˜๊ณ , ์–ผ๊ตด ๊ฐ์ง€์‹œ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์ œ2 ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ „๋‹ฌํ•˜๋Š” ์–ผ๊ตด ๊ฐ์ง€๋ถ€; ์ œ1 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋‹ค ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ œ2 ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ œ2 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋ฉฐ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•˜๊ณ  ๋‹ค์‹œ ์ œ1 ์ƒํƒœ๋กœ ๋ณต๊ท€ํ•˜๊ณ , ์ œ์Šค์ณ ๊ฐ์ง€์‹œ ๊ฐ์ง€๋œ ์ œ์Šค์ณ์— ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ์ถœ๋ ฅํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€; ๋ฐ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ˆ˜์‹ ๋œ ๋™์ž‘ ์‹ ํ˜ธ์— ๋Œ€์‘ํ•œ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•˜๋Š” ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€;๋ฅผ ํฌํ•จํ•œ๋‹ค.According to an aspect of the present invention, a gesture detection device including a motion detector, a face detector, a gesture detector, and a result output unit may detect a user's motion (motion) and, upon detecting a motion, first wake up to the face detector. a motion detector for transmitting a wake up signal; When the first wake-up signal is received from the motion detection unit, the device operates in the second state for a predetermined time, detects a user's face, returns to the first state, and detects a face to the gesture detection unit. A face detector for transmitting a second wake-up signal; When the second wake-up signal is received from the face detection unit, the device operates in the second state for a predetermined time, detects the user's gesture, returns to the first state, and detects the gesture. A gesture detector for outputting a corresponding operation signal; And a result output unit configured to perform an operation corresponding to the operation signal received from the gesture detector.

์ด๋•Œ, ์ƒ๊ธฐ ์ œ1 ์ƒํƒœ๋Š” ์ œ2 ์ƒํƒœ์— ๋น„ํ•ด ์ ์€ ๋Ÿ‰์˜ ์ „๋ ฅ์„ ์†Œ๋ชจํ•˜๋Š” ๋™์ž‘ ์ƒํƒœ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค.In this case, the first state may be an operating state that consumes less power than the second state.

๋ฐ”๋žŒ์งํ•˜๊ฒŒ๋Š”, ์ƒ๊ธฐ ์ œ1 ์ƒํƒœ๋Š” ํŒŒ์›Œ ์˜คํ”„(Power Off) ์ƒํƒœ ๋˜๋Š” ์Šฌ๋ฆฝ(sleep) ์ƒํƒœ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค.Preferably, the first state may be a power off state or a sleep state.

์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”, ๊ฐ์ง€๋œ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ๋ฐฉํ–ฅ์ด ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์ผ์ • ๊ฐ๋„ ์ด๋‚ด์ธ ๊ฒฝ์šฐ์—๋งŒ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒƒ์œผ๋กœ ํŒ๋‹จํ•  ์ˆ˜ ์žˆ๋‹ค.The face detection unit may determine that the user's face is detected only when the detected user's face direction is within a predetermined angle based on the face detection unit.

๋˜ํ•œ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”, ๊ฐ์ง€๋œ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ํฌ๊ธฐ๊ฐ€ ์ œ1 ๋ฌธํ„ฑ๊ฐ’ ์ด์ƒ์ด๋ฉฐ ์ œ2 ๋ฌธํ„ฑ๊ฐ’ ์ดํ•˜์ธ ๊ฒฝ์šฐ์—๋งŒ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒƒ์œผ๋กœ ํŒ๋‹จํ•  ์ˆ˜ ์žˆ๋‹ค.In addition, the face detector may determine that the user's face is detected only when the detected user's face size is greater than or equal to the first threshold and less than or equal to the second threshold.

์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”, ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ, ๊ฐ์ง€๋œ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜์—ฌ ์ด์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด๋ฅผ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์ถ”๊ฐ€์ ์œผ๋กœ ์ „๋‹ฌํ•˜๊ณ , ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ œ๊ณต๋œ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์„ค์ •ํ•˜์—ฌ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์— ๋Œ€ํ•ด์„œ๋งŒ ์ œ์Šค์ณ ๊ฐ์ง€๋ฅผ ์ˆ˜ํ–‰ํ•  ์ˆ˜ ์žˆ๋‹ค.The face detector, when detecting a user's face, selects the detected face as a gesture detection target and additionally transmits the location information to the gesture detector, and the gesture detector detects a gesture detected by the face detector. The gesture detection area of the user may be set based on the location information to perform gesture detection only on the gesture detection area.

ํŠนํžˆ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”, ๋ณต์ˆ˜ ๊ฐœ์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ, ์ด์ค‘ ์–ด๋Š ํ•˜๋‚˜์˜ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜์—ฌ ์ด์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด๋ฅผ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์ถ”๊ฐ€์ ์œผ๋กœ ์ „๋‹ฌํ•˜๊ณ , ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ œ๊ณต๋œ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์„ค์ •ํ•˜์—ฌ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์— ๋Œ€ํ•ด์„œ๋งŒ ์ œ์Šค์ณ ๊ฐ์ง€๋ฅผ ์ˆ˜ํ–‰ํ•  ์ˆ˜ ์žˆ๋‹ค.In particular, when detecting a plurality of faces, the face detection unit selects one of the faces as a gesture detection target, and additionally transmits the location information to the gesture detection unit, and the gesture detection unit provides a gesture provided from the face detection unit. A gesture detection area of a user may be set based on location information on a detection target to perform gesture detection only on the gesture detection area.

์ผ ์˜ˆ๋กœ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”, ๋ณต์ˆ˜ ๊ฐœ์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ, ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€๋ฅผ ํ†ตํ•ด ๊ฐ์ง€๋œ ์›€์ง์ž„ ์ •๋ณด์— ๊ฐ€์žฅ ๊ฐ€๊นŒ์šด ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•  ์ˆ˜ ์žˆ๋‹ค.For example, when detecting a plurality of faces, the face detector may select a face closest to the motion information detected by the motion detector as a gesture detection target.

๋‹ค๋ฅธ ์˜ˆ๋กœ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”, ๋ณต์ˆ˜ ๊ฐœ์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ, ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€๋ฅผ ํ†ตํ•ด ๊ฐ์ง€๋œ ์›€์ง์ž„ ์ •๋ณด์™€ ์ „๋ถ€ ๋˜๋Š” ์ผ๋ถ€๊ฐ€ ์ค‘์ฒฉ๋˜๋Š” ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•  ์ˆ˜ ์žˆ๋‹ค.As another example, when detecting a plurality of faces, the face detector may select a face that overlaps all or a part of the motion information detected by the motion detector as a gesture detection target.

์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์˜ ์œ„์น˜๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์ผ์ • ๋ฒ”์œ„ ์ด๋‚ด์˜ ์˜์—ญ์„ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•  ์ˆ˜ ์žˆ๋‹ค.The gesture detection unit may set an area within a predetermined range as a gesture detection area based on the position of the gesture detection target.

๋˜ํ•œ, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์˜ ์œ„์น˜๋กœ๋ถ€ํ„ฐ ์ผ์ • ๊ฑฐ๋ฆฌ ์ด๊ฒฉ๋œ ์ผ์ • ํฌ๊ธฐ์˜ ์˜์—ญ์„ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•  ์ˆ˜ ์žˆ๋‹ค.The gesture detecting unit may set a region having a predetermined size spaced apart from the position of the gesture sensing target as a gesture sensing region.

์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”, ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ์˜ ๋ชจ์–‘ ๋ฐ ์›€์ง์ž„ ๋ฐฉํ–ฅ์„ ๊ฐ์ง€ํ•˜๊ณ , ์ด์— ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ์ถœ๋ ฅํ•  ์ˆ˜ ์žˆ๋‹ค.The gesture detector may detect a shape and a movement direction of a user's gesture and output an operation signal corresponding thereto.

์ด์™€ ๊ฐ™์€ ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜๋Š”, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋ฅผ ํ†ตํ•ด ์–ผ๊ตด ๊ฐ์ง€์‹œ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๊ฐ€ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•˜๋Š” ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์•Œ๋žŒ ์ •๋ณด๋ฅผ ์ œ๊ณตํ•˜๋Š” ์•Œ๋žŒ๋ถ€;๋ฅผ ๋” ํฌํ•จํ•  ์ˆ˜ ์žˆ๋‹ค.Such a gesture detecting apparatus may further include an alarm unit configured to provide alarm information for a predetermined time when the gesture detecting unit detects a user's gesture when detecting a face through the face detecting unit.

๋ณธ ๋ฐœ๋ช…์˜ ๋‹ค๋ฅธ ์ธก๋ฉด์— ๋”ฐ๋ผ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€, ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€ ๋ฐ ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€๋ฅผ ํฌํ•จํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜๋Š”, ์‚ฌ์šฉ์ž์˜ ์›€์ง์ž„(๋ชจ์…˜)์„ ๊ฐ์ง€ํ•˜๊ณ , ์›€์ง์ž„ ๊ฐ์ง€์‹œ ์ƒ๊ธฐ ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์›จ์ดํฌ์—…(wake up) ์‹ ํ˜ธ๋ฅผ ์ „๋‹ฌํ•˜๋Š” ์›€์ง์ž„ ๊ฐ์ง€๋ถ€; ์ œ1 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋‹ค ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ œ2 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋ฉฐ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•˜๊ณ , ์–ผ๊ตด ๊ฐ์ง€์‹œ ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•˜์—ฌ ๊ฐ์ง€๋œ ์ œ์Šค์ณ์— ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ์ถœ๋ ฅํ•˜๋˜, ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋˜์ง€ ์•Š๊ฑฐ๋‚˜ ์ œ์Šค์ณ๊ฐ€ ๊ฐ์ง€๋˜์ง€ ์•Š์œผ๋ฉด ์ œ1 ์ƒํƒœ๋กœ ๋ณต๊ท€ํ•˜๋Š” ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€; ๋ฐ ์ƒ๊ธฐ ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ˆ˜์‹ ๋œ ๋™์ž‘ ์‹ ํ˜ธ์— ๋Œ€์‘ํ•œ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•˜๋Š” ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€;๋ฅผ ํฌํ•จํ•œ๋‹ค.According to another aspect of the present invention, a gesture detection device including a motion detector, a face / gesture detector, and a result output unit detects a user's motion (motion) and wakes up to the face / gesture detector when motion is detected. up) a motion detector for transmitting a signal; When the wake-up signal is received from the motion detection unit, the device operates in the second state for a predetermined time, detects a user's face, and detects a user's gesture for a predetermined time. A face / gesture detection unit that outputs a corresponding operation signal and returns to a first state when a user's face is not detected or a gesture is not detected for a predetermined time; And a result output unit configured to perform an operation corresponding to the operation signal received from the face / gesture detector.

์ด๋•Œ, ์ƒ๊ธฐ ์ œ1 ์ƒํƒœ๋Š” ์ œ2 ์ƒํƒœ์— ๋น„ํ•ด ์ ์€ ๋Ÿ‰์˜ ์ „๋ ฅ์„ ์†Œ๋ชจํ•˜๋Š” ๋™์ž‘ ์ƒํƒœ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค.In this case, the first state may be an operating state that consumes less power than the second state.

์ƒ๊ธฐ ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”, ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•˜๊ณ  ๊ฐ์ง€๋œ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜๋Š” ์–ผ๊ตด ๊ฐ์ง€๋ถ€; ๋ฐ ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์„ ์ •๋œ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์ •๋ณด๋ฅผ ์ „๋‹ฌ๋ฐ›๊ณ , ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์„ค์ •ํ•˜๊ณ  ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์— ๋Œ€ํ•ด์„œ๋งŒ ์ œ์Šค์ณ ๊ฐ์ง€๋ฅผ ์ˆ˜ํ–‰ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€;๋ฅผ ํฌํ•จํ•  ์ˆ˜ ์žˆ๋‹ค.The face / gesture detector may include: a face detector configured to detect a user's face for a predetermined time and select the detected face as a gesture detection target when receiving a wake-up signal from the motion detector; And a gesture detection unit configured to receive information on the selected gesture detection target from the face detection unit, set a user's gesture detection region based on the information on the gesture detection target, and perform gesture detection only on the gesture detection region. It can include;

ํŠนํžˆ, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์˜ ์œ„์น˜๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์ผ์ • ๋ฒ”์œ„ ์ด๋‚ด์˜ ์˜์—ญ์„ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•  ์ˆ˜ ์žˆ๋‹ค.In particular, the gesture detection unit may set an area within a predetermined range as a gesture detection area based on the position of the gesture detection target.

๋ณธ ๋ฐœ๋ช…์˜ ๋˜ ๋‹ค๋ฅธ ์ธก๋ฉด์— ๋”ฐ๋ผ ๋ชจ์…˜/์–ผ๊ตด ๊ฐ์ง€๋ถ€, ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€ ๋ฐ ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€๋ฅผ ํฌํ•จํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜๋Š”, ์‚ฌ์šฉ์ž์˜ ์›€์ง์ž„(๋ชจ์…˜)์„ ๊ฐ์ง€ํ•˜๊ณ , ์›€์ง์ž„ ๊ฐ์ง€์‹œ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•˜๋ฉฐ, ์–ผ๊ตด ๊ฐ์ง€์‹œ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์›จ์ดํฌ์—…(wake up) ์‹ ํ˜ธ๋ฅผ ์ „๋‹ฌํ•˜๋Š” ๋ชจ์…˜/์–ผ๊ตด ๊ฐ์ง€๋ถ€; ์ œ1 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋‹ค ์ƒ๊ธฐ ๋ชจ์…˜/์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ œ2 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋ฉฐ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•˜๊ณ  ๋‹ค์‹œ ์ œ1 ์ƒํƒœ๋กœ ๋ณต๊ท€ํ•˜๊ณ , ์ œ์Šค์ณ ๊ฐ์ง€์‹œ ๊ฐ์ง€๋œ ์ œ์Šค์ณ์— ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ์ถœ๋ ฅํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€; ๋ฐ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ˆ˜์‹ ๋œ ๋™์ž‘ ์‹ ํ˜ธ์— ๋Œ€์‘ํ•œ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•˜๋Š” ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€;๋ฅผ ํฌํ•จํ•œ๋‹ค.According to another aspect of the present invention, a gesture detection device including a motion / face detection unit, a gesture detection unit, and a result output unit detects a user's motion (motion), detects a user's face when detecting a motion, and detects a face. A motion / face detector configured to transfer a wake up signal to the gesture detector; Operating in the first state When receiving the wake-up signal from the motion / face detection unit, the device operates in the second state for a predetermined time, detects the user's gesture and returns to the first state, and detects the gesture when the gesture is detected. A gesture detector for outputting a corresponding operation signal; And a result output unit configured to perform an operation corresponding to the operation signal received from the gesture detector.

์ด๋•Œ, ์ƒ๊ธฐ ์ œ1 ์ƒํƒœ๋Š” ์ œ2 ์ƒํƒœ์— ๋น„ํ•ด ์ ์€ ๋Ÿ‰์˜ ์ „๋ ฅ์„ ์†Œ๋ชจํ•˜๋Š” ๋™์ž‘ ์ƒํƒœ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค.In this case, the first state may be an operating state that consumes less power than the second state.

์ƒ๊ธฐ ๋ชจ์…˜/์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”, ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ ๊ฐ์ง€๋œ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜๊ณ , ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด๋ฅผ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์ถ”๊ฐ€์ ์œผ๋กœ ์ „๋‹ฌํ•˜๊ณ , ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”, ์ƒ๊ธฐ ๋ชจ์…˜/์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ „๋‹ฌ๋ฐ›์€ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์„ค์ •ํ•˜๊ณ  ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์— ๋Œ€ํ•ด์„œ๋งŒ ์ œ์Šค์ณ ๊ฐ์ง€๋ฅผ ์ˆ˜ํ–‰ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€;๋ฅผ ํฌํ•จํ•  ์ˆ˜ ์žˆ๋‹ค.The motion / face detection unit selects a face detected when a user's face is detected as a gesture detection target, additionally transmits position information on the gesture detection target to the gesture detection unit, and the gesture detection unit detects the motion / face detection. And a gesture detection unit configured to set a user's gesture detection area based on the location information of the gesture detection target received from the unit, and perform gesture detection only on the gesture detection area.

์ด๋•Œ, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์˜ ์œ„์น˜๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์ผ์ • ๋ฒ”์œ„ ์ด๋‚ด์˜ ์˜์—ญ์„ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•  ์ˆ˜ ์žˆ๋‹ค.In this case, the gesture detection unit may set an area within a predetermined range as a gesture detection area based on the position of the gesture detection target.

๋ณธ ๋ฐœ๋ช…์˜ ๋ฐ”๋žŒ์งํ•œ ์‹ค์‹œ์˜ˆ์— ๋”ฐ๋ฅธ ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋Š” ์‚ฌ์šฉ์ž์˜ ์›€์ง์ž„ ๋ฐ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•˜์—ฌ ์ œ์Šค์ณ ์ž…๋ ฅ ์ค€๋น„๊ฐ€ ์™„๋ฃŒ๋˜์—ˆ๋Š”์ง€๋ฅผ ํŒ๋ณ„ํ•˜๊ณ , ์ œ์Šค์ณ ์ž…๋ ฅ ์ค€๋น„๊ฐ€ ์™„๋ฃŒ๋œ ๊ฒฝ์šฐ์—๋งŒ ์ œ์Šค์ณ ์ธ์‹ ๋ชจ๋“ˆ์„ ๋™์ž‘ ์‹œํ‚ด์œผ๋กœ์จ ์ „์ฒด ์†Œ๋ชจ ์ „๋ ฅ๋Ÿ‰ ๋ฐ ์—ฐ์‚ฐ๋Ÿ‰์„ ๊ฐ์†Œ์‹œํ‚ค๋Š” ํšจ๊ณผ๊ฐ€ ์žˆ๋‹ค.The gesture recognition apparatus according to the preferred embodiment of the present invention detects the user's movement and face to determine whether the gesture input preparation is completed, and operates the gesture recognition module only when the gesture input preparation is completed, thereby reducing the total power consumption and the amount of calculation. It is effective to let.

ํŠนํžˆ, ์‚ฌ๋žŒ์˜ ์›€์ง์ž„ ๊ฐ์ง€ ๋™์ž‘์€ ์ €์ „๋ ฅ์œผ๋กœ ๊ตฌ๋™ ๊ฐ€๋Šฅํ•˜๋ฏ€๋กœ, ์ €์ „๋ ฅ์œผ๋กœ ์‚ฌ๋žŒ์˜ ์›€์ง์ž„(๋ฐ ์–ผ๊ตด)์„ ๊ฐ์ง€ํ•˜์—ฌ ์ƒ๋Œ€์ ์œผ๋กœ ๋งŽ์€ ์ „๋ ฅ์„ ํ•„์š”๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ์ธ์‹ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ• ์ง€ ์—ฌ๋ถ€๋ฅผ ํŒ๋ณ„ํ•จ์œผ๋กœ์จ ์ข…๋ž˜ ๋Œ€๋น„ ๋งŽ์€ ์†Œ๋น„ ์ „๋ ฅ๋Ÿ‰์„ ๊ฐ์†Œ์‹œํ‚ฌ ์ˆ˜ ์žˆ๋‹ค๋Š” ํšจ๊ณผ๊ฐ€ ์žˆ๋‹ค.In particular, since the motion detection operation of the human being can be driven with low power, it is possible to detect a human motion (and face) at low power and determine whether to perform a gesture recognition operation that requires a relatively large amount of power. There is an effect that can be reduced.

๋˜ํ•œ, ์ œ์Šค์ณ ๊ฐ์ง€(๊ฒ€์ถœ) ์ „์— ์‚ฌ๋žŒ์˜ ์–ผ๊ตด์„ ๋จผ์ € ๊ฐ์ง€(๊ฒ€์ถœ)ํ•˜์—ฌ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•  ์˜์—ญ์„ ํ•œ์ •(์ œํ•œ)ํ•จ์œผ๋กœ์จ ์ „์ฒด ์˜์ƒ ์ •๋ณด๊ฐ€ ์•„๋‹Œ ์ผ๋ถ€ ์˜์ƒ ์ •๋ณด๋งŒ์„ ํ™œ์šฉํ•˜์—ฌ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€(๊ฒ€์ถœ)ํ•  ์ˆ˜ ์žˆ๋‹ค๋Š” ํŠน์ง•์ด ์žˆ์œผ๋ฉฐ, ์ด๋กœ ์ธํ•ด ์ œ์Šค์ณ ๊ฒ€์ถœ์„ ์œ„ํ•œ ์—ฐ์‚ฐ๋Ÿ‰์„ ์ตœ์†Œํ™”์‹œํ‚ฌ ์ˆ˜ ์žˆ๋‹ค๋Š” ํšจ๊ณผ๊ฐ€ ์žˆ๋‹ค.In addition, by detecting (detecting) a face of a person before gesture detection (detection) first, by limiting (limiting) an area for detecting a gesture, a gesture can be detected (detected) by using only some image information instead of all image information. This has the effect of minimizing the amount of computation for gesture detection.

๋„ 1์€ ๋ณธ ๋ฐœ๋ช…์˜ ์ œ1 ์˜ˆ์— ๋”ฐ๋ฅธ ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด,1 is a view showing a gesture recognition device according to a first example of the present invention;

๋„ 2๋Š” ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ผ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒƒ์œผ๋กœ ํŒ๋‹จํ•˜๋Š” ์ผ ์˜ˆ๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด,2 illustrates an example of determining that a face of a user is detected according to the present invention;

๋„ 3์€ ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ผ ๋ณต์ˆ˜ ๊ฐœ์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ, ์ด์ค‘ ์–ด๋Š ํ•˜๋‚˜์˜ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜๋Š” ์ผ ์˜ˆ๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด,3 is a view illustrating an example of selecting one of the faces as a gesture detection target when detecting a plurality of faces according to the present invention;

๋„ 4๋Š” ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ผ ๊ฐ์ง€๋œ ์–ผ๊ตด ์˜์—ญ ์ƒ์—์„œ ์ œ์Šค์ณ๋ฅผ ์ธ์‹ํ•˜๋Š” ์ผ ์˜ˆ๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด,4 illustrates an example of recognizing a gesture on a detected face area according to the present invention;

๋„ 5๋Š” ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ผ ๊ฐ์ง€๋œ ์–ผ๊ตด ์˜์—ญ์œผ๋กœ๋ถ€ํ„ฐ ์ผ์ • ๊ฑฐ๋ฆฌ ์ด๊ฒฉ๋œ ์˜์—ญ ์ƒ์—์„œ ์ œ์Šค์ณ๋ฅผ ์ธ์‹ํ•˜๋Š” ์ผ ์˜ˆ๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด,5 illustrates an example of recognizing a gesture on an area spaced a predetermined distance from a detected face area according to the present invention;

๋„ 6์€ ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ผ ๊ฐ์ง€๋˜๋Š” ์ œ์Šค์ณ์˜ ๋ชจ์–‘์˜ ์ผ ์˜ˆ๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด,6 is a view showing an example of the shape of the gesture detected in accordance with the present invention,

๋„ 7์€ ๋ณธ ๋ฐœ๋ช…์˜ ์ œ2 ์˜ˆ์— ๋”ฐ๋ฅธ ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด,7 is a view showing a gesture recognition device according to a second example of the present invention;

๋„ 8์€ ๋ณธ ๋ฐœ๋ช…์˜ ์ œ3 ์˜ˆ์— ๋”ฐ๋ฅธ ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด์ด๋‹ค.8 is a diagram illustrating a gesture recognizing apparatus according to a third example of the present invention.

๋ณธ ๋ฐœ๋ช…์€ ๋‹ค์–‘ํ•œ ๋ณ€ํ™˜์„ ๊ฐ€ํ•  ์ˆ˜ ์žˆ๊ณ  ์—ฌ๋Ÿฌ ๊ฐ€์ง€ ์‹ค์‹œ์˜ˆ๋ฅผ ๊ฐ€์งˆ ์ˆ˜ ์žˆ๋Š” ๋ฐ”, ํŠน์ • ์‹ค์‹œ์˜ˆ๋“ค์„ ๋„๋ฉด์— ์˜ˆ์‹œํ•˜๊ณ  ์ƒ์„ธํ•œ ์„ค๋ช…์— ์ƒ์„ธํ•˜๊ฒŒ ์„ค๋ช…ํ•˜๊ณ ์ž ํ•œ๋‹ค. ๊ทธ๋Ÿฌ๋‚˜, ์ด๋Š” ๋ณธ ๋ฐœ๋ช…์˜ ํŠน์ •ํ•œ ์‹ค์‹œ ํ˜•ํƒœ์— ๋Œ€ํ•ด ํ•œ์ •ํ•˜๋ ค๋Š” ๊ฒƒ์ด ์•„๋‹ˆ๋ฉฐ, ๋ณธ ๋ฐœ๋ช…์˜ ์‚ฌ์ƒ ๋ฐ ๊ธฐ์ˆ  ๋ฒ”์œ„์— ํฌํ•จ๋˜๋Š” ๋ชจ๋“  ๋ณ€ํ™˜, ๊ท ๋“ฑ๋ฌผ ๋‚ด์ง€ ๋Œ€์ฒด๋ฌผ์„ ํฌํ•จํ•˜๋Š” ๊ฒƒ์œผ๋กœ ์ดํ•ด๋˜์–ด์•ผ ํ•œ๋‹ค. ๋ณธ ๋ฐœ๋ช…์„ ์„ค๋ช…ํ•จ์— ์žˆ์–ด์„œ ๊ด€๋ จ๋œ ๊ณต์ง€ ๊ธฐ์ˆ ์— ๋Œ€ํ•œ ๊ตฌ์ฒด์ ์ธ ์„ค๋ช…์ด ๋ณธ ๋ฐœ๋ช…์˜ ์š”์ง€๋ฅผ ํ๋ฆด ์ˆ˜ ์žˆ๋‹ค๊ณ  ํŒ๋‹จ๋˜๋Š” ๊ฒฝ์šฐ ๊ทธ ์ƒ์„ธํ•œ ์„ค๋ช…์„ ์ƒ๋žตํ•œ๋‹ค.As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to be limited to the particular embodiment of the present invention, it should be understood to include all transformations, equivalents, and substitutes included in the spirit and scope of the present invention. In the following description of the present invention, if it is determined that the detailed description of the related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

์ œ1, ์ œ2 ๋“ฑ์˜ ์šฉ์–ด๋Š” ๋‹ค์–‘ํ•œ ๊ตฌ์„ฑ์š”์†Œ๋“ค์„ ์„ค๋ช…ํ•˜๋Š”๋ฐ ์‚ฌ์šฉ๋  ์ˆ˜ ์žˆ์ง€๋งŒ, ์ƒ๊ธฐ ๊ตฌ์„ฑ์š”์†Œ๋“ค์€ ์ƒ๊ธฐ ์šฉ์–ด๋“ค์— ์˜ํ•ด ํ•œ์ •๋˜์–ด์„œ๋Š” ์•ˆ ๋œ๋‹ค. ์ƒ๊ธฐ ์šฉ์–ด๋“ค์€ ํ•˜๋‚˜์˜ ๊ตฌ์„ฑ์š”์†Œ๋ฅผ ๋‹ค๋ฅธ ๊ตฌ์„ฑ์š”์†Œ๋กœ๋ถ€ํ„ฐ ๊ตฌ๋ณ„ํ•˜๋Š” ๋ชฉ์ ์œผ๋กœ๋งŒ ์‚ฌ์šฉ๋œ๋‹ค.Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

๋ณธ ์ถœ์›์—์„œ ์‚ฌ์šฉํ•œ ์šฉ์–ด๋Š” ๋‹จ์ง€ ํŠน์ •ํ•œ ์‹ค์‹œ์˜ˆ๋ฅผ ์„ค๋ช…ํ•˜๊ธฐ ์œ„ํ•ด ์‚ฌ์šฉ๋œ ๊ฒƒ์œผ๋กœ, ๋ณธ ๋ฐœ๋ช…์„ ํ•œ์ •ํ•˜๋ ค๋Š” ์˜๋„๊ฐ€ ์•„๋‹ˆ๋‹ค. ๋‹จ์ˆ˜์˜ ํ‘œํ˜„์€ ๋ฌธ๋งฅ์ƒ ๋ช…๋ฐฑํ•˜๊ฒŒ ๋‹ค๋ฅด๊ฒŒ ๋œปํ•˜์ง€ ์•Š๋Š” ํ•œ, ๋ณต์ˆ˜์˜ ํ‘œํ˜„์„ ํฌํ•จํ•œ๋‹ค. ๋ณธ ์ถœ์›์—์„œ, "ํฌํ•จํ•˜๋‹ค" ๋˜๋Š” "๊ฐ€์ง€๋‹ค" ๋“ฑ์˜ ์šฉ์–ด๋Š” ๋ช…์„ธ์„œ์ƒ์— ๊ธฐ์žฌ๋œ ํŠน์ง•, ์ˆซ์ž, ๋‹จ๊ณ„, ๋™์ž‘, ๊ตฌ์„ฑ์š”์†Œ, ๋ถ€ํ’ˆ ๋˜๋Š” ์ด๋“ค์„ ์กฐํ•ฉํ•œ ๊ฒƒ์ด ์กด์žฌํ•จ์„ ์ง€์ •ํ•˜๋ ค๋Š” ๊ฒƒ์ด์ง€, ํ•˜๋‚˜ ๋˜๋Š” ๊ทธ ์ด์ƒ์˜ ๋‹ค๋ฅธ ํŠน์ง•๋“ค์ด๋‚˜ ์ˆซ์ž, ๋‹จ๊ณ„, ๋™์ž‘, ๊ตฌ์„ฑ์š”์†Œ, ๋ถ€ํ’ˆ ๋˜๋Š” ์ด๋“ค์„ ์กฐํ•ฉํ•œ ๊ฒƒ๋“ค์˜ ์กด์žฌ ๋˜๋Š” ๋ถ€๊ฐ€ ๊ฐ€๋Šฅ์„ฑ์„ ๋ฏธ๋ฆฌ ๋ฐฐ์ œํ•˜์ง€ ์•Š๋Š” ๊ฒƒ์œผ๋กœ ์ดํ•ด๋˜์–ด์•ผ ํ•œ๋‹ค.The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

์ดํ•˜, ๋ณธ ๋ฐœ๋ช…์˜ ์‹ค์‹œ์˜ˆ๋ฅผ ์ฒจ๋ถ€ํ•œ ๋„๋ฉด๋“ค์„ ์ฐธ์กฐํ•˜์—ฌ ์ƒ์„ธํžˆ ์„ค๋ช…ํ•˜๊ธฐ๋กœ ํ•œ๋‹ค.Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

๋„ 1์€ ๋ณธ ๋ฐœ๋ช…์˜ ์ œ1 ์˜ˆ์— ๋”ฐ๋ฅธ ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด์ด๋‹ค.1 is a diagram illustrating a gesture recognizing apparatus according to a first example of the present invention.

๋„ 1์— ๋„์‹œ๋œ ๋ฐ”์™€ ๊ฐ™์ด, ๋ณธ ๋ฐœ๋ช…์˜ ์ผ ์˜ˆ์— ๋”ฐ๋ฅธ ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋Š” ์›€์ง์ž„(๋ชจ์…˜) ๊ฐ์ง€๋ถ€(10), ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20), ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30) ๋ฐ ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€(40)๋ฅผ ํฌํ•จํ•œ๋‹ค. ์ดํ•˜, ๊ฐ ๊ตฌ์„ฑ ์š”์†Œ๋ณ„๋กœ ๊ตฌ๋ถ„ํ•˜์—ฌ ์ƒ์„ธํžˆ ์„ค๋ช…ํ•œ๋‹ค.As shown in FIG. 1, the gesture recognition apparatus according to an embodiment of the present invention may include a motion (motion) detecting unit 10, a face detecting unit 20, a gesture detecting unit 30, and a result output unit 40. Include. Hereinafter, each component will be described in detail.

[์›€์ง์ž„ [movement ๊ฐ์ง€๋ถ€์—Detector ๋Œ€ํ•œ ์„ค๋ช…]ย Description of

์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10)๋Š” ์‚ฌ์šฉ์ž์˜ ์›€์ง์ž„(๋ชจ์…˜)์„ ๊ฐ์ง€ํ•œ๋‹ค. ์ด๋ฅผ ์œ„ํ•œ ๊ธฐ์ˆ  ๊ตฌ์„ฑ์œผ๋กœ์จ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10)๋กœ๋Š” ์ธ์ฒด๊ฐ์ง€ ์„ผ์„œ๋‚˜ ์˜์ƒ ์„ผ์„œ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค.The motion detector 10 detects a user's motion (motion). As a technical configuration for this, a human body sensor or an image sensor may be applied to the motion detector 10.

์ธ์ฒด๊ฐ์ง€ ์„ผ์„œ์˜ ๊ฒฝ์šฐ ์ ์™ธ์„  ํŒจ์‹œ๋ธŒ ๋ฐฉ์‹(PIR : Passive Infrared Ray), ๊ทผ์ ์™ธ์„  ์•กํ‹ฐ๋ธŒ๋ฐฉ์‹, ์ดˆ์ŒํŒŒ, ๋งˆ์ดํฌ๋กœํŒŒ ๋“ฑ์„ ํ†ตํ•ด ์ผ์ • ๊ฐ„๊ฒฉ์œผ๋กœ ์ธ์ฒด์— ๋Œ€ํ•œ ์ •๋ณด๋ฅผ ํš๋“ํ•˜๊ณ , ํš๋“๋˜๋Š” ์ •๋ณด๊ฐ„ ์ฐจ์ด๊ฐ’์ด ์ผ์ • ์ด์ƒ์ด๋ผ๊ณ  ํŒ๋‹จ๋˜๋ฉด ์‚ฌ์šฉ์ž์˜ ์›€์ง์ž„(๋ชจ์…˜)์ด ๊ฐ์ง€๋œ ๊ฒƒ์œผ๋กœ ํŒ๋‹จํ•  ์ˆ˜ ์žˆ๋‹ค.In the case of the human body detection sensor, information about the human body is acquired at regular intervals through an infrared passive method (PIR), near infrared active method, ultrasonic waves, microwaves, and the like, and when it is determined that the difference between the acquired information is more than a predetermined level, It may be determined that the motion of the motion is detected.

์˜์ƒ ์„ผ์„œ์˜ ๊ฒฝ์šฐ CMOS(Complementary MOS) ์˜์ƒ ์„ผ์„œ, CCD(Charge-Coupled Device), IR ์ด๋ฏธ์ง€ ์„ผ์„œ ๋“ฑ ์‚ฌ๋žŒ์— ๋Œ€ํ•œ ์˜์ƒ ์ •๋ณด๋ฅผ ํš๋“ํ•  ์ˆ˜ ์žˆ๋Š” ๋ชจ๋“  ๊ตฌ์„ฑ ์š”์†Œ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค. ์ด ๊ฒฝ์šฐ์—๋„ ์ƒ๊ธฐ ์˜์ƒ ์„ผ์„œ๋Š” ์ผ์ • ๊ฐ„๊ฒฉ์œผ๋กœ ํš๋“๋˜๋Š” ์˜์ƒ ์ •๋ณด์˜ ์ฐจ๋ถ„ ๊ฐ’ ๋˜๋Š” ์ •ํ•ฉ ๊ฒฐ๊ณผ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์‚ฌ์šฉ์ž์˜ ์›€์ง์ž„(๋ชจ์…˜)์ด ์žˆ์—ˆ๋Š”์ง€๋ฅผ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค.In the case of an image sensor, all components capable of acquiring image information of a person, such as a complementary MOS (CMOS) image sensor, a charge-coupled device (CCD), and an IR image sensor, may be applied. In this case, the image sensor may detect whether there is a motion (motion) of the user based on a difference value or a matching result of the image information acquired at a predetermined interval.

์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10)๋Š” ์ƒ๊ธฐ์™€ ๊ฐ™์€ ๋‹ค์–‘ํ•œ ๋ฐฉ๋ฒ•๋“ค์„ ํ†ตํ•ด ์›€์ง์ž„์ด ๊ฐ์ง€๋œ ๊ฒฝ์šฐ, ๋ณ„๋„์˜ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋กœ ์›จ์ดํฌ์—…(wake up) ์‹ ํ˜ธ๋ฅผ ์ „๋‹ฌํ•œ๋‹ค.When the motion detection unit 10 detects a motion through the various methods as described above, the motion detection unit 10 transmits a wake up signal to the separate face detection unit 20.

[์–ผ๊ตด [Face ๊ฐ์ง€๋ถ€์—Detector ๋Œ€ํ•œ ์„ค๋ช…]ย Description of

์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ํ‰์†Œ์—๋Š” ์ œ1 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋‹ค ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10)๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—…(wake up) ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ œ2 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋ฉฐ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•œ๋‹ค. ์ด๋•Œ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ผ์ • ์˜์—ญ์— ๋Œ€ํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•˜๊ณ  ๋‚œ ํ›„, ๋‹ค์‹œ ์ œ1 ์ƒํƒœ๋กœ ๋ณต๊ท€ํ•˜๊ฒŒ ๋œ๋‹ค.The face detector 20 normally operates in a first state. When the face detector 20 receives a wake up signal from the motion detector 10, the face detector 20 operates in a second state for a predetermined time and detects a user's face. At this time, the face detecting unit 20 detects the user's face in a certain region for a predetermined time, and then returns to the first state.

๋ณธ ๋ฐœ๋ช…์— ์ ์šฉ ๊ฐ€๋Šฅํ•œ ์‹ค์‹œ์˜ˆ์—์„œ, ์ œ1 ์ƒํƒœ๋กœ๋Š” ์Šฌ๋ฆฝ(sleep) ์ƒํƒœ, ํŒŒ์›Œ ์˜คํ”„(power off) ์ƒํƒœ ๋“ฑ์ด ์ ์šฉ๋  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ์ œ2 ์ƒํƒœ๋กœ๋Š” ์ •์ƒ ๋™์ž‘ ์ƒํƒœ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค.In an embodiment applicable to the present invention, a sleep state, a power off state, or the like may be applied to the first state, and a normal operating state may be applied to the second state.

์ฆ‰, ๋ณธ์› ๋ฐœ๋ช…์— ์žˆ์–ด, ์ œ1 ์ƒํƒœ๋Š” ์ œ2 ์ƒํƒœ์— ๋น„ํ•ด ์ ์€ ๋Ÿ‰์˜ ์ „๋ ฅ์„ ์†Œ๋ชจํ•˜๋Š” ๋™์ž‘ ์ƒํƒœ๋ฅผ ์˜๋ฏธํ•  ์ˆ˜ ์žˆ๋‹ค.That is, in the present invention, the first state may mean an operating state that consumes a smaller amount of power than the second state.

์ผ๋ฐ˜์ ์œผ๋กœ, ํŒŒ์›Œ ์˜คํ”„(power off) ์ƒํƒœ๋ž€ ๋ชจ๋“  ๊ตฌ์„ฑ ์š”์†Œ๋“ค๋กœ์˜ ์ „์›์„ ์ฐจ๋‹จํ•œ ์ƒํƒœ๋ฅผ ์˜๋ฏธํ•˜๋ฉฐ, ์Šฌ๋ฆฝ(sleep) ์ƒํƒœ๋ž€ ์ผ๋ถ€ ๊ตฌ์„ฑ ์š”์†Œ๋งŒ ๋™์ž‘ํ•˜๋„๋ก ์ œ์–ดํ•˜๊ณ  ๋‹ค๋ฅธ ๊ตฌ์„ฑ ์š”์†Œ๋“ค์€ ์ „์›์„ ์ฐจ๋‹จํ•˜์—ฌ ์ „์ฒด ์†Œ๋ชจ ์ „๋ ฅ๋Ÿ‰์„ ์ตœ์†Œํ™”ํ•˜๋Š” ์ƒํƒœ๋ฅผ ์˜๋ฏธํ•œ๋‹ค. ์ด๋•Œ, ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ๋ชจ๋“  ๊ตฌ์„ฑ ์š”์†Œ์— ์ „์›์„ ๊ณต๊ธ‰ํ•˜์—ฌ ๋ชจ๋“  ๊ตฌ์„ฑ ์š”์†Œ๋“ค์ด ๋™์ž‘ํ•  ์ˆ˜ ์žˆ๋„๋ก ์ œ์–ดํ•˜๊ฒŒ ๋œ๋‹ค.In general, the power off state means that power to all components is turned off. The sleep state controls only some components to operate and the other components are turned off to consume the entire power. It means a state that minimizes the amount of power. At this time, when the wake-up signal is received, power is supplied to all components to control all components to operate.

์ผ ์˜ˆ๋กœ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ํ‰์†Œ์—๋Š” ์ œ1 ์ƒํƒœ๋กœ์„œ ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10)๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๋Š” ๊ตฌ์„ฑ ์™ธ์— ๋‹ค๋ฅธ ๊ตฌ์„ฑ ์š”์†Œ๋“ค๋กœ์˜ ๊ณต๊ธ‰ ์ „์›์„ ์ฐจ๋‹จํ•˜๋Š” ์Šฌ๋ฆฝ ์ƒํƒœ๋กœ ๋™์ž‘ํ•  ์ˆ˜ ์žˆ๋‹ค. ์ด์–ด, ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10)๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ๊ธฐํƒ€ ๊ตฌ์„ฑ ์š”์†Œ๋“ค(์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฒ€์ถœํ•˜๋Š” ๋ชจ๋“ˆ ๋“ฑ)๋กœ ์ „์›์„ ๊ณต๊ธ‰ํ•˜์—ฌ ๋™์ž‘์ผ€ ํ•˜๋ฉฐ ์ œ2 ์ƒํƒœ๋กœ์„œ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ๊ฐ์ง€ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•˜๊ฒŒ ๋œ๋‹ค.For example, the face detector 20 may operate in a sleep state that cuts off power to other components in addition to the configuration of receiving a wake-up signal from the motion detector 10 as a first state. have. Subsequently, upon receiving the wake-up signal from the motion detection unit 10, power is supplied to other components (a module for detecting a user's face, etc.) to perform a user's face detection operation as a second state. do.

์ด์™€ ๊ฐ™์€ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋กœ๋Š” ์‚ฌ๋žŒ์˜ ์–ผ๊ตด ํ˜•ํƒœ๋ฅผ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋Š” ๋ชจ๋“  ๊ตฌ์„ฑ ์š”์†Œ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค. ์ผ ์˜ˆ๋กœ, ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10)์™€ ๊ฐ™์ด, ์ธ์ฒด๊ฐ์ง€ ์„ผ์„œ, ์˜์ƒ ์„ผ์„œ ๋ชจ๋‘ ์ ์šฉ ๊ฐ€๋Šฅํ•˜๋‹ค.As the face detector 20, all the components capable of detecting the shape of a human face may be applied. For example, like the motion detector 10, both a human body sensor and an image sensor may be applied.

[์–ผ๊ตด [Face ๊ฐ์ง€๋ถ€์˜Detector ์–ผ๊ตด ๊ฐ์ง€ ํŒ๋‹จ ๊ธฐ์ค€์˜ ์˜ˆ]ย Example of Face Detection Criteria]

๋ณธ ๋ฐœ๋ช…์— ์ ์šฉ๊ฐ€๋Šฅํ•œ ์‹ค์‹œ์˜ˆ์— ์žˆ์–ด, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์€ ๊ฒฝ์šฐ์—๋งŒ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒƒ์œผ๋กœ ํŒ๋‹จํ•  ์ˆ˜ ์žˆ๋‹ค.In the embodiment applicable to the present invention, the face detector 20 may determine that the user's face is detected only in the following cases.

1. ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ๋ฐฉํ–ฅ์ด ์ผ์ • ๊ฐ๋„ 1. The user's face is at an angle ์ด๋‚ด์ธ ๊ฒฝ์šฐWithin

๋„ 2๋Š” ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ผ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒƒ์œผ๋กœ ํŒ๋‹จํ•˜๋Š” ์ผ ์˜ˆ๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด์ด๋‹ค.2 is a diagram illustrating an example of determining that a face of a user is detected according to the present invention.

๋„ 2์— ๋„์‹œ๋œ ๋ฐ”์™€ ๊ฐ™์ด, ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ์ •๋ฉด์„ ํ–ฅํ•˜๊ณ  ์žˆ๋Š” ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒฝ์šฐ์—๋งŒ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒƒ์œผ๋กœ ํŒ๋‹จํ•  ์ˆ˜ ์žˆ๋‹ค. ๋ณด๋‹ค ๊ตฌ์ฒด์ ์œผ๋กœ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ๊ฐ์ง€๋œ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ๋ฐฉํ–ฅ์ด ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์ผ์ • ๊ฐ๋„ ์ด๋‚ด์ธ ๊ฒฝ์šฐ์—๋งŒ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒƒ์œผ๋กœ ํŒ๋‹จํ•  ์ˆ˜ ์žˆ๋‹ค.As illustrated in FIG. 2, the face detector 20 may determine that the face of the user is detected only when the face of which the face of the user faces the front is detected. More specifically, the face detector 20 may determine that the face of the user is detected only when the detected direction of the face of the user is within a predetermined angle with respect to the face detector 20.

์ด๋ฅผ ํŒ๋‹จํ•˜๊ธฐ ์œ„ํ•ด, ๋‹ค์–‘ํ•œ ์–ผ๊ตด ๊ฒ€์ถœ ์•Œ๊ณ ๋ฆฌ์ฆ˜์ด ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค. ์˜ˆ๋ฅผ ๋“ค์–ด, ์–ผ๊ตด ์ธ์‹์„ ํ•˜๊ธฐ ์œ„ํ•œ ๋งค์นญ ํ…œํ”Œ๋ฆฟ(matching template)๋ฅผ ์ •๋ฐฉํ–ฅ ์˜์ƒ์„ ํ†ตํ•ด ํ•™์Šต์‹œํ‚ด์œผ๋กœ์จ ์ด๋ฅผ ๊ตฌํ˜„ํ•  ์ˆ˜ ์žˆ๋‹ค. ๋˜๋Š” ๊ฐ์ง€๋˜๋Š” ์–ผ๊ตด์˜ ํ˜•ํƒœ ์ •๋ณด๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ๋ฐฉํ–ฅ์„ ๊ฐ์ง€ํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค.To determine this, various face detection algorithms can be applied. For example, this may be implemented by learning a matching template for face recognition through a forward image. Alternatively, the user's face may be detected by detecting the direction of the user's face based on the shape information of the face.

์ด์™€ ๊ฐ™์ด ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ฅธ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์ „์ฒด์ ์ธ ์–ผ๊ตด์˜ ๋ฐฉํ–ฅ์„ ๊ฒ€์ถœํ•˜์—ฌ ์–ผ๊ตด์˜ ๊ฐ์ง€ ์—ฌ๋ถ€๋ฅผ ํŒ๋‹จํ•จ์œผ๋กœ์จ ์˜์ƒ ์ •๋ณด ๋‚ด์—์„œ ์‹œ์„  ์œ„์น˜๋ฅผ ์‚ฐ์ถœํ•˜๊ณ  ์ด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์‹œ์„  ๋ฐฉํ–ฅ์„ ์‚ฐ์ถœํ•˜๋Š” ์ข…๋ž˜ ๊ธฐ์ˆ  ๋Œ€๋น„ ์ „์ฒด ์—ฐ์‚ฐ๋Ÿ‰ ๋ฐ ์ด๋กœ ์ธํ•œ ์†Œ๋ชจ ์ „๋ ฅ๋Ÿ‰์„ ๊ฐ์†Œ์‹œํ‚ค๋Š” ํšจ๊ณผ๊ฐ€ ์žˆ๋‹ค.As described above, the face detecting unit 20 according to the present invention detects the overall direction of the face to determine whether the face is detected, calculates the position of the gaze in the image information, and calculates the gaze direction based on the overall calculation amount and This has the effect of reducing the amount of power consumed.

2. ์–ผ๊ตด 2. Face ๊ฐ์ง€๋ถ€์™€Detection unit ์‚ฌ์šฉ์ž๊ฐ„Between users ๊ฑฐ๋ฆฌ๊ฐ€ ์ผ์ • ย Street schedule ์ด๋‚ด์ธ ๊ฒฝ์šฐWithin

๋‹ค๋ฅธ ์‹ค์‹œ์˜ˆ์—์„œ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์ผ์ • ๊ฑฐ๋ฆฌ ์ด๋‚ด์— ์œ„์น˜ํ•˜๋Š” ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด๋งŒ์„ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค.In another embodiment, the face detector 20 may detect only a face of a user located within a certain distance.

์ด๋ฅผ ์œ„ํ•ด์„œ๋Š” ๋‹ค์–‘ํ•œ ๋ฐฉ๋ฒ•์ด ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค. ์ผ ์˜ˆ๋กœ, ๋ณ„๋„์˜ ๊ฐ์ง€ ์„ผ์„œ๋ฅผ ์ด์šฉํ•˜์—ฌ ์‚ฌ์šฉ์ž์™€ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๊ฐ„ ๊ฑฐ๋ฆฌ๋ฅผ ์ธก์ •ํ•˜๊ณ , ์ƒ๊ธฐ ๊ฑฐ๋ฆฌ ๊ฐ’์ด ์ผ์ • ์ด๋‚ด์ธ ๊ฒฝ์šฐ์—๋งŒ ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋กœ ํ•˜์—ฌ๊ธˆ ๊ฐ์ง€ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ† ๋ก ํ•  ์ˆ˜ ์žˆ๋‹ค.To this end, various methods may be applied. For example, the distance between the user and the face detector 20 may be measured by using a separate sensor, and the face detector 20 may be configured to perform a detection operation only when the distance value is within a predetermined range. .

๋ฐ”๋žŒ์งํ•˜๊ฒŒ๋Š”, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋ฅผ ํ†ตํ•ด ๊ฐ์ง€๋˜๋Š” ์–ผ๊ตด ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์‚ฌ์šฉ์ž์™€ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๊ฐ„ ๊ฑฐ๋ฆฌ๋ฅผ ์ธก์ •ํ•˜๊ณ , ์ƒ๊ธฐ ๊ฑฐ๋ฆฌ ๊ฐ’์ด ์ผ์ • ์ด๋‚ด์ธ ๊ฒฝ์šฐ์—๋งŒ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ๊ฐ์ง€ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ† ๋ก ํ•  ์ˆ˜ ์žˆ๋‹ค. ์ด๋ฅผ ์œ„ํ•ด, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ํ•ด์ƒ๋„์— ๋”ฐ๋ฅธ ์–ผ๊ตด์˜ ํ”ฝ์…€ ์ˆ˜๋ฅผ ์นด์šดํŠธํ•˜์—ฌ ํ”ฝ์…€ ์ˆ˜๊ฐ€ ์ผ์ • ๊ฐœ์ˆ˜ ์ด์ƒ์ธ ๊ฒฝ์šฐ์—๋งŒ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€(๊ฒ€์ถœ)ํ•˜๋„๋ก ์ œ์–ดํ•  ์ˆ˜ ์žˆ๋‹ค.Preferably, the distance between the user and the face detection unit 20 is measured based on the face information detected by the face detection unit 20, and the face detection operation of the user is performed only when the distance value is within a predetermined range. You can do it. To this end, the face detecting unit 20 may control to detect (detect) the user's face only when the number of pixels of the face according to the resolution is counted.

3. ์–ผ๊ตด 3. face ๊ฐ์ง€๋ถ€์™€Detection unit ์‚ฌ์šฉ์ž๊ฐ„Between users ๊ฑฐ๋ฆฌ๊ฐ€ ์ผ์ • ๋ฒ”์œ„ ย Distance range ์ด๋‚ด์ธ ๊ฒฝ์šฐWithin

๋˜ ๋‹ค๋ฅธ ์‹ค์‹œ์˜ˆ์—์„œ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์ผ์ • ๋ฒ”์œ„ ์ด๋‚ด์— ์œ„์น˜ํ•˜๋Š” ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด๋งŒ์„ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค. ๋‹ค์‹œ ๋งํ•ด, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ตœ์†Œ A ๊ฑฐ๋ฆฌ ์ด์ƒ ์ตœ๋Œ€ B ๊ฑฐ๋ฆฌ ์ดํ•˜ ์ด๊ฒฉ๋œ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด๋งŒ์„ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค.In another embodiment, the face detector 20 may detect only a face of a user located within a predetermined range. In other words, the face detector 20 may detect only a face of a user spaced apart from the face detector by a minimum A distance or more and a maximum B distance or less.

์ด๋ฅผ ์œ„ํ•ด์„œ๋Š” ๋‹ค์–‘ํ•œ ๋ฐฉ๋ฒ•์ด ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค. ์ผ ์˜ˆ๋กœ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ๊ฐ์ง€๋œ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ํฌ๊ธฐ๊ฐ€ ์ œ1 ๋ฌธํ„ฑ๊ฐ’ ์ด์ƒ์ด๋ฉฐ ์ œ2 ๋ฌธํ„ฑ๊ฐ’ ์ดํ•˜์ธ ๊ฒฝ์šฐ์—๋งŒ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒƒ์œผ๋กœ ํŒ๋‹จํ•  ์ˆ˜ ์žˆ๋‹ค. ์ด๋ฅผ ์œ„ํ•ด, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ํ•ด์ƒ๋„์— ๋”ฐ๋ฅธ ์–ผ๊ตด์˜ ํ”ฝ์…€ ์ˆ˜๋ฅผ ์นด์šดํŠธํ•˜์—ฌ ํ”ฝ์…€ ์ˆ˜๊ฐ€ ์ผ์ • ๊ฐœ์ˆ˜ ๋ฒ”์œ„ ์ด๋‚ด์ธ ๊ฒฝ์šฐ์—๋งŒ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€(๊ฒ€์ถœ)ํ•˜๋„๋ก ์ œ์–ดํ•  ์ˆ˜ ์žˆ๋‹ค.To this end, various methods may be applied. For example, the face detector 20 may determine that the user's face is detected only when the detected user's face size is greater than or equal to the first threshold and less than or equal to the second threshold. To this end, the face detector 20 may count the number of pixels of the face according to the resolution to control (detect) the user's face only when the number of pixels is within a predetermined number range.

๋ณธ ๋ฐœ๋ช…์— ์ ์šฉ๊ฐ€๋Šฅํ•œ ๋ฐ”๋žŒ์งํ•œ ์‹ค์‹œ์˜ˆ์—์„œ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์ƒ๊ธฐ์™€ ๊ฐ™์€ ๋‹ค์–‘ํ•œ ๋ฐฉ๋ฒ•์„ ํ†ตํ•ด ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋˜๊ฒŒ ๋˜๋ฉด, ๊ฐ์ง€๋œ ์–ผ๊ตด์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด๋ฅผ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋กœ ์ œ๊ณตํ•˜๊ณ , ์ด๋ฅผ ์ˆ˜์‹ ๋ฐ›์€ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์ƒ๊ธฐ ์œ„์น˜ ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์„ค์ •ํ•˜๊ฒŒ ๋œ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์ œ์Šค์ณ ๊ฐ์ง€๋ฅผ ์œ„ํ•œ ์—ฐ์‚ฐ๋Ÿ‰์„ ๊ฐ์†Œ์‹œํ‚ฌ ์ˆ˜ ์žˆ๋‹ค. ์ดํ•˜, ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)์— ๋Œ€ํ•ด์„œ๋Š” ๊ด€๋ จ ์„ค๋ช…์„ ํ†ตํ•ด ์ƒ์„ธํžˆ ์„ค๋ช…ํ•œ๋‹ค.In the preferred embodiment applicable to the present invention, when the face of the user is detected through the various methods as described above, the face detecting unit 20 provides the gesture detecting unit 30 with the position information on the detected face. In response, the gesture detection unit 30 may receive the gesture detection unit 30 and set the gesture detection area based on the position information. Through this, the gesture detector 30 may reduce the amount of calculation for detecting the gesture. Hereinafter, the gesture detector 30 will be described in detail with reference to the related description.

์ด์ฒ˜๋Ÿผ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์–ผ๊ตด์„ ๊ฐ์ง€ํ•˜๊ฒŒ ๋˜๋ฉด, ๊ฐ์ง€๋œ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜๊ณ  ์ด์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด๋ฅผ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋กœ ์ œ๊ณตํ•  ์ˆ˜ ์žˆ๋‹ค.As such, when the face detector 20 detects a face, the face detector 20 may select the detected face as a gesture detection target and provide location information thereof to the gesture detector 30.

์ด๋•Œ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ๋ณต์ˆ˜ ๊ฐœ์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋  ๊ฒฝ์šฐ์—๋Š” ์ผ์ • ๊ทœ์น™์— ๋”ฐ๋ผ ์ด์ค‘ ์–ด๋Š ํ•˜๋‚˜์˜ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜์—ฌ ์ด์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด๋ฅผ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋กœ ์ œ๊ณตํ•  ์ˆ˜ ์žˆ๋‹ค.In this case, when a plurality of faces are detected, the face detector 20 may select one of the faces as a gesture detection target according to a predetermined rule and provide location information thereof to the gesture detector 30. have.

[๋ณต์ˆ˜ ๊ฐœ์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ, ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ ์„ ์ •์˜ ์˜ˆ][Example of Gesture Detection Target Selection when Detecting Multiple Faces]

1. ์›€์ง์ž„ ์ •๋ณด์— ๊ฐ€์žฅ ๊ฐ€๊นŒ์ด ์œ„์น˜ํ•œ ์–ผ๊ตด1. Face closest to movement information

๋„ 3์€ ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ผ ๋ณต์ˆ˜ ๊ฐœ์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ, ์ด์ค‘ ์–ด๋Š ํ•˜๋‚˜์˜ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜๋Š” ์ผ ์˜ˆ๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด์ด๋‹ค.3 is a diagram illustrating an example of selecting one of the faces as a gesture detection target when detecting a plurality of faces according to the present invention.

๋„ 3์— ๋„์‹œ๋œ ๋ฐ”์™€ ๊ฐ™์ด, ๋ณธ ๋ฐœ๋ช…์— ์ ์šฉ๊ฐ€๋Šฅํ•œ ์‹ค์‹œ์˜ˆ์— ์žˆ์–ด, ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10)๋ฅผ ํ†ตํ•ด ๊ฐ์ง€๋œ ์›€์ง์ž„ ์ •๋ณด์— ๊ฐ€์žฅ ๊ฐ€๊นŒ์ด ์œ„์น˜ํ•œ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•  ์ˆ˜ ์žˆ๋‹ค. As shown in FIG. 3, in the embodiment applicable to the present invention, the face detector 20 may select a face closest to the motion information detected by the motion detector 10 as a gesture detection target. have.

๋ณด๋‹ค ๊ตฌ์ฒด์ ์œผ๋กœ, ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ๊ฐ์ง€๋œ ์›€์ง์ž„ ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ํŠน์ • ๋ฐฉํ–ฅ์œผ๋กœ ๊ฐ€์žฅ ๊ฐ€๊นŒ์ด ์œ„์น˜ํ•œ ์–ผ๊ตด ์ •๋ณด๋ฅผ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•  ์ˆ˜ ์žˆ๋‹ค. ๋„ 3์—์„œ๋Š” ๊ฐ์ง€๋œ ์›€์ง์ž„์˜ ์œ„์ชฝ ๋ฐฉํ–ฅ์œผ๋กœ ๊ฐ€์žฅ ๊ฐ€๊นŒ์ด ์œ„์น˜ํ•œ ์–ผ๊ตด ์ •๋ณด๋ฅผ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜๋Š” ์˜ˆ๋ฅผ ๋„์‹œํ•˜์˜€์œผ๋‚˜, ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ฅธ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์ƒ๊ธฐ ์‹ค์‹œ์˜ˆ๋กœ ํ•œ์ •๋˜์ง€ ์•Š๋Š”๋‹ค.More specifically, the face detector 20 may select the face information closest to the specific direction as the gesture detection target based on the detected motion information. 3 illustrates an example of selecting the face information located closest in the upward direction of the detected motion as a gesture detection target, but the face detection unit 20 according to the present invention is not limited to the above embodiment.

2. ์›€์ง์ž„ ์ •๋ณด๊ฐ€ ๊ฐ์ง€๋œ ์˜์—ญ ์ƒ์˜ ์–ผ๊ตด2. Face on the area where motion information is detected

๋‹ค๋ฅธ ์‹ค์‹œ์˜ˆ์—์„œ, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10)๋ฅผ ํ†ตํ•ด ๊ฐ์ง€๋œ ์›€์ง์ž„ ์ •๋ณด์™€ ์ „๋ถ€ ๋˜๋Š” ์ผ๋ถ€๊ฐ€ ์ค‘์ฒฉ๋˜๋Š” ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•  ์ˆ˜ ์žˆ๋‹ค. ๋‹ค์‹œ ๋งํ•ด, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ๊ฐ์ง€๋œ ์›€์ง์ž„ ์ •๋ณด๊ฐ€ ํŠน์ • ์–ผ๊ตด ์œ„์—์„œ ๊ฐ์ง€๋œ ๊ฒฝ์šฐ ํ•ด๋‹น ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜๊ณ , ์ด์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด๋ฅผ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋กœ ์ œ๊ณตํ•  ์ˆ˜ ์žˆ๋‹ค.In another embodiment, the face detector 20 may select a face that overlaps all or a part of the motion information detected by the motion detector 10 as a gesture detection target. In other words, when the detected motion information is detected on a specific face, the face detector 20 may select a corresponding face as a gesture detection target and provide the position information to the gesture detector 30.

์ƒ๊ธฐ์™€ ๊ฐ™์€ ์‹ค์‹œ์˜ˆ๋“ค์„ ํ†ตํ•ด ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์„ ์„ ์ •ํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ์ด์— ๋Œ€ํ•œ ์ •๋ณด๋ฅผ ์ œ๊ณต๋ฐ›์€ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์ƒ๊ธฐ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์ •๋ณด๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ์ œ์Šค์ณ ๊ฐ์ง€ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•  ์ˆ˜ ์žˆ๋‹ค.Through the above embodiments, the face detection unit 20 may select a gesture detection target, and the gesture detection unit 30 provided with the information may perform a gesture detection operation based on the information on the detection target. can do.

[[ ์ œ์Šค์ณGesture ๊ฐ์ง€๋ถ€์—Detector ๋Œ€ํ•œ ์„ค๋ช…]ย Description of

์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ํ‰์†Œ์—๋Š” ์ œ1 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋‹ค ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—…(wake up) ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ œ2 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋ฉฐ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•œ๋‹ค. ์ด๋•Œ, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ผ์ • ์˜์—ญ์— ๋Œ€ํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•˜๊ณ  ๋‚œ ํ›„, ๋‹ค์‹œ ์ œ1 ์ƒํƒœ๋กœ ๋ณต๊ท€ํ•œ๋‹ค.The gesture detector 30 normally operates in a first state. When the gesture detector 30 receives a wake up signal from the face detector 20, the gesture detector 30 operates in a second state for a predetermined time and detects a user's gesture. At this time, the gesture detector 30 detects the user's gesture with respect to the predetermined area for a predetermined time, and then returns to the first state.

๋ณธ ๋ฐœ๋ช…์— ์ ์šฉ ๊ฐ€๋Šฅํ•œ ์‹ค์‹œ์˜ˆ์—์„œ, ์ œ1 ์ƒํƒœ๋กœ๋Š” ์Šฌ๋ฆฝ(sleep) ์ƒํƒœ, ํŒŒ์›Œ ์˜คํ”„(power off) ์ƒํƒœ ๋“ฑ์ด ์ ์šฉ๋  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ์ œ2 ์ƒํƒœ๋กœ๋Š” ์ •์ƒ ๋™์ž‘ ์ƒํƒœ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค.In an embodiment applicable to the present invention, a sleep state, a power off state, or the like may be applied to the first state, and a normal operating state may be applied to the second state.

์ฆ‰, ๋ณธ์› ๋ฐœ๋ช…์— ์žˆ์–ด, ์ œ1 ์ƒํƒœ๋Š” ์ œ2 ์ƒํƒœ์— ๋น„ํ•ด ์ ์€ ๋Ÿ‰์˜ ์ „๋ ฅ์„ ์†Œ๋ชจํ•˜๋Š” ๋™์ž‘ ์ƒํƒœ๋ฅผ ์˜๋ฏธํ•  ์ˆ˜ ์žˆ๋‹ค.That is, in the present invention, the first state may mean an operating state that consumes a smaller amount of power than the second state.

์ผ ์˜ˆ๋กœ, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ํ‰์†Œ์—๋Š” ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๋Š” ๊ตฌ์„ฑ ์™ธ์— ๋‹ค๋ฅธ ๊ตฌ์„ฑ ์š”์†Œ๋“ค๋กœ์˜ ๊ณต๊ธ‰ ์ „์›์„ ์ฐจ๋‹จํ•˜๋Š” ์Šฌ๋ฆฝ ์ƒํƒœ๋กœ ๋™์ž‘ํ•  ์ˆ˜ ์žˆ๋‹ค. ์ด์–ด, ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ๊ธฐํƒ€ ๊ตฌ์„ฑ ์š”์†Œ๋“ค(์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฒ€์ถœํ•˜๋Š” ๋ชจ๋“ˆ ๋“ฑ)๋กœ ์ „์›์„ ๊ณต๊ธ‰ํ•˜์—ฌ ๋™์ž‘์ผ€ ํ•จ์œผ๋กœ์จ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ ๊ฐ์ง€ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•˜๊ฒŒ ๋œ๋‹ค.For example, the gesture detector 30 may operate in a sleep state that cuts off power to other components in addition to the configuration of receiving a wake-up signal from the face detector 20. Subsequently, when the wake-up signal is received from the face detector 20, the user's gesture detection may be performed by supplying power to other components (such as a module for detecting the user's gesture) to operate.

์ด๋•Œ, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋กœ๋Š” ์‚ฌ์šฉ์ž์˜ ์† ๋™์ž‘ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋Š” ๋ชจ๋“  ๊ตฌ์„ฑ ์š”์†Œ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค. ๋ฐ”๋žŒ์งํ•˜๊ฒŒ๋Š” ๋น„์ ผ ์„ผ์„œ๊ฐ€ ์ ์šฉ๋˜์–ด ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๋ณด๋‹ค ์ •ํ™•ํ•˜๊ฒŒ ๊ฐ์ง€(๊ฒ€์ถœ)ํ•  ์ˆ˜ ์žˆ๋‹ค.In this case, all the components capable of detecting the gesture of the user's hand may be applied to the gesture detecting unit 30. Preferably, a vision sensor may be applied to more accurately detect (detect) the user's gesture.

๋ณธ ๋ฐœ๋ช…์— ์ ์šฉ๊ฐ€๋Šฅํ•œ ๋ฐ”๋žŒ์งํ•œ ์‹ค์‹œ์˜ˆ์—์„œ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋กœ๋ถ€ํ„ฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ (์œ„์น˜) ์ •๋ณด๋ฅผ ์ œ๊ณต๋ฐ›๊ฒŒ ๋˜๋ฉด, ์ƒ๊ธฐ ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์„ค์ •ํ•˜๊ณ  ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์— ํ•œํ•˜์—ฌ ์ œ์Šค์ณ ๊ฐ์ง€ ์—ฐ์‚ฐ์„ ์ˆ˜ํ–‰ํ•œ๋‹ค. ์ฆ‰, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์—ฐ์‚ฐ๋Ÿ‰ ๋ฐ ์ „๋ ฅ ์†Œ๋ชจ๋Ÿ‰์„ ๊ฐ์†Œ์‹œํ‚ค๊ธฐ ์œ„ํ•˜์—ฌ ํš๋“๋˜๋Š” ๋ชจ๋“  ์˜์ƒ ์ •๋ณด์— ๋Œ€ํ•ด ์ œ์Šค์ณ ๊ฐ์ง€ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•˜์ง€ ์•Š๊ณ , ์ด์ค‘ ์ผ๋ถ€ ์˜์—ญ์— ๋Œ€ํ•ด์„œ๋งŒ ์ œ์Šค์ณ ๊ฐ์ง€(๊ฒ€์ถœ) ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•  ์ˆ˜ ์žˆ๋‹ค.In the preferred embodiment applicable to the present invention, when the gesture detecting unit 30 receives the (location) information on the gesture detecting object from the face detecting unit 20, the gesture detecting unit 30 sets the gesture detecting region based on the information. The gesture detection operation is performed only in the gesture detection area. That is, the gesture detector 30 may perform a gesture detection (detection) operation on only some of the regions without performing a gesture detection operation on all image information obtained to reduce the amount of computation and power consumption.

์ดํ•˜, ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)์— ์˜ํ•ด ์„ค์ •๋˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ์จ ์ ์šฉ๊ฐ€๋Šฅํ•œ ์‹ค์‹œ์˜ˆ๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™๋‹ค.Hereinafter, an embodiment applicable as the gesture detection area set by the gesture detection unit 30 is as follows.

[[ ์ œ์Šค์ณGesture ๊ฐ์ง€ ์˜์—ญ์˜ ์˜ˆ]ย Example of detection area]

1. ์–ผ๊ตด ์œ„์—์„œ์˜ 1. on the face ์ œ์Šค์ณGesture ๊ฐ์ง€ย Detect

๋„ 4๋Š” ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ผ ๊ฐ์ง€๋œ ์–ผ๊ตด ์˜์—ญ ์ƒ์—์„œ ์ œ์Šค์ณ๋ฅผ ์ธ์‹ํ•˜๋Š” ์ผ ์˜ˆ๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด์ด๋‹ค.4 illustrates an example of recognizing a gesture on a detected face area according to the present invention.

๋„ 4์— ๋„์‹œ๋œ ๋ฐ”์™€ ๊ฐ™์ด, ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ฅธ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •๋œ ์–ผ๊ตด ์œ„์˜ ์˜์—ญ ์ƒ์— ์ž…๋ ฅ๋˜๋Š” ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค. ์ด๋ฅผ ์œ„ํ•ด, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์˜ ์œ„์น˜๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์ผ์ • ๋ฒ”์œ„ ์ด๋‚ด์˜ ์˜์—ญ์„ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•  ์ˆ˜ ์žˆ๋‹ค.As shown in FIG. 4, the gesture detector 30 may detect a gesture input on an area on a face selected as a gesture detection target. To this end, the gesture detection unit 30 may set an area within a predetermined range as a gesture detection area based on the position of the gesture detection target.

2. ์–ผ๊ตด์„ ๊ธฐ์ค€์œผ๋กœ ํŠน์ • ์˜์—ญ์—์„œ์˜ 2. in a specific area relative to the face ์ œ์Šค์ณGesture ๊ฐ์ง€ย Detect

๋„ 5๋Š” ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ผ ๊ฐ์ง€๋œ ์–ผ๊ตด ์˜์—ญ์œผ๋กœ๋ถ€ํ„ฐ ์ผ์ • ๊ฑฐ๋ฆฌ ์ด๊ฒฉ๋œ ์˜์—ญ ์ƒ์—์„œ ์ œ์Šค์ณ๋ฅผ ์ธ์‹ํ•˜๋Š” ์ผ ์˜ˆ๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด์ด๋‹ค.5 is a diagram illustrating an example of recognizing a gesture on an area spaced a predetermined distance from a detected face area according to the present invention.

๋„ 5์— ๋„์‹œ๋œ ๋ฐ”์™€ ๊ฐ™์ด, ๋ณธ ๋ฐœ๋ช…์— ๋”ฐ๋ฅธ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์˜ ์œ„์น˜๋กœ๋ถ€ํ„ฐ ์ผ์ • ๊ฑฐ๋ฆฌ ์ด๊ฒฉ๋œ ์ผ์ • ํฌ๊ธฐ์˜ ์˜์—ญ์„ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•  ์ˆ˜ ์žˆ๋‹ค.As illustrated in FIG. 5, the gesture detector 30 may set a region having a predetermined size spaced apart from a position of the gesture sensing object as a gesture sensing region.

๊ตฌ์ฒด์ ์œผ๋กœ, ๋„ 5์—์„œ๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ(์–ผ๊ตด)์˜ ์œ„์น˜๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์•„๋ž˜ ๋ฐฉํ–ฅ์œผ๋กœ ์ผ์ • ๊ฑฐ๋ฆฌ ์ด๊ฒฉ๋œ ์˜์—ญ์„ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•œ ์˜ˆ๋ฅผ ๋‚˜ํƒ€๋‚ด๊ณ  ์žˆ์œผ๋‚˜, ๋ณธ ๋ฐœ๋ช…์€ ์ƒ๊ธฐ ์‹ค์‹œ์˜ˆ์— ํ•œ์ •๋˜์ง€ ์•Š๋Š”๋‹ค.Specifically, FIG. 5 illustrates an example in which a region spaced a predetermined distance downward in the downward direction based on the position of the gesture sensing object (face) is set as the gesture sensing region, but the present invention is not limited to the above embodiment.

์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์ƒ๊ธฐ์™€ ๊ฐ™์ด ๋‹ค์–‘ํ•œ ๋ฐฉ๋ฒ•์„ ํ†ตํ•ด ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์„ค์ •ํ•˜๊ณ , ์ƒ๊ธฐ ์˜์—ญ์— ํ•œ์ •ํ•˜์—ฌ ์ œ์Šค์ณ ๊ฐ์ง€ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•จ์œผ๋กœ์จ ์ œ์Šค์ณ ์‚ฐ์ถœ์— ์†Œ์š”๋˜๋Š” ์—ฐ์‚ฐ๋Ÿ‰์„ ์ตœ์ ํ™”์‹œํ‚ฌ ์ˆ˜ ์žˆ๋‹ค. ์ด์–ด, ์ œ์Šค์ณ๊ฐ€ ๊ฐ์ง€๋˜๊ฒŒ ๋˜๋ฉด ๊ฐ์ง€๋œ ์ œ์Šค์ณ์— ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€(40)๋กœ ์ถœ๋ ฅํ•˜๊ฒŒ ๋œ๋‹ค.The gesture detection unit 30 may optimize the amount of calculation required to calculate the gesture by setting the gesture detection area through various methods as described above and performing the gesture detection operation only in the area. Subsequently, when a gesture is detected, an operation signal corresponding to the detected gesture is output to the result output unit 40.

๋ณธ ๋ฐœ๋ช…์— ์ ์šฉ๊ฐ€๋Šฅํ•œ ์‹ค์‹œ์˜ˆ์—์„œ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ์˜ ๋ชจ์–‘ ๋ฐ ์›€์ง์ž„ ๋ฐฉํ–ฅ์„ ๊ฐ์ง€ํ•˜๊ณ , ์ด์— ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ์ถœ๋ ฅํ•  ์ˆ˜ ์žˆ๋‹ค.In an embodiment applicable to the present invention, the gesture detector 30 may detect a shape and a movement direction of a user's gesture and output an operation signal corresponding thereto.

์ผ ์˜ˆ๋กœ, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์˜์ƒ ๋ถ„์„์„ ํ†ตํ•ด ๋„ 6์— ๋„์‹œ๋œ ๋‹ค์–‘ํ•œ ์ œ์Šค์ณ์˜ ๋ชจ์–‘์„ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค.As an example, the gesture detector 30 may detect the shapes of various gestures shown in FIG. 6 through image analysis.

๋˜ํ•œ, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ๊ฐ์ง€๋œ ์ œ์Šค์ณ ๋ชจ์–‘์˜ ์›€์ง์ž„ ๋ฐฉํ–ฅ๋„ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค. In addition, the gesture detection unit 30 may also detect a detected gesture direction of movement.

์ด๋ฅผ ์œ„ํ•ด์„œ๋Š” ๋‹ค์–‘ํ•œ ์‚ฐ์ถœ ์•Œ๊ณ ๋ฆฌ์ฆ˜์ด ์ ์šฉ๋  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ์ผ ์˜ˆ๋กœ ์ผ์ • ์‹œ๊ฐ„ ๊ฐ„๊ฒฉ์œผ๋กœ ํš๋“๋˜๋Š” ์˜์ƒ ๋ฐ์ดํ„ฐ๊ฐ„ ์ฐจ๋ถ„ ์ •๋ณด๋ฅผ ์ด์šฉํ•˜์—ฌ ์†(์ œ์Šค์ณ)์˜ ์ด๋™ ๋ฐฉํ–ฅ์„ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค.To this end, various calculation algorithms may be applied. For example, a moving direction of a hand (gesture) may be detected using difference information between image data acquired at predetermined time intervals.

๋˜๋Š”, ๋ธ”๋ก ๋ชจ์…˜์„ ๊ตฌํ•˜์—ฌ ๊ฐœ๋ณ„ ๋ธ”๋ก์˜ ์›€์ง์ž„ ๋ฒกํ„ฐ๋ฅผ ๊ตฌํ•œ ํ›„ ์ „์ฒด ์›€์ง์ž„ ๋ฒกํ„ฐ์˜ ํ‰๊ท ์„ ๊ตฌํ•จ์œผ๋กœ์จ ์†(์ œ์Šค์ณ)์˜ ์›€์ง์ž„ ๋ฐฉํ–ฅ์„ ๊ฐ์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค.Alternatively, the motion direction of a hand (gesture) may be detected by obtaining a block motion to obtain a motion vector of an individual block, and then calculating an average of all motion vectors.

๋˜ ๋‹ค๋ฅธ ๋ฐฉ๋ฒ•์œผ๋กœ๋Š”, ์˜ตํ‹ฐ์ปฌ ํ”Œ๋กœ์šฐ(Optical Flow)๋ฅผ ๊ตฌํ•˜์—ฌ ์ „์ฒด์ ์œผ๋กœ ์˜ตํ‹ฐ์ปฌ ํ”Œ๋กœ์šฐ๊ฐ€ ์–ด๋Š ๋ฐฉํ–ฅ์œผ๋กœ ์›€์ง์ด๋Š”์ง€๋ฅผ ๊ฒ€์ถœํ•จ์œผ๋กœ์จ ์›€์ง์ž„์˜ ๋ฐฉํ–ฅ์„ ํŠธ๋ž˜ํ‚น(tracking)ํ•  ์ˆ˜ ์žˆ๋‹ค. Alternatively, the direction of the movement can be tracked by obtaining the optical flow and detecting which direction the optical flow is moving as a whole.

๋ณธ ๋ฐœ๋ช…์€ ์ƒ๊ธฐ ์‹ค์‹œ์˜ˆ๋กœ ํ•œ์ •๋˜์ง€ ์•Š์œผ๋ฉฐ, ์ด์™ธ ๊ธฐํƒ€ ๋‹ค๋ฅธ ์›€์ง์ž„ ๊ฐ์ง€ ๋ฐฉ๋ฒ• ๋˜ํ•œ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค.The present invention is not limited to the above embodiment, and other motion sensing methods may also be applied.

[๊ฒฐ๊ณผ [result ์ถœ๋ ฅ๋ถ€์— ๋Œ€ํ•œ ์„ค๋ช…Description of output ]]

๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€(40)๋Š” ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋กœ๋ถ€ํ„ฐ ์ˆ˜์‹ ๋œ ๋™์ž‘ ์‹ ํ˜ธ์— ๋Œ€์‘ํ•œ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•œ๋‹ค. ์ด๋•Œ, ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ๊ฐ์ง€๋œ ์ œ์Šค์ณ์˜ ๋ชจ์–‘ ๋ฐ ์›€์ง์ž„ ๋ฐฉํ–ฅ๋ณ„ ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ์— ๋Œ€ํ•œ ํ…Œ์ด๋ธ” ์ •๋ณด๋ฅผ ์ €์žฅํ•˜๋ฉฐ, ํŠน์ • ์ œ์Šค์ณ์˜ ๋ชจ์–‘ ๋ฐ ์›€์ง์ž„ ๋ฐฉํ–ฅ์ด ๊ฐ์ง€๋˜๊ฒŒ ๋˜๋ฉด ์ƒ๊ธฐ ํ…Œ์ด๋ธ” ์ •๋ณด๋ฅผ ํ™œ์šฉํ•˜์—ฌ ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€(40)๋กœ ์ œ๊ณตํ•  ์ˆ˜ ์žˆ๋‹ค.The result output unit 40 performs an operation corresponding to the operation signal received from the gesture detection unit 30. In this case, the gesture detection unit 30 stores table information on the corresponding motion signal for each shape and movement direction of the detected gesture. When the shape and movement direction of a specific gesture are detected, the gesture detection unit 30 uses the table information. The signal may be provided to the result output unit 40.

์ผ ์˜ˆ๋กœ, A ์ œ์Šค์ณ๋Š” TV์˜ ์ฑ„๋„ ๋ณ€๊ฒฝ(์ฑ„๋„ ๋ฒˆํ˜ธ ์ฆ๊ฐ€ ๋˜๋Š” ๊ฐ์†Œ), B ์ œ์Šค์ณ๋Š” TV์˜ ์Œ๋Ÿ‰ ์กฐ์ ˆ(์Œ๋Ÿ‰ ํฌ๊ธฐ ์ฆ๊ฐ€ ๋˜๋Š” ๊ฐ์†Œ), C ์ œ์Šค์ณ๋Š” TV์˜ ์ „์› ์˜จ/์˜คํ”„ ์ œ์–ด ๋™์ž‘์— ๋Œ€์‘๋˜๋„๋ก ์„ค์ •๋˜์—ˆ๋‹ค๊ณ  ๊ฐ€์ •ํ•œ๋‹ค.For example, assume that the A gesture is set to change a channel of the TV (increase or decrease channel number), the B gesture is to adjust the volume of the TV (increase or decrease volume), and the C gesture is set to correspond to the power on / off control operation of the TV. do.

์ด ๊ฒฝ์šฐ, ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)์— ์˜ํ•ด ์‚ฌ์šฉ์ž์˜ B ์ œ์Šค์ณ๊ฐ€ ๊ฐ์ง€๋˜์—ˆ๋‹ค๋ฉด, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ์ƒ๊ธฐ ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€(40)๋กœ ์Œ๋Ÿ‰ ์กฐ์ ˆ(์Œ๋Ÿ‰ ํฌ๊ธฐ ์ฆ๊ฐ€ ๋˜๋Š” ๊ฐ์†Œ)์— ๋Œ€ํ•œ ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ์ œ๊ณตํ•  ์ˆ˜ ์žˆ๋‹ค. ์ด๋ฅผ ์ œ๊ณต ๋ฐ›์€ ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€(40)๋Š” ๋Œ€์‘๋˜๋Š” ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•  ์ˆ˜ ์žˆ๋‹ค.In this case, if the user's B gesture is detected by the gesture detector 30, the gesture detector 30 provides an operation signal for volume control (volume increase or decrease) to the result output unit 40. can do. As a result, the result output unit 40 may perform a corresponding operation.

[์ถ”๊ฐ€ [Add ๊ตฌ์„ฑ์— ๋Œ€ํ•œ ์„ค๋ช…Description of the configuration ]]

๋ณธ ๋ฐœ๋ช…์— ์ ์šฉ๊ฐ€๋Šฅํ•œ ๋‹ค๋ฅธ ์‹ค์‹œ์˜ˆ์—์„œ, ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜๋Š” ์•Œ๋žŒ๋ถ€(๋ฏธ๋„์‹œ)๋ฅผ ๋” ํฌํ•จํ•  ์ˆ˜ ์žˆ๋‹ค. ์ƒ๊ธฐ ์•Œ๋žŒ๋ถ€(๋ฏธ๋„์‹œ)๋Š” ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋ฅผ ํ†ตํ•ด ์–ผ๊ตด์ด ๊ฐ์ง€๋˜๊ฒŒ ๋˜๋ฉด(์ฆ‰, ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์ด ์„ ์ •๋˜๊ฒŒ ๋˜๋ฉด), ์‚ฌ์šฉ์ž๋กœ ํ•˜์—ฌ๊ธˆ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๊ฐ€ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•  ์ค€๋น„๊ฐ€ ๋˜์—ˆ์Œ์— ๋Œ€ํ•œ ์•Œ๋žŒ ๋ฉ”์‹œ์ง€๋ฅผ ์ œ๊ณตํ•  ์ˆ˜ ์žˆ๋‹ค. ๋‹ค์‹œ ๋งํ•ด, ์ƒ๊ธฐ ์•Œ๋žŒ๋ถ€๋Š” ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๊ฐ€ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•˜๋Š” ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์•Œ๋žŒ ์ •๋ณด๋ฅผ ์ œ๊ณตํ•จ์œผ๋กœ์จ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•  ์ค€๋น„๊ฐ€ ๋˜์—ˆ์Œ์— ๋Œ€ํ•œ ์ •๋ณด๋ฅผ ์ œ๊ณตํ•  ์ˆ˜ ์žˆ๋‹ค.In another embodiment applicable to the present invention, the gesture sensing device may further include an alarm unit (not shown). When the face is detected through the face detecting unit 20 (that is, when a gesture detection target is selected), the alarm unit (not shown) allows the user to detect the user's gesture by the gesture detecting unit 30. You can provide an alarm message that you are ready to do so. In other words, the alarm unit may provide information that the gesture detection unit 30 is ready to detect a gesture by providing alarm information for a predetermined time for detecting the user's gesture.

์ด์™€ ๊ฐ™์ด ๋ณธ ๋ฐœ๋ช…์˜ ์ œ1 ์˜ˆ์— ๋”ฐ๋ฅธ ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋Š” ๊ฐ๊ฐ ๊ตฌ๋ถ„๋˜๋Š” ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10), ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20), ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋ฅผ ํฌํ•จํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ์ด๋•Œ, ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20) ๋ฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ํ‰์†Œ์—๋Š” ์ œ1 ์ƒํƒœ(์Šฌ๋ฆฝ ์ƒํƒœ ๋˜๋Š” ํŒŒ์›Œ ์˜คํ”„ ์ƒํƒœ ๋“ฑ)๋กœ ๋™์ž‘ํ•˜๋‹ค ๋ณ„๋„์˜ ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ž ์‹œ ๋™์•ˆ ์ œ2 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋ฉฐ ๊ด€๋ จ ๋™์ž‘์„ ์ˆ˜ํ–‰ ํ›„ ๋‹ค์‹œ ์ œ1 ์ƒํƒœ๋กœ ๋˜๋Œ์•„๊ฐˆ ์ˆ˜ ์žˆ๋‹ค.As such, the gesture recognizing apparatus according to the first example of the present invention may include a motion detector 10, a face detector 20, and a gesture detector 30, each of which is distinguished. In this case, the face detector 20 ) And the gesture detector 30 normally operate in a first state (sleep state or power off state). When a separate wake-up signal is received, the gesture detection unit 30 operates in a second state for a while. Can return to the 1 state.

์ด๋ฅผ ํ†ตํ•ด, ์ €์ „๋ ฅ์œผ๋กœ ๊ตฌ๋™๋˜๋Š” ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10)๋ฅผ ํ†ตํ•ด ์‚ฌ์šฉ์ž๊ฐ€ ์ œ์Šค์ณ๋ฅผ ์ž…๋ ฅํ•  ์ค€๋น„๋ฅผ ํ•˜์˜€๋Š”์ง€๋ฅผ ํŒ๋ณ„ํ•˜๊ณ , ์ค€๋น„๊ฐ€ ๋œ ๊ฒฝ์šฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20) ๋ฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋ฅผ ์›จ์ดํฌ์—… ์‹œ์ผœ ์ตœ์ข…์ ์œผ๋กœ๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•จ์œผ๋กœ์จ ์ „์ฒด์ ์œผ๋กœ ์ €์ „๋ ฅ์œผ๋กœ ๊ตฌ๋™ ๊ฐ€๋Šฅํ•˜๋‹ค๋Š” ํšจ๊ณผ๊ฐ€ ์žˆ๋‹ค.Through this, the user may determine whether the user prepares to input a gesture through the low-power motion detector 10, and when the user is ready, wakes up the face detector 20 and the gesture detector 30. Has the effect of being able to be driven with low power as a whole by performing the gesture sensing operation.

๋˜ํ•œ, ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ(์–ผ๊ตด)์„ ์„ ์ •ํ•˜์—ฌ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์ œํ•œํ•จ์œผ๋กœ์จ ์ œ์Šค์ณ ๊ฐ์ง€์— ์†Œ์š”๋˜๋Š” ์—ฐ์‚ฐ๋Ÿ‰์„ ๊ฐ์†Œ์‹œํ‚ฌ ์ˆ˜ ์žˆ๋‹ค๋Š” ํšจ๊ณผ๊ฐ€ ์žˆ๋‹ค.In addition, by selecting the gesture detection target (face) and limiting the gesture detection area, the amount of computation required for the gesture detection may be reduced.

๋ณธ ๋ฐœ๋ช…์˜ ๋‹ค๋ฅธ ์‹ค์‹œ์˜ˆ์—์„œ๋Š”, ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20) ๋ฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๊ฐ€ ํ•˜๋‚˜์˜ ๊ตฌ์„ฑ ์š”์†Œ๋กœ์„œ ๋™์ž‘ํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ๋˜ ๋‹ค๋ฅธ ์‹ค์‹œ์˜ˆ์—์„œ๋Š” ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10) ๋ฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๊ฐ€ ํ•˜๋‚˜์˜ ๊ตฌ์„ฑ ์š”์†Œ๋กœ์„œ ๋™์ž‘ํ•  ์ˆ˜ ์žˆ๋‹ค.In another embodiment of the present invention, the face detector 20 and the gesture detector 30 may operate as one component, and in another embodiment, the motion detector 10 and the face detector 20. Can operate as one component.

์ดํ•˜, ์ƒ๊ธฐ ์‹ค์‹œ์˜ˆ์—์„œ๋Š” ๋„ 7 ๋ฐ ๋„ 8์„ ํ†ตํ•ด ์ƒ์„ธํžˆ ์„ค๋ช…ํ•œ๋‹ค.Hereinafter, the embodiment will be described in detail with reference to FIGS. 7 and 8.

๋„ 7์€ ๋ณธ ๋ฐœ๋ช…์˜ ์ œ2 ์˜ˆ์— ๋”ฐ๋ฅธ ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด์ด๋‹ค.7 is a diagram illustrating a gesture recognizing apparatus according to a second example of the present invention.

๋„ 7์— ๋„์‹œ๋œ ๋ฐ”์™€ ๊ฐ™์ด, ์ œ1 ์˜ˆ์˜ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20) ๋ฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(30)๋Š” ํ•˜๋‚˜์˜ ๊ตฌ์„ฑ ์š”์†Œ๋กœ์„œ ํ†ตํ•ฉํ•˜์—ฌ ๋™์ž‘ํ•  ์ˆ˜ ์žˆ๋‹ค.As shown in FIG. 7, the face detector 20 and the gesture detector 30 of the first example may be integrated and operate as one component.

์ด๋•Œ, ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(110)๋กœ๋Š” PIR ์„ผ์„œ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(125)๋กœ๋Š” ์˜์ƒ ์„ผ์„œ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด, ์›€์ง์ž„์ด ๊ฐ์ง€๋œ ๊ฒฝ์šฐ์—๋งŒ ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(125)๋ฅผ ์›จ์ดํฌ์—…์‹œํ‚ด์œผ๋กœ์จ ์ „์ฒด์ ์œผ๋กœ ์ €์ „๋ ฅ์œผ๋กœ ๊ตฌํ˜„ ๊ฐ€๋Šฅํ•˜๋‹ค.In this case, the PIR sensor may be applied to the motion detector 110, and the image sensor may be applied to the face / gesture detector 125. As a result, the face / gesture detection unit 125 may be woken up only when a motion is detected, and thus may be implemented at low power.

์ด์™ธ ๋™์ž‘ ๋ฐฉ๋ฒ•์— ๋Œ€ํ•ด์„œ๋Š” ์•ž์„œ ์„ค๋ช…ํ•œ ๋ฐ”์™€ ๋™์ผํ•œ ๋ฐ” ์ƒ๋žตํ•œ๋‹ค.Other operations will be omitted as described above.

๋„ 8์€ ๋ณธ ๋ฐœ๋ช…์˜ ์ œ3 ์˜ˆ์— ๋”ฐ๋ฅธ ์ œ์Šค์ณ ์ธ์‹ ์žฅ์น˜๋ฅผ ๋‚˜ํƒ€๋‚ธ ๋„๋ฉด์ด๋‹ค.8 is a diagram illustrating a gesture recognizing apparatus according to a third example of the present invention.

๋„ 8์— ๋„์‹œ๋œ ๋ฐ”์™€ ๊ฐ™์ด, ์ œ1 ์˜ˆ์˜ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€(10) ๋ฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€(20)๋Š” ํ•˜๋‚˜์˜ ๊ตฌ์„ฑ ์š”์†Œ๋กœ์„œ ํ†ตํ•ฉํ•˜์—ฌ ๋™์ž‘ํ•  ์ˆ˜ ์žˆ๋‹ค.As shown in FIG. 8, the motion detector 10 and the face detector 20 of the first example may be integrated and operate as one component.

์ด๋•Œ, ์›€์ง์ž„/์–ผ๊ตด ๊ฐ์ง€๋ถ€(215)๋กœ๋Š” PIR ์„ผ์„œ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(230)๋กœ๋Š” ์˜์ƒ ์„ผ์„œ๊ฐ€ ์ ์šฉ๋  ์ˆ˜ ์žˆ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด, ์›€์ง์ž„/์–ผ๊ตด ๊ฐ์ง€ ๋™์ž‘์€ ์ €์ „๋ ฅ์œผ๋กœ ๊ตฌ๋™ ๊ฐ€๋Šฅํ•œ PIR ์„ผ์„œ๋ฅผ ์ด์šฉํ•˜์—ฌ ์ˆ˜ํ–‰ํ•˜๋ฉฐ, ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒฝ์šฐ์—๋งŒ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€(230)๋ฅผ ์›จ์ดํฌ์—…์‹œํ‚ด์œผ๋กœ์จ ์ „์ฒด์ ์œผ๋กœ ์ €์ „๋ ฅ์œผ๋กœ ๊ตฌํ˜„ ๊ฐ€๋Šฅํ•˜๋‹ค.In this case, the PIR sensor may be applied to the motion / face detector 215 and the image sensor may be applied to the gesture detector 230. Through this, the motion / face detection operation is performed by using the PIR sensor which can be driven at a low power, and can be realized at low power as a whole by waking up the gesture detector 230 only when a face is detected.

์ด์™ธ ๋™์ž‘ ๋ฐฉ๋ฒ•์— ๋Œ€ํ•ด์„œ๋Š” ์•ž์„œ ์„ค๋ช…ํ•œ ๋ฐ”์™€ ๋™์ผํ•œ ๋ฐ” ์ƒ๋žตํ•œ๋‹ค.Other operations will be omitted as described above.

์ด์ œ๊นŒ์ง€ ๋ณธ ๋ฐœ๋ช…์— ๋Œ€ํ•˜์—ฌ ๊ทธ ๋ฐ”๋žŒ์งํ•œ ์‹ค์‹œ์˜ˆ๋“ค์„ ์ค‘์‹ฌ์œผ๋กœ ์‚ดํŽด๋ณด์•˜๋‹ค. ๋ณธ ๋ฐœ๋ช…์ด ์†ํ•˜๋Š” ๊ธฐ์ˆ  ๋ถ„์•ผ์—์„œ ํ†ต์ƒ์˜ ์ง€์‹์„ ๊ฐ€์ง„ ์ž๋Š” ๋ณธ ๋ฐœ๋ช…์ด ๋ณธ ๋ฐœ๋ช…์˜ ๋ณธ์งˆ์ ์ธ ํŠน์„ฑ์—์„œ ๋ฒ—์–ด๋‚˜์ง€ ์•Š๋Š” ๋ฒ”์œ„์—์„œ ๋ณ€ํ˜•๋œ ํ˜•ํƒœ๋กœ ๊ตฌํ˜„๋  ์ˆ˜ ์žˆ์Œ์„ ์ดํ•ดํ•  ์ˆ˜ ์žˆ์„ ๊ฒƒ์ด๋‹ค. ๊ทธ๋Ÿฌ๋ฏ€๋กœ ๊ฐœ์‹œ๋œ ์‹ค์‹œ์˜ˆ๋“ค์€ ํ•œ์ •์ ์ธ ๊ด€์ ์ด ์•„๋‹ˆ๋ผ ์„ค๋ช…์ ์ธ ๊ด€์ ์—์„œ ๊ณ ๋ ค๋˜์–ด์•ผ ํ•œ๋‹ค. ๋ณธ ๋ฐœ๋ช…์˜ ๋ฒ”์œ„๋Š” ์ „์ˆ ํ•œ ์„ค๋ช…์ด ์•„๋‹ˆ๋ผ ํŠนํ—ˆ์ฒญ๊ตฌ๋ฒ”์œ„์— ๋‚˜ํƒ€๋‚˜ ์žˆ์œผ๋ฉฐ, ๊ทธ์™€ ๋™๋“ฑํ•œ ๋ฒ”์œ„ ๋‚ด์— ์žˆ๋Š” ๋ชจ๋“  ์ฐจ์ด์ ์€ ๋ณธ ๋ฐœ๋ช…์— ํฌํ•จ๋œ ๊ฒƒ์œผ๋กœ ํ•ด์„๋˜์–ด์•ผ ํ•  ๊ฒƒ์ด๋‹ค.So far I looked at the center of the preferred embodiment for the present invention. Those skilled in the art will appreciate that the present invention can be implemented in a modified form without departing from the essential features of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

Claims (21)

์›€์ง์ž„ ๊ฐ์ง€๋ถ€, ์–ผ๊ตด ๊ฐ์ง€๋ถ€, ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€ ๋ฐ ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€๋ฅผ ํฌํ•จํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜์— ์žˆ์–ด์„œ,In the gesture detection device comprising a motion detector, a face detector, a gesture detector and a result output unit, ์‚ฌ์šฉ์ž์˜ ์›€์ง์ž„(๋ชจ์…˜)์„ ๊ฐ์ง€ํ•˜๊ณ , ์›€์ง์ž„ ๊ฐ์ง€์‹œ ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ ์ œ1 ์›จ์ดํฌ์—…(wake up) ์‹ ํ˜ธ๋ฅผ ์ „๋‹ฌํ•˜๋Š” ์›€์ง์ž„ ๊ฐ์ง€๋ถ€;A motion detector configured to detect a user's motion (motion) and to transmit a first wake up signal to the face detector when motion is detected; ์ œ1 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋‹ค ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ œ1 ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ œ2 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋ฉฐ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•˜๊ณ  ๋‹ค์‹œ ์ œ1 ์ƒํƒœ๋กœ ๋ณต๊ท€ํ•˜๊ณ , ์–ผ๊ตด ๊ฐ์ง€์‹œ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์ œ2 ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ „๋‹ฌํ•˜๋Š” ์–ผ๊ตด ๊ฐ์ง€๋ถ€;When the first wake-up signal is received from the motion detection unit, the device operates in the second state for a predetermined time, detects a user's face, returns to the first state, and detects a face to the gesture detection unit. A face detector for transmitting a second wake-up signal; ์ œ1 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋‹ค ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ œ2 ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ œ2 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋ฉฐ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•˜๊ณ  ๋‹ค์‹œ ์ œ1 ์ƒํƒœ๋กœ ๋ณต๊ท€ํ•˜๊ณ , ์ œ์Šค์ณ ๊ฐ์ง€์‹œ ๊ฐ์ง€๋œ ์ œ์Šค์ณ์— ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ์ถœ๋ ฅํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€; ๋ฐWhen the second wake-up signal is received from the face detection unit, the device operates in the second state for a predetermined time, detects the user's gesture, returns to the first state, and detects the gesture. A gesture detector for outputting a corresponding operation signal; And ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ˆ˜์‹ ๋œ ๋™์ž‘ ์‹ ํ˜ธ์— ๋Œ€์‘ํ•œ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•˜๋Š” ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€;๋ฅผ ํฌํ•จํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And a result output unit configured to perform an operation corresponding to the operation signal received from the gesture detection unit. ์ œ1 ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 1, ์ƒ๊ธฐ ์ œ1 ์ƒํƒœ๋Š” ์ œ2 ์ƒํƒœ์— ๋น„ํ•ด ์ ์€ ๋Ÿ‰์˜ ์ „๋ ฅ์„ ์†Œ๋ชจํ•˜๋Š” ๋™์ž‘ ์ƒํƒœ์ธ ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And wherein the first state is an operating state that consumes less power than the second state. ์ œ 2ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 2, ์ƒ๊ธฐ ์ œ1 ์ƒํƒœ๋Š” ํŒŒ์›Œ ์˜คํ”„(Power Off) ์ƒํƒœ ๋˜๋Š” ์Šฌ๋ฆฝ(sleep) ์ƒํƒœ์ธ ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And the first state is a power off state or a sleep state. ์ œ 1ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 1, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”,The face detection unit, ๊ฐ์ง€๋œ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ๋ฐฉํ–ฅ์ด ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์ผ์ • ๊ฐ๋„ ์ด๋‚ด์ธ ๊ฒฝ์šฐ์—๋งŒ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒƒ์œผ๋กœ ํŒ๋‹จํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.Gesture detection device, characterized in that it is determined that the user's face is detected only when the detected direction of the user's face is within a predetermined angle with respect to the face detection unit. ์ œ 1ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 1, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”,The face detection unit, ๊ฐ์ง€๋œ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ํฌ๊ธฐ๊ฐ€ ์ œ1 ๋ฌธํ„ฑ๊ฐ’ ์ด์ƒ์ด๋ฉฐ ์ œ2 ๋ฌธํ„ฑ๊ฐ’ ์ดํ•˜์ธ ๊ฒฝ์šฐ์—๋งŒ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋œ ๊ฒƒ์œผ๋กœ ํŒ๋‹จํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And detecting that the user's face is detected only when the detected user's face size is greater than or equal to the first threshold and less than or equal to the second threshold. ์ œ 1ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 1, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”,The face detection unit, ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ, ๊ฐ์ง€๋œ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜์—ฌ ์ด์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด๋ฅผ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์ถ”๊ฐ€์ ์œผ๋กœ ์ „๋‹ฌํ•˜๊ณ ,When the user's face is detected, the detected face is selected as a gesture detection target, and location information about the detected face is additionally transmitted to the gesture detection unit. ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”,The gesture detection unit, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ œ๊ณต๋œ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์„ค์ •ํ•˜์—ฌ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์— ๋Œ€ํ•ด์„œ๋งŒ ์ œ์Šค์ณ ๊ฐ์ง€๋ฅผ ์ˆ˜ํ–‰ํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And detecting a gesture only for the gesture detection area by setting a user's gesture detection area based on location information of a gesture detection target provided from the face detection unit. ์ œ 6ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 6, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”,The face detection unit, ๋ณต์ˆ˜ ๊ฐœ์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ, ์ด์ค‘ ์–ด๋Š ํ•˜๋‚˜์˜ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜์—ฌ ์ด์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด๋ฅผ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์ถ”๊ฐ€์ ์œผ๋กœ ์ „๋‹ฌํ•˜๊ณ ,Upon detecting a plurality of faces, one of the faces is selected as a gesture detection target, and the position information is additionally transmitted to the gesture detection unit. ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”,The gesture detection unit, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ œ๊ณต๋œ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์„ค์ •ํ•˜์—ฌ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์— ๋Œ€ํ•ด์„œ๋งŒ ์ œ์Šค์ณ ๊ฐ์ง€๋ฅผ ์ˆ˜ํ–‰ํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And detecting a gesture only for the gesture detection area by setting a user's gesture detection area based on location information of a gesture detection target provided from the face detection unit. ์ œ 7ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 7, wherein ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”,The face detection unit, ๋ณต์ˆ˜ ๊ฐœ์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ, ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€๋ฅผ ํ†ตํ•ด ๊ฐ์ง€๋œ ์›€์ง์ž„ ์ •๋ณด์— ๊ฐ€์žฅ ๊ฐ€๊นŒ์šด ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And detecting a face closest to the motion information detected by the motion detector as a gesture detection target when detecting a plurality of faces. ์ œ 7ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 7, wherein ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”,The face detection unit, ๋ณต์ˆ˜ ๊ฐœ์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ, ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€๋ฅผ ํ†ตํ•ด ๊ฐ์ง€๋œ ์›€์ง์ž„ ์ •๋ณด์™€ ์ „๋ถ€ ๋˜๋Š” ์ผ๋ถ€๊ฐ€ ์ค‘์ฒฉ๋˜๋Š” ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.When detecting a plurality of faces, the gesture detection device characterized in that for selecting a gesture detection target for the face overlapping all or part of the motion information detected by the motion detection unit. ์ œ 6ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 6, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”,The gesture detection unit, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์˜ ์œ„์น˜๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์ผ์ • ๋ฒ”์œ„ ์ด๋‚ด์˜ ์˜์—ญ์„ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.Gesture sensing device, characterized in that for setting a region within a predetermined range as a gesture sensing area based on the position of the gesture detection target. ์ œ 6ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 6, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”,The gesture detection unit, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์˜ ์œ„์น˜๋กœ๋ถ€ํ„ฐ ์ผ์ • ๊ฑฐ๋ฆฌ ์ด๊ฒฉ๋œ ์ผ์ • ํฌ๊ธฐ์˜ ์˜์—ญ์„ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.Gesture sensing device, characterized in that for setting a region of a predetermined size spaced apart from the position of the gesture detection target as a gesture sensing area. ์ œ 1ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 1, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”,The gesture detection unit, ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ์˜ ๋ชจ์–‘ ๋ฐ ์›€์ง์ž„ ๋ฐฉํ–ฅ์„ ๊ฐ์ง€ํ•˜๊ณ , ์ด์— ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ์ถœ๋ ฅํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.Gesture detection device for detecting the shape and direction of movement of the user gesture, and outputs a corresponding motion signal. ์ œ 1ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 1, ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋ฅผ ํ†ตํ•ด ์–ผ๊ตด ๊ฐ์ง€์‹œ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๊ฐ€ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•˜๋Š” ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์•Œ๋žŒ ์ •๋ณด๋ฅผ ์ œ๊ณตํ•˜๋Š” ์•Œ๋žŒ๋ถ€;๋ฅผ ๋” ํฌํ•จํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And an alarm unit configured to provide alarm information for a predetermined time when the gesture detection unit detects a user's gesture when detecting a face through the face detection unit. ์›€์ง์ž„ ๊ฐ์ง€๋ถ€, ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€ ๋ฐ ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€๋ฅผ ํฌํ•จํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜์— ์žˆ์–ด์„œ,In the gesture detection device comprising a motion detector, a face / gesture detector and a result output unit, ์‚ฌ์šฉ์ž์˜ ์›€์ง์ž„(๋ชจ์…˜)์„ ๊ฐ์ง€ํ•˜๊ณ , ์›€์ง์ž„ ๊ฐ์ง€์‹œ ์ƒ๊ธฐ ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์›จ์ดํฌ์—…(wake up) ์‹ ํ˜ธ๋ฅผ ์ „๋‹ฌํ•˜๋Š” ์›€์ง์ž„ ๊ฐ์ง€๋ถ€;A motion detection unit for detecting a user's motion (motion) and transmitting a wake up signal to the face / gesture detection unit when the motion is detected; ์ œ1 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋‹ค ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ œ2 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋ฉฐ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•˜๊ณ , ์–ผ๊ตด ๊ฐ์ง€์‹œ ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•˜์—ฌ ๊ฐ์ง€๋œ ์ œ์Šค์ณ์— ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ์ถœ๋ ฅํ•˜๋˜, ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์ด ๊ฐ์ง€๋˜์ง€ ์•Š๊ฑฐ๋‚˜ ์ œ์Šค์ณ๊ฐ€ ๊ฐ์ง€๋˜์ง€ ์•Š์œผ๋ฉด ์ œ1 ์ƒํƒœ๋กœ ๋ณต๊ท€ํ•˜๋Š” ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€; ๋ฐWhen the wake-up signal is received from the motion detection unit, the device operates in the second state for a predetermined time, detects a user's face, and detects a user's gesture for a predetermined time. A face / gesture detection unit that outputs a corresponding operation signal and returns to a first state when a user's face is not detected or a gesture is not detected for a predetermined time; And ์ƒ๊ธฐ ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ˆ˜์‹ ๋œ ๋™์ž‘ ์‹ ํ˜ธ์— ๋Œ€์‘ํ•œ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•˜๋Š” ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€;๋ฅผ ํฌํ•จํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And a result output unit configured to perform an operation corresponding to the operation signal received from the face / gesture detection unit. ์ œ 14ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 14, ์ƒ๊ธฐ ์ œ1 ์ƒํƒœ๋Š” ์ œ2 ์ƒํƒœ์— ๋น„ํ•ด ์ ์€ ๋Ÿ‰์˜ ์ „๋ ฅ์„ ์†Œ๋ชจํ•˜๋Š” ๋™์ž‘ ์ƒํƒœ์ธ ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And wherein the first state is an operating state that consumes less power than the second state. ์ œ 14ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 14, ์ƒ๊ธฐ ์–ผ๊ตด/์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”,The face / gesture detection unit, ์ƒ๊ธฐ ์›€์ง์ž„ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•˜๊ณ  ๊ฐ์ง€๋œ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜๋Š” ์–ผ๊ตด ๊ฐ์ง€๋ถ€; ๋ฐA face detector for detecting a face of a user for a predetermined time and selecting the detected face as a gesture detection target when receiving a wake-up signal from the motion detector; And ์ƒ๊ธฐ ์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์„ ์ •๋œ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์ •๋ณด๋ฅผ ์ „๋‹ฌ๋ฐ›๊ณ , ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์„ค์ •ํ•˜๊ณ  ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์— ๋Œ€ํ•ด์„œ๋งŒ ์ œ์Šค์ณ ๊ฐ์ง€๋ฅผ ์ˆ˜ํ–‰ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€;๋ฅผ ํฌํ•จํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.A gesture detection unit receiving information on the selected gesture detection object from the face detection unit, setting a gesture detection area of the user based on the information on the gesture detection object, and performing gesture detection only on the gesture detection area; Gesture detection device comprising a. ์ œ 16ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 16, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”,The gesture detection unit, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์˜ ์œ„์น˜๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์ผ์ • ๋ฒ”์œ„ ์ด๋‚ด์˜ ์˜์—ญ์„ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.Gesture sensing device, characterized in that for setting a region within a predetermined range as a gesture sensing area based on the position of the gesture detection target. ๋ชจ์…˜/์–ผ๊ตด ๊ฐ์ง€๋ถ€, ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€ ๋ฐ ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€๋ฅผ ํฌํ•จํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜์— ์žˆ์–ด์„œ,In the gesture detection device comprising a motion / face detection unit, a gesture detection unit and a result output unit, ์‚ฌ์šฉ์ž์˜ ์›€์ง์ž„(๋ชจ์…˜)์„ ๊ฐ์ง€ํ•˜๊ณ , ์›€์ง์ž„ ๊ฐ์ง€์‹œ ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด์„ ๊ฐ์ง€ํ•˜๋ฉฐ, ์–ผ๊ตด ๊ฐ์ง€์‹œ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์›จ์ดํฌ์—…(wake up) ์‹ ํ˜ธ๋ฅผ ์ „๋‹ฌํ•˜๋Š” ๋ชจ์…˜/์–ผ๊ตด ๊ฐ์ง€๋ถ€;A motion / face detection unit configured to detect a user's motion (motion), detect a user's face when the motion is detected, and transmit a wake up signal to the gesture detector when the face is detected; ์ œ1 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋‹ค ์ƒ๊ธฐ ๋ชจ์…˜/์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์›จ์ดํฌ์—… ์‹ ํ˜ธ๋ฅผ ์ˆ˜์‹ ํ•˜๊ฒŒ ๋˜๋ฉด ์ผ์ • ์‹œ๊ฐ„ ๋™์•ˆ ์ œ2 ์ƒํƒœ๋กœ ๋™์ž‘ํ•˜๋ฉฐ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ๋ฅผ ๊ฐ์ง€ํ•˜๊ณ  ๋‹ค์‹œ ์ œ1 ์ƒํƒœ๋กœ ๋ณต๊ท€ํ•˜๊ณ , ์ œ์Šค์ณ ๊ฐ์ง€์‹œ ๊ฐ์ง€๋œ ์ œ์Šค์ณ์— ๋Œ€์‘๋˜๋Š” ๋™์ž‘ ์‹ ํ˜ธ๋ฅผ ์ถœ๋ ฅํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€; ๋ฐOperating in the first state When receiving the wake-up signal from the motion / face detection unit, the device operates in the second state for a predetermined time, detects the user's gesture and returns to the first state, and detects the gesture when the gesture is detected. A gesture detector for outputting a corresponding operation signal; And ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ˆ˜์‹ ๋œ ๋™์ž‘ ์‹ ํ˜ธ์— ๋Œ€์‘ํ•œ ๋™์ž‘์„ ์ˆ˜ํ–‰ํ•˜๋Š” ๊ฒฐ๊ณผ ์ถœ๋ ฅ๋ถ€;๋ฅผ ํฌํ•จํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And a result output unit configured to perform an operation corresponding to the operation signal received from the gesture detection unit. ์ œ 18ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 18, ์ƒ๊ธฐ ์ œ1 ์ƒํƒœ๋Š” ์ œ2 ์ƒํƒœ์— ๋น„ํ•ด ์ ์€ ๋Ÿ‰์˜ ์ „๋ ฅ์„ ์†Œ๋ชจํ•˜๋Š” ๋™์ž‘ ์ƒํƒœ์ธ ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And wherein the first state is an operating state that consumes less power than the second state. ์ œ 18ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 18, ์ƒ๊ธฐ ๋ชจ์…˜/์–ผ๊ตด ๊ฐ์ง€๋ถ€๋Š”,The motion / face detection unit, ์‚ฌ์šฉ์ž์˜ ์–ผ๊ตด ๊ฐ์ง€์‹œ ๊ฐ์ง€๋œ ์–ผ๊ตด์„ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์œผ๋กœ ์„ ์ •ํ•˜๊ณ , ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด๋ฅผ ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋กœ ์ถ”๊ฐ€์ ์œผ๋กœ ์ „๋‹ฌํ•˜๊ณ ,Selecting a detected face as a gesture detection target when detecting a user's face, and additionally transmits the position information on the gesture detection target to the gesture detection unit, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”,The gesture detection unit, ์ƒ๊ธฐ ๋ชจ์…˜/์–ผ๊ตด ๊ฐ์ง€๋ถ€๋กœ๋ถ€ํ„ฐ ์ „๋‹ฌ๋ฐ›์€ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์— ๋Œ€ํ•œ ์œ„์น˜ ์ •๋ณด์— ๊ธฐ๋ฐ˜ํ•˜์—ฌ ์‚ฌ์šฉ์ž์˜ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์„ ์„ค์ •ํ•˜๊ณ  ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์— ๋Œ€ํ•ด์„œ๋งŒ ์ œ์Šค์ณ ๊ฐ์ง€๋ฅผ ์ˆ˜ํ–‰ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€;๋ฅผ ํฌํ•จํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.And a gesture detector configured to set a user's gesture detection area based on the location information on the gesture detection object received from the motion / face detection unit and perform gesture detection only for the gesture detection area. Sensing device. ์ œ 20ํ•ญ์— ์žˆ์–ด์„œ,The method of claim 20, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€๋ถ€๋Š”,The gesture detection unit, ์ƒ๊ธฐ ์ œ์Šค์ณ ๊ฐ์ง€ ๋Œ€์ƒ์˜ ์œ„์น˜๋ฅผ ๊ธฐ์ค€์œผ๋กœ ์ผ์ • ๋ฒ”์œ„ ์ด๋‚ด์˜ ์˜์—ญ์„ ์ œ์Šค์ณ ๊ฐ์ง€ ์˜์—ญ์œผ๋กœ ์„ค์ •ํ•˜๋Š” ๊ฒƒ์„ ํŠน์ง•์œผ๋กœ ํ•˜๋Š” ์ œ์Šค์ณ ๊ฐ์ง€ ์žฅ์น˜.Gesture sensing device, characterized in that for setting a region within a predetermined range as a gesture sensing area based on the position of the gesture detection target.
PCT/KR2015/007407 2015-07-16 2015-07-16 Gesture recognition device Ceased WO2017010593A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2015/007407 WO2017010593A1 (en) 2015-07-16 2015-07-16 Gesture recognition device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2015/007407 WO2017010593A1 (en) 2015-07-16 2015-07-16 Gesture recognition device

Publications (1)

Publication Number Publication Date
WO2017010593A1 true WO2017010593A1 (en) 2017-01-19

Family

ID=57757992

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/007407 Ceased WO2017010593A1 (en) 2015-07-16 2015-07-16 Gesture recognition device

Country Status (1)

Country Link
WO (1) WO2017010593A1 (en)

Cited By (3)

* Cited by examiner, โ€  Cited by third party
Publication number Priority date Publication date Assignee Title
CN107422859A (en) * 2017-07-26 2017-12-01 ๅนฟไธœ็พŽ็š„ๅˆถๅ†ท่ฎพๅค‡ๆœ‰้™ๅ…ฌๅธ Regulation and control method, apparatus and computer-readable recording medium and air-conditioning based on gesture
KR20200121513A (en) * 2019-04-16 2020-10-26 ๊ฒฝ๋ถ๋Œ€ํ•™๊ต ์‚ฐํ•™ํ˜‘๋ ฅ๋‹จ Device and method for recognizing motion using deep learning, recording medium for performing the method
KR102437979B1 (en) * 2022-02-22 2022-08-30 ์ฃผ์‹ํšŒ์‚ฌ ๋งˆ์ธ๋“œํฌ์ง€ Apparatus and method for interfacing with object orientation based on gesture

Citations (5)

* Cited by examiner, โ€  Cited by third party
Publication number Priority date Publication date Assignee Title
US20130229508A1 (en) * 2012-03-01 2013-09-05 Qualcomm Incorporated Gesture Detection Based on Information from Multiple Types of Sensors
WO2013133624A1 (en) * 2012-03-06 2013-09-12 ๋ชจ์ ผ์Šค๋žฉ ์ฃผ์‹ํšŒ์‚ฌ Interface apparatus using motion recognition, and method for controlling same
KR20130109031A (en) * 2012-03-26 2013-10-07 ์‹ค๋ฆฌ์ฝคํ…(์ฃผ) Motion gesture recognition module and method for recognizing motion gesture thereof
EP2680191A2 (en) * 2012-06-26 2014-01-01 Google Inc. Facial recognition
US20140368423A1 (en) * 2013-06-17 2014-12-18 Nvidia Corporation Method and system for low power gesture recognition for waking up mobile devices

Patent Citations (5)

* Cited by examiner, โ€  Cited by third party
Publication number Priority date Publication date Assignee Title
US20130229508A1 (en) * 2012-03-01 2013-09-05 Qualcomm Incorporated Gesture Detection Based on Information from Multiple Types of Sensors
WO2013133624A1 (en) * 2012-03-06 2013-09-12 ๋ชจ์ ผ์Šค๋žฉ ์ฃผ์‹ํšŒ์‚ฌ Interface apparatus using motion recognition, and method for controlling same
KR20130109031A (en) * 2012-03-26 2013-10-07 ์‹ค๋ฆฌ์ฝคํ…(์ฃผ) Motion gesture recognition module and method for recognizing motion gesture thereof
EP2680191A2 (en) * 2012-06-26 2014-01-01 Google Inc. Facial recognition
US20140368423A1 (en) * 2013-06-17 2014-12-18 Nvidia Corporation Method and system for low power gesture recognition for waking up mobile devices

Cited By (7)

* Cited by examiner, โ€  Cited by third party
Publication number Priority date Publication date Assignee Title
CN107422859A (en) * 2017-07-26 2017-12-01 ๅนฟไธœ็พŽ็š„ๅˆถๅ†ท่ฎพๅค‡ๆœ‰้™ๅ…ฌๅธ Regulation and control method, apparatus and computer-readable recording medium and air-conditioning based on gesture
CN107422859B (en) * 2017-07-26 2020-04-03 ๅนฟไธœ็พŽ็š„ๅˆถๅ†ท่ฎพๅค‡ๆœ‰้™ๅ…ฌๅธ Gesture-based regulation and control method and device, computer-readable storage medium and air conditioner
KR20200121513A (en) * 2019-04-16 2020-10-26 ๊ฒฝ๋ถ๋Œ€ํ•™๊ต ์‚ฐํ•™ํ˜‘๋ ฅ๋‹จ Device and method for recognizing motion using deep learning, recording medium for performing the method
KR102192051B1 (en) * 2019-04-16 2020-12-16 ๊ฒฝ๋ถ๋Œ€ํ•™๊ต ์‚ฐํ•™ํ˜‘๋ ฅ๋‹จ Device and method for recognizing motion using deep learning, recording medium for performing the method
KR102437979B1 (en) * 2022-02-22 2022-08-30 ์ฃผ์‹ํšŒ์‚ฌ ๋งˆ์ธ๋“œํฌ์ง€ Apparatus and method for interfacing with object orientation based on gesture
KR20230126150A (en) * 2022-02-22 2023-08-29 ์ฃผ์‹ํšŒ์‚ฌ ๋งˆ์ธ๋“œํฌ์ง€ Method for interfacing based on gesture
KR102702165B1 (en) 2022-02-22 2024-09-04 ์ฃผ์‹ํšŒ์‚ฌ ๋งˆ์ธ๋“œํฌ์ง€ Method for interfacing based on gesture

Similar Documents

Publication Publication Date Title
AU2014297039B2 (en) Auto-cleaning system, cleaning robot and method of controlling the cleaning robot
WO2020091505A1 (en) Electronic device and method for intelligent interaction thereof
WO2017039308A1 (en) Virtual reality display apparatus and display method thereof
WO2017119664A1 (en) Display apparatus and control methods thereof
WO2019107741A1 (en) Method for detecting wear using plurality of sensors and electronic device implementing same
EP3281058A1 (en) Virtual reality display apparatus and display method thereof
WO2020180051A1 (en) Electronic apparatus and control method thereof
WO2018009029A1 (en) Electronic device and operating method thereof
EP3281089A1 (en) Smart device and method of operating the same
WO2020059939A1 (en) Artificial intelligence device
WO2019124908A1 (en) Electronic device and method for controlling touch sensor controller on basis of image synchronization signal
WO2020141727A1 (en) Healthcare robot and control method therefor
WO2021047070A1 (en) Terminal photographing method and apparatus, mobile terminal, and readable storage medium
WO2017023140A1 (en) Device and method for managing power in electronic device
WO2009157654A2 (en) Method and apparatus for detecting a slide touch, and recording medium where program for implementing the method is recorded
WO2018143509A1 (en) Moving robot and control method therefor
WO2017215354A1 (en) Measurement gauge data storage method and apparatus
WO2017010593A1 (en) Gesture recognition device
WO2015194697A1 (en) Video display device and operating method thereof
WO2020032668A1 (en) Method and device for processing user input on basis of time during which user input is maintained
WO2020171607A1 (en) Touch circuit for preventing erroneous touch due to temperature change, electronic device comprising touch circuit, and method for operating same
WO2021132743A1 (en) Electronic device for displaying application-related content, and method for controlling same
WO2022019582A1 (en) Robot and control method therefor
WO2018120717A1 (en) Method and device for controlling air conditioner
WO2016080662A1 (en) Method and device for inputting korean characters based on motion of fingers of user

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15898354

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15898354

Country of ref document: EP

Kind code of ref document: A1