[go: up one dir, main page]

WO2017204373A1 - Système de détermination d'indice émotionnel utilisant un changement multisensoriel et procédé associé - Google Patents

Système de détermination d'indice émotionnel utilisant un changement multisensoriel et procédé associé Download PDF

Info

Publication number
WO2017204373A1
WO2017204373A1 PCT/KR2016/005492 KR2016005492W WO2017204373A1 WO 2017204373 A1 WO2017204373 A1 WO 2017204373A1 KR 2016005492 W KR2016005492 W KR 2016005492W WO 2017204373 A1 WO2017204373 A1 WO 2017204373A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
multisensory
sensory
signal change
environmental
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2016/005492
Other languages
English (en)
Korean (ko)
Inventor
황민철
이양우
김삼이
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Brighttech Co Ltd
Industry Academic Cooperation Foundation of Sangmyung University
Original Assignee
Brighttech Co Ltd
Industry Academic Cooperation Foundation of Sangmyung University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Brighttech Co Ltd, Industry Academic Cooperation Foundation of Sangmyung University filed Critical Brighttech Co Ltd
Priority to PCT/KR2016/005492 priority Critical patent/WO2017204373A1/fr
Publication of WO2017204373A1 publication Critical patent/WO2017204373A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state

Definitions

  • the present invention relates to a system and method for determining an emotional index using multiple sensory changes, and more particularly, to a system and method for determining an emotional index using multiple sensory changes for determining an emotional index according to a multisensory change of a subject. It is about.
  • Emotion index is a concept that contrasts with intelligence index and refers to social indexes such as positive thinking about self and interpersonal ability.
  • intelligence index refers to social indexes such as positive thinking about self and interpersonal ability.
  • interpersonal relationships become important according to the personalization tendency of members of society, interest in emotional index is increasing.
  • emotional index is a criterion for hiring or evaluating personnel.
  • the research history of the emotional index is shorter than the intelligence index, so the method of evaluating the emotional index is limited, and most of them are evaluated through the response process to the question, so it can be manipulated artificially, so that the objectivity and accuracy of the emotional index are not guaranteed. There is a problem.
  • the present invention has been made in an effort to provide a system and method for determining an emotional index using multiple sensory changes for determining an emotional index according to a multisensory change of a subject.
  • the emotional index determination method using a multi-sensory change in the emotional index determination method using a emotional index determination system comprising a plurality of sensors and the emotional index determination server, A sensor generating a multisensory signal by sensing a subject and generating an environment signal by sensing a surrounding environment of the subject, wherein the emotion index determination server of the multisensory signal and the environmental signal received from the plurality of sensors Extracting the multisensory signal change amount and the environmental signal change amount by analyzing the magnitude, calculating the multisensory signal change level and the environment signal change level using the multisensory signal change amount and the environmental signal change amount and respective reference values, and By using the difference value between the multisensory signal change level and the environment signal change level, Determining the emotional index.
  • the multi-sensory signal may include at least one of an olfactory signal, a tactile signal, a taste signal, an auditory signal, and a visual signal.
  • the reference value includes a multisensory signal reference value corresponding to a multisensory signal change amount and an environmental signal reference value corresponding to an environmental signal change amount
  • the calculating of the multisensory signal change level and the environmental signal change level comprises: the multisensory signal
  • the multisensory signal change level may be calculated by dividing a change amount by the multisensory signal reference value
  • the environment signal change level may be calculated by dividing the change amount of the environmental signal by an environment signal reference value.
  • the determining of the emotion index of the subject may include calculating a difference value between the multisensory signal change level and an environment signal change level, and converting the calculated difference value into a difference value between the multisensory signal change level and an environment signal change level. Comparing the emotional index values according to the range with the stored look-up table, and as a result of the comparison, determining the emotional index value corresponding to the calculated difference value as the emotional index of the subject.
  • the method may further include selecting and providing the emotion management service corresponding to the determined emotion index to the user.
  • a system for determining an emotional index using a multisensory change generates a multisensory signal by sensing a subject and a plurality of sensors for generating an environment signal by sensing the environment of the subject, and the multisensory And an emotion index determination server for determining the emotion index of the subject by using a signal and an environment signal, wherein the emotion index determination server analyzes the multisensory signals and environmental signals transmitted from the plurality of sensors and multisensory.
  • a change amount extracting unit for extracting a signal change amount and an environmental signal change amount for extracting a signal change amount and an environmental signal change amount, a change level calculating unit calculating a multi-sensory signal change level and an environment signal change level using the multi-sensory signal change amount and the environmental signal change amount, and respective reference values, and the multi-sensory
  • the emotional index of the subject is determined by using the difference between the signal change level and the environmental signal change level.
  • Emotion index determination unit is included.
  • the emotional index is determined in consideration of the change in the multisensory signal and the environmental signal and the correlation between each other, the emotional index can be accurately determined.
  • an objective emotional index can be obtained by using a multisensory signal reflecting olfactory, tactile, taste, auditory, and visual information, which are difficult to control artificially.
  • FIG. 1 is a view for explaining an emotional index determination system using a multi-sensory change according to an embodiment of the present invention.
  • FIG. 2 is a flowchart illustrating a method of determining an emotional index using the emotional index determining system according to an exemplary embodiment of the present invention.
  • Emotion index determination system using a multi-sensory change according to an embodiment of the present invention includes a plurality of sensors 100 and the emotional index determination server 200, may further include a user terminal (300).
  • the plurality of sensors 100 generate a multisensory signal by sensing a subject, and generate an environment signal by sensing a surrounding environment of the subject.
  • the sensor 100 includes an EEG measurement sensor for generating a multisensory signal, a camera sensor for generating environmental information, a microphone sensor, and a gas sensor.
  • the sensor 100 senses information according to the five sense stimulus responses applied to the subject. It may further include a device capable of.
  • the EEG sensor may generate a multisensory signal by sensing an EEG generated by the five sense stimuli applied to the subject.
  • the gas sensor may generate an environmental signal by measuring the type and concentration of gas around the subject, and the microphone sensor may generate an environmental signal by measuring the noise level around the subject.
  • the camera sensor may generate an environmental signal by measuring the degree of congestion around the subject.
  • the multi-sensory signal may include at least one of an olfactory signal, a tactile signal, a taste signal, an auditory signal, and a visual signal according to the five senses stimulus applied to the subject.
  • the emotional index determination server 200 determines the emotional index of the subject using the multi-sensory signal and the environmental signal.
  • the emotional index determination server 200 includes a variation extracting unit 210, a change level setting unit 220, and an emotional index determining unit 230, and further includes a service providing unit 240. Can be.
  • the change amount extracting unit 210 extracts the multisensory signal change amount and the environmental signal change amount by analyzing the multisensory signals and environmental signals received from the plurality of sensors 100.
  • the change extracting unit 210 may extract the change in the multisensory signal and the change in the environmental signal by analyzing the change in the magnitude of the multisensory signal and the environment signal. The amount of change in multisensory signals and the amount of change in environmental signals can be extracted.
  • the change level calculator 220 calculates the multisensory signal change level and the environment signal change level using the multisensory signal change amount and the environment signal change amount and respective reference values.
  • the reference value includes a multisensory signal reference value corresponding to the multisensory signal change amount and an environmental signal reference value corresponding to the environment signal change amount.
  • the change level setting unit 220 may calculate the multisensory signal change level by dividing the multisensory signal change amount by the multisensory signal reference value, and calculate the environment signal change level by dividing the environment signal change amount by the environment signal reference value.
  • the emotional index determiner 230 determines the emotional index of the subject using the difference between the multisensory signal change level and the environmental signal change level. Specifically, the emotional index determiner 230 calculates a difference value between the multisensory signal change level and the environmental signal change level, and uses the calculated difference value as an emotion according to the difference value range of the multisensory signal change level and the environmental signal change level. The index value is compared with a stored lookup table, and the emotional index value corresponding to the calculated difference value is determined as the emotional index of the subject.
  • the service provider 240 selects and provides the emotion management service corresponding to the determined emotion index to the user. Meanwhile, the service provider 240 may communicate with the user terminal 300 by wire or wirelessly, and transmit the selected emotion management service to the user terminal 300.
  • the user terminal 300 outputs the emotion management service received from the service provider 240 to the subject. Meanwhile, the user terminal 300 may be connected to the plurality of sensors 100 by wire or wirelessly to receive a multisensory signal and an environment signal, and then transmit the same to the emotion index determination server 200.
  • FIG. 2 is a flowchart illustrating a method of determining an emotional index using the emotional index determining system according to an exemplary embodiment of the present invention.
  • the plurality of sensors 100 generate a multisensory signal by sensing a subject and generate an environment signal by sensing a surrounding environment of the subject (S210).
  • the multisensory signal is a signal for the biological response of the subject according to the five senses stimulus applied to the subject, and the olfactory signal by the olfactory stimulus, the tactile signal by the tactile stimulus, the taste signal by the taste stimulus, and the auditory stimulus. It may include at least one of an audio signal and a visual signal by a visual stimulus.
  • the environmental signal means a signal for the five senses stimulus applied to the subject by the surrounding environment of the subject.
  • the emotional index determination server 200 analyzes the multi-sensory signals and environmental signals received from the plurality of sensors 100 to extract the multi-sensory signal change amount and the environmental signal change amount (S220). Specifically, the emotional index determination server 200 may extract the multisensory signal change amount and the environmental signal change amount by analyzing the change in the magnitude of the multisensory signal and the environmental signal.
  • the emotional index determination server 200 extracts the multi-sensory signal change amount and the environmental signal change amount during the same time interval corresponding to each other, which is a correlation between the five sense stimuli recognized by the subject in response to external stimuli. This is to reflect the sentiment index. If the time interval from which the multisensory signal change amount is extracted and the time interval from which the environmental signal change amount is extracted are different from each other, the correlation between the multisensory signal and the environmental signal is sparse and thus an incorrect emotional index may be determined.
  • the multisensory signal change amount and the environmental signal change amount may be extracted through the sum of the respective signals.
  • the emotion index determination server 200 integrates the magnitude change of the sum of the auditory signal and the visual signal of the same time zone and multi-sensory. The amount of signal change can be extracted.
  • the emotion index determination server 200 sets the multisensory signal change level and the environmental signal change level using the multisensory signal change amount and the environment signal change amount and respective reference values (S230).
  • the reference value includes a multisensory signal reference value corresponding to the multisensory signal change amount and an environmental signal reference value corresponding to the environment signal change amount.
  • the multisensory signal change level is 1.5. If the environmental signal change amount is 20 and the environmental signal reference value is 15, the environmental signal change level is 4/3.
  • the emotion index determination server 200 calculates a difference value between the multisensory signal change level and the environment signal change level (S240). In detail, the emotion index determination server 200 calculates a difference value by subtracting the multisensory signal change level from the environment signal change level.
  • the emotional index determination server 200 compares the calculated difference value with a lookup table in which the emotional index value according to the difference value range of the multisensory signal change level and the environmental signal change level is stored (S250). In accordance with the comparison result, the emotional index value corresponding to the calculated difference value is determined as the emotional index of the subject (S260).
  • Table 1 is a table showing a lookup table according to an embodiment of the present invention.
  • the difference value is -1.667, so the calculated difference value is in the range of -0.17 to -0.16 compared to the lookup table of Table 1. Belongs. Therefore, the emotional index of the subject is determined to be 24.5 points.
  • the emotion index determination server 200 selects and provides the emotion management service corresponding to the determined emotion index to the user (S270).
  • the emotion management service is a service that helps to control emotions. For example, when the emotion index of the subject is low, it means that it is difficult to control the emotion change on its own. Or image content.
  • the emotional index is determined in consideration of the change of the multisensory signal and the environmental signal and the correlation between each other, the emotional index can be accurately determined.
  • an objective emotional index can be obtained by using a multisensory signal reflecting olfactory, tactile, taste, auditory, and visual information, which are difficult to control artificially.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Pathology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Child & Adolescent Psychology (AREA)
  • Developmental Disabilities (AREA)
  • Educational Technology (AREA)
  • Hospice & Palliative Care (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

La présente invention concerne un système de détermination d'indice émotionnel utilisant un changement multisensoriel et un procédé associé. Selon la présente invention, le procédé de détermination d'indice émotionnel utilisant un changement multisensoriel, c'est-à-dire, le procédé de détermination d'indice émotionnel utilisant un système de détermination d'indice émotionnel qui comprend une pluralité de capteurs et un serveur de détermination d'indice émotionnel, comprend les étapes de : génération d'un signal multisensoriel par détection d'une personne à mesurer et génération d'un signal d'environnement par détection d'un environnement périphérique de la personne à mesurer, par la pluralité de capteurs ; analyse de l'intensité du signal multisensoriel et du signal d'environnement reçus depuis la pluralité de capteurs et extraction de la quantité de changement du signal multisensoriel et de la quantité de changement du signal d'environnement, par le serveur de détermination d'indice émotionnel ; calcul d'un taux de changement du signal multisensoriel et d'un taux de changement du signal d'environnement, au moyen de la quantité de changement du signal multisensoriel, la quantité de changement du signal d'environnement, et chaque valeur de référence de ceux-ci ; et détermination d'un indice émotionnel de la personne à mesurer au moyen d'une valeur de différence du taux de changement du signal multisensoriel et d'une valeur de différence du taux de changement du signal d'environnement. Par conséquent, selon la présente invention, un indice émotionnel est déterminé en tenant compte d'un changement du signal multisensoriel, d'un changement d'un signal d'environnement, et d'une corrélation mutuelle entre les deux signaux, et peut ainsi être déterminé avec précision. En outre, la présente invention utilise un signal multisensoriel reflétant des informations olfactives, tactiles, gustatives, auditives et visuelles difficiles à contrôler artificiellement, et peut ainsi acquérir un indice émotionnel objectif.
PCT/KR2016/005492 2016-05-24 2016-05-24 Système de détermination d'indice émotionnel utilisant un changement multisensoriel et procédé associé Ceased WO2017204373A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2016/005492 WO2017204373A1 (fr) 2016-05-24 2016-05-24 Système de détermination d'indice émotionnel utilisant un changement multisensoriel et procédé associé

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2016/005492 WO2017204373A1 (fr) 2016-05-24 2016-05-24 Système de détermination d'indice émotionnel utilisant un changement multisensoriel et procédé associé

Publications (1)

Publication Number Publication Date
WO2017204373A1 true WO2017204373A1 (fr) 2017-11-30

Family

ID=60411462

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2016/005492 Ceased WO2017204373A1 (fr) 2016-05-24 2016-05-24 Système de détermination d'indice émotionnel utilisant un changement multisensoriel et procédé associé

Country Status (1)

Country Link
WO (1) WO2017204373A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113840629A (zh) * 2019-05-08 2021-12-24 柯泰克股份有限公司 上外侧内侧前脑束的自适应深部脑刺激

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080046644A (ko) * 2005-08-09 2008-05-27 아이캡 테크놀로지스 인코포레이티드 사람의 감정 상태에 관한 장치 및 방법
JP4272702B2 (ja) * 2006-11-15 2009-06-03 パナソニック株式会社 脳波識別方法の調整装置、方法およびコンピュータプログラム
KR20110065954A (ko) * 2009-12-10 2011-06-16 한국전자통신연구원 감성 변화에 따른 감성지수 결정 장치 및 그 방법
KR20130129710A (ko) * 2012-05-21 2013-11-29 상명대학교서울산학협력단 뇌 기능 연결성 분석을 이용한 감성 판단 방법 및 이를 적용하는 시스템
US20150230744A1 (en) * 2012-08-10 2015-08-20 Valorisation-Recherche, Limited Partnership Method and system for assessing a stimulus property perceived by a subject

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20080046644A (ko) * 2005-08-09 2008-05-27 아이캡 테크놀로지스 인코포레이티드 사람의 감정 상태에 관한 장치 및 방법
JP4272702B2 (ja) * 2006-11-15 2009-06-03 パナソニック株式会社 脳波識別方法の調整装置、方法およびコンピュータプログラム
KR20110065954A (ko) * 2009-12-10 2011-06-16 한국전자통신연구원 감성 변화에 따른 감성지수 결정 장치 및 그 방법
KR20130129710A (ko) * 2012-05-21 2013-11-29 상명대학교서울산학협력단 뇌 기능 연결성 분석을 이용한 감성 판단 방법 및 이를 적용하는 시스템
US20150230744A1 (en) * 2012-08-10 2015-08-20 Valorisation-Recherche, Limited Partnership Method and system for assessing a stimulus property perceived by a subject

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113840629A (zh) * 2019-05-08 2021-12-24 柯泰克股份有限公司 上外侧内侧前脑束的自适应深部脑刺激

Similar Documents

Publication Publication Date Title
Owsley Contrast sensitivity.
JP5448199B2 (ja) 感性状態判定装置
WO2020138720A1 (fr) Système et procédé pour fournir et analyser des informations d'aliment fonctionnel diététique personnalisées relatives à la peau
WO2020138718A1 (fr) Système et procédé d'analyse et de fourniture d'informations cosmétiques personnalisées
WO2017007259A1 (fr) Appareil de mesure d'état d'aliment, module de mesure d'état d'aliment, et appareil intelligent le comprenant
WO2015076617A1 (fr) Dispositif et procédé de prédiction de l'âge de la peau à l'aide d'un moyen de quantification
Liu et al. Simple model for encoding natural images by retinal ganglion cells with nonlinear spatial integration
JPWO2022098459A5 (fr)
WO2016186363A1 (fr) Dispositif et procédé pour réaliser un test de personnalité
WO2016186362A1 (fr) Dispositif et procédé permettant de fournir des informations sur l'état psychologique d'un utilisateur reflété par du texte
EP3223252A1 (fr) Système et procédé de surveillance de comportement anormal
CN115032250B (zh) 酒精浓度检测方法和装置、可穿戴设备及存储介质
CN103903002B (zh) 环境亮度检测方法和系统
WO2019240322A1 (fr) Procédé et appareil de mesure d'influence par utilisation d'un réseau social
WO2019035691A2 (fr) Procédé, système et support d'enregistrement non transitoire lisible par ordinateur pour fournir un service sur la base d'informations génétiques
Prabu et al. A Deep Learning Model for Identifying and Analyzing Eating Disorder-Related Communication on Social Media
WO2017204373A1 (fr) Système de détermination d'indice émotionnel utilisant un changement multisensoriel et procédé associé
CN113990500A (zh) 一种生命体征参数的监测方法、装置以及储存介质
WO2012057389A1 (fr) Système d'extraction d'une zone cible à l'aide d'une pluralité de caméras et son procédé
WO2014208937A1 (fr) Procédé de détection de site d'hameçonnage faisant appel à une comparaison d'image et appareil associé
WO2016186301A1 (fr) Dispositif de mesure d'état d'aliment et système de mesure d'état d'aliment l'utilisant
US12219297B2 (en) Image processing system and method
JP2017035198A (ja) 情報処理システム、情報処理方法、情報処理装置、及び情報処理プログラム
Daisy et al. Early-stage depression detector using IoMT
Mattavelli et al. The “Happy Face Killer” in the eyes of the beholder: Relational encoding of facial emotions in context influences trustworthiness attributions

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16903221

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 16903221

Country of ref document: EP

Kind code of ref document: A1