CN107647873B

CN107647873B - Emotion detection method and mobile terminal

Info

Publication number: CN107647873B
Application number: CN201710772091.4A
Authority: CN
Inventors: 张恒莉; 杨雪洁; 卢浩
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2017-08-31
Filing date: 2017-08-31
Publication date: 2021-04-02
Anticipated expiration: 2037-08-31
Also published as: CN107647873A

Abstract

Embodiments of the present invention provide an emotion detection method and a mobile terminal. The method is applied in a mobile terminal. The mobile terminal is configured with a molecular sensor, including: driving the molecular sensor to emit near-infrared light to a target user, so that the mobile terminal is configured with a molecular sensor. The molecular sensor receives the hormone characteristic light reflected by the target user; detects hormone type information contained in the target user according to the hormone characteristic light; and uses the hormone type information to generate emotional information of the target user. On the one hand, since the molecular sensor can be miniaturized and configured in a mobile terminal, it is easy to carry, and the hormones originate from the target user itself, and no specific behavior is required, which facilitates the detection of the target user's emotions and improves the simplicity of detection. On the one hand, the mobile terminal can easily detect the target user, and the target user does not need to spend a lot of time filling out the form, which improves the timeliness of detection.

Description

Emotion detection method and mobile terminal

Technical Field

The invention relates to the technical field of communication, in particular to a method for detecting emotion and a mobile terminal.

Background

With the continuous development of society, the rhythm of life of people is faster and faster, and people face more and more psychological pressure while enjoying modern life.

Under the conditions of environmental influence or poor physical state, the mood is easy to fluctuate (such as anxiety, dysphoria and the like), and the physical and mental health of people is not facilitated, even physical and mental injuries are caused.

For example, drivers are prone to road rage caused by driving for a long time, and traffic accidents caused by unstable emotions; mood disorders such as long-term anxiety, phobia, depression, etc. in children are likely to cause mood disorders, etc.

Currently, the emotion can be detected using two methods:

first, detection of emotion is performed using physiological data such as electrocardiogram, pulse, blood pressure, electroencephalogram, or the like, or behavior data such as expression, voice, text, or the like.

Second, emotion detection is performed using a psychological scale, for example, EPQ (Eysenck personalitic questonai), Katel 16 Personality test, MMPI (Minnesota Multipharmaceutical personalitic Inventory, Minnesota) multi-phase Personality test.

However, in the first method, the sensor for detecting the psychological data is complicated, and the user is inconvenient to carry; the behavior data has fewer sources, and the user needs to perform specific behaviors for detection, which causes inconvenient detection and complex operation. In the second method, the user is required to spend a lot of time filling out the form, and timeliness is poor.

Disclosure of Invention

The embodiment of the invention provides an emotion detection method and a mobile terminal, and aims to solve the problems of inconvenience in emotion detection based on psychological data and behavior data, complex operation and poor timeliness of emotion detection based on a psychological scale.

In a first aspect, a method for detecting emotion is provided, and is applied in a mobile terminal, where the mobile terminal is configured with a molecular sensor, and the method includes:

driving the molecular sensor to emit near-infrared light to a target user, wherein the molecular sensor receives hormone characteristic light reflected by the target user;

detecting hormone type information contained in the target user according to the hormone characteristic light;

and generating emotion information of the target user by adopting the hormone category information.

In a second aspect, there is provided a mobile terminal configured with a molecular sensor, the mobile terminal comprising:

the molecular sensor driving module is used for driving the molecular sensor to emit near infrared light to a target user, and the molecular sensor receives hormone characteristic light reflected by the target user;

the hormone detection module is used for detecting the hormone type information contained in the target user according to the hormone characteristic light;

and the emotion information generation module is used for generating the emotion information of the target user by adopting the hormone type information.

In this way, in the embodiment of the present invention, the molecular sensor is configured in the mobile terminal, the molecular sensor emits near infrared light to the target user and receives the reflected hormone characteristic light, and the molecular sensor detects the hormone type information contained in the body of the user by detecting the molecular characteristics of the hormone, so as to generate emotion information for the target user.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.

Fig. 1 is a flowchart of a method of detecting emotion according to an embodiment of the present invention.

Fig. 2 is a schematic view of a state of the near-infrared light irradiation molecule according to an embodiment of the present invention.

Fig. 3 is a schematic structural diagram of a molecular sensor according to an embodiment of the present invention.

Fig. 4 is a schematic structural diagram of a receiver according to an embodiment of the present invention.

Fig. 5 is a schematic diagram of another receiver according to an embodiment of the present invention.

Fig. 6 is a flow chart of another emotion detection method according to an embodiment of the present invention.

FIG. 7 is an infrared spectrum of one embodiment of the present invention.

Fig. 8 is a block diagram of a mobile terminal according to an embodiment of the present invention.

FIG. 9 is a block diagram of a hormone detection module in accordance with one embodiment of the invention.

Fig. 10 is a block diagram of an emotion information generation module according to an embodiment of the present invention.

Fig. 11 is a block diagram of an emotion information generation module according to an embodiment of the present invention.

Fig. 12 is a block diagram of an emotion information inquiry sub-module according to an embodiment of the present invention.

Fig. 13 is a block diagram of another mobile terminal of an embodiment of the present invention.

Fig. 14 is a block diagram of a mobile terminal according to another embodiment of the present invention.

Fig. 15 is a schematic structural diagram of a mobile terminal according to still another embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

First embodiment

Referring to fig. 1, a flowchart of a method for detecting emotion according to an embodiment of the present invention is shown, which may specifically include the following steps:

step 101, driving the molecular sensor to emit near-infrared light to a target user, and receiving the hormone characteristic light reflected by the target user by the molecular sensor.

In a specific implementation, the embodiments of the present invention may be applied to a mobile terminal, for example, a mobile phone, a PDA (Personal Digital Assistant), a laptop computer, a palmtop computer, an intelligent wearable device (such as a bracelet), and the like, which is not limited in this respect. It should be noted that these mobile terminals may be separate mobile terminals, such as separate mobile phones; or a connected mobile terminal, such as a target user wearing intelligent wearing equipment, a mobile phone connected with intelligent wearing equipment; the molecular sensor is configured in the intelligent wearable device, near infrared light is emitted to a target user, the molecular sensor receives hormone characteristic light reflected by the target user, and information obtained after processing is transmitted to the mobile phone.

These mobile terminals can support operating systems such as Android (Android), IOS, windows phone, windows, and the like. In the embodiment of the present invention, the Mobile terminal is configured with a molecular sensor, the molecular sensor accesses to the Processor through an MIPI (Mobile Industry Processor Interface) Interface and an I2C (Inter-Integrated Circuit) Interface, the molecular sensor sends a handshake signal to the Processor through the I2C Interface to notify the Processor that data is to be transmitted, and then transmits the detected data to the Processor through the MIPI Interface for further processing.

As shown in fig. 2, the molecular sensor may emit near infrared light (near IR)201 to a sample to be detected, when the frequency of vibration or rotation of a certain group in the molecule 202 of the sample is the same as the frequency of the near infrared light 201, the molecule 202 absorbs energy, and the molecule 202 transitions from the original ground state vibration (rotation) energy level to a higher energy vibration (rotation) energy level, and after the molecule 202 absorbs infrared radiation, the transition of vibration and rotation energy levels occurs, and light in the wavelength range is absorbed by the sample. Therefore, the molecular sensor receives the light reflected by the sample, analyzes the attenuation degree of the emitted light, and reflects the characteristics of relative vibration between atoms in the sample molecule, molecular rotation and the like, thereby identifying the molecular structure of the sample.

In a particular implementation, as shown in fig. 3, a molecular sensor 300 may include a light source 301 and a receiver 302. Wherein the light source 301 may emit near infrared light; generally, the effective wavelength of the near infrared Light may be 720nm to 1070nm, and the Light source 301 may be an LED (Light-Emitting Diode) Emitting tube, for example. Receiver 302 may be a photosensitive sensor that receives light reflected from the sample; typically, the sensitivity of the receiver 302 is less than 10nm, for example 8 nm. In one example of embodiment of the present invention, the receiver is provided with a multi-stage dispersion device.

As shown in fig. 4, a slit 421 is provided inside the receiver, a mirror 422 is used as a first-stage dispersion device, a grating 423 is used as a second-stage dispersion device, a mirror 424 is used as a third-stage dispersion device, the emitted light 410 enters the slit 421, enters the grating 423 after being reflected by the mirror 422, enters the mirror 424 after being diffracted by the grating 423, and collects a vibration pattern after being reflected by the mirror 424. In this example, the receiver can reflect and diffract the reflected light for multiple times in a short distance, which ensures that the obtained wavelength range is wide and the distance is shortened, so that the size of the molecular sensor can be reduced while ensuring high resolution.

In another example of embodiment of the present invention, as shown in fig. 5, the receiver comprises, in order along the direction of the incident light, a primary lens array 501, a filter array 502, a secondary lens array 503, a micro-pore array 504, a support structure array 505, and a sensor array 506. Light emitted from the sample is irradiated onto the primary lens array 501 to generate diffused light, the diffused light is irradiated onto the filter array 502, and the micropore array 504 prevents crosstalk between filters in the filter array 502. The light passing through filter array 502 is angle coded and passes through secondary lens array 503. secondary lens array 503 performs a fourier transform on the angle coded light to convert it into spatially coded light, and the light reaches sensor array 506. The position of the sensor elements in sensor array 506 is related to the optical axis of the lens array corresponding to the wavelength of the light, and the wavelength for a certain pixel position is determined based on the optical axis of the lens array related to the pixel position. The sensor unit records the light intensity and thus corresponds to the wavelength of the light resolved at that location. In this example, the receiver has a straight optical axis and a short optical path, which enable the molecular sensor to be smaller in size, lower in cost, be incorporated into a mobile terminal, and have sufficient sensitivity and resolution to obtain spectrograms at multiple band wavelengths of the sample.

Of course, the structure of the molecular sensor is only an example, and other structures of the molecular sensor may be set according to actual situations when implementing the embodiment of the present invention, and are not limited herein. In addition, besides the structure of the molecular sensor, those skilled in the art can also adopt other structures of the molecular sensor according to actual needs, and the embodiment of the invention is not limited thereto.

In daily life and work, emotions affect thinking, decision-making, behaviors, social relations, happiness, physical and psychological health and the like of users. So-called mood, which is a reaction to external stimuli and/or internal tokens in effective valence according to a certain model hypothesis, is a combination of psychological states including subjective experience, behavioral expressions (expressions of body, face, language) and peripheral physiological reactions (e.g. heart rate, respiration, etc.) and depends on the interaction of different physiological hormones. Many physiological changes in the process of different emotional characteristics are related to the activities of endocrine glands, wherein the secretory activity of adrenal glands is most closely related to emotion, and is actually one of the main bases for responding to emotion and endocrine response. The adrenal gland is composed of two parts, the cortex and the medulla, which affect emotional behavior through neural and endocrine pathways: the hypothalamus-pituitary-adrenal cortex system, and the hypothalamus-sympathetic nerve-adrenal medulla system. It can be seen that the adrenal glands are innervated by both the autonomic and central nervous systems, which are directly regulated.

1. Hypothalamic-pituitary-adrenal cortex system

When emotion occurs, the hypothalamus delivers Corticotropin Releasing Factor (CRF) which regulates the amount of adrenocorticotropic hormone (ACTH) secreted from the anterior pituitary, which in turn controls adrenocorticotropic steroid secretion and blood concentration. Adrenocortical hormones on the one hand influence the physiological effects of the various organs of the body; on the other hand, the medicine has a feedback regulation effect on the central nervous system and pituitary gland.

Noxious psychological stimuli such as anxiety, anger, fear, etc. can significantly increase ACTH and corticosteroid secretion and lead to a range of physiological effects. For example, when a person is in an anxiety state, peripheral blood vessels contract, blood glucose levels decrease, muscles relax, digestive gland secretory activity decreases, which is associated with increased ACTH and corticosteroid secretion.

2. Hypothalamic-sympathetic-adrenal medullary system

In response to emotional stimuli, sympathetic nerves stimulate both the internal organs and the adrenal medulla. Through the action of neural information, internal organs immediately enter stress activities; the adrenal medulla secretes two hormones, epinephrine and norepinephrine, and promotes physiological stress.

In the embodiment of the invention, the mobile terminal can enable the molecular sensor to face a target user to be detected, and control the molecular sensor to emit near infrared light with a certain wavelength to the target user. Because of its transparency, the near-infrared light can penetrate into the body of the target user, and the molecules (including adrenal hormones) in the body of the target user absorb radiation of certain frequencies and reflect the rest of the light to the molecular sensor, which receives the hormone characteristic light carrying hormone characteristic information.

And 102, detecting hormone type information contained in the target user according to the hormone characteristic light.

In a specific implementation, the hormone characteristic light can reflect the characteristics of the components and the content ratio of the components in the hormone, so as to judge the type of the hormone.

And 103, generating emotion information of the target user by using the hormone category information.

In practical application, corresponding hormone models can be established in advance for different types of emotions and corresponding hormone characteristics, namely, the emotion types and degrees/grades of the users can be described by the hormone models.

If the type, concentration and change rate of concentration of the hormone of the target user are detected currently, matching information suitable for the hormone model can be searched in the hormone model, emotion information marked by the matching information is extracted, and the current emotion information of the target user is generated.

Second embodiment

Referring to fig. 6, a flow chart of another emotion testing method according to an embodiment of the present invention is shown, and is applied in a mobile terminal, where the mobile terminal is configured with a molecular sensor, and the method may specifically include the following steps:

step 601, driving the molecular sensor to emit near-infrared light to a target user, and receiving the hormone characteristic light reflected by the target user by the molecular sensor.

And step 602, drawing a hormone infrared spectrogram by using the hormone characteristic light.

When infrared light with a certain frequency passes through the molecule, the infrared light is absorbed by the bond with the same vibration frequency in the molecule, and the obtained transmittance curve is recorded and called as an infrared spectrogram.

In one representation of the infrared spectrogram, the abscissa is the wavelength λ (μm) and/or the wavenumber 1/λ (cm)^-1) And the ordinate is the absorbance a.

In another representation of the infrared spectrogram, the abscissa is the wavelength λ (. mu.m) and/or the wavenumber 1/λ (cm)^-1) The ordinate is the percent transmission T% (i.e. the percentage of light transmitted through the sample).

The molecular sensor is used for emitting near infrared light to a sample and receiving light reflected by the sample, and an infrared spectrogram can be drawn by utilizing the emitted light.

For example, as shown in fig. 7, when the molecular sensor emits near-infrared light toward the desktop, the desk has different components such as wood, paint, etc., and different molecular bonds react with the near-infrared light of different wavelengths, so that an infrared spectrum can be drawn by using the reflected light.

In the embodiment of the invention, the hormone infrared spectrogram can be drawn by adopting the hormone characteristic light reflected by the target user, so as to obtain the hormone infrared spectrogram. The attenuation degree of near infrared light with different wavelengths after being reflected is measured through a hormone infrared spectrogram, the characteristics of molecular components in the hormone can be reflected, and therefore the type and content proportion information of the hormone can be judged.

Step 603, matching the hormone infrared spectrogram with a preset target infrared spectrogram.

The target infrared spectrogram is obtained by detecting a sample user containing specified hormone by adopting near infrared light.

And step 604, inquiring hormone type information corresponding to the target infrared spectrogram as hormone type information contained in the target user when matching is successful.

In a specific implementation, the mobile terminal may search a preset and corresponding target infrared spectrogram according to the hormone category information, where the target infrared spectrogram is an infrared spectrogram obtained by detecting a sample user containing a specified hormone by using near-infrared light.

In one approach, a spectrogram database may be created at the server, in which are stored infrared spectrograms for a plurality of samples, which may include those obtained from the detection of a sample user containing a specified hormone using near infrared light.

The spectrogram database may be maintained by a network-wide user, that is, the network-wide user may mark information (such as name, variety, and the like) of a certain sample after detecting the infrared spectrogram of the sample using a molecular sensor, and upload the information to a server, or may be maintained by a professional detection mechanism, that is, after the detection mechanism detects the infrared spectrogram of a certain sample using an infrared spectrometer or other device or a molecular sensor, the information (such as water content, sugar content, and the like) of the sample is marked, and upload the information to a server, and so on.

In this way, the mobile terminal can send a hormone detection request to the server, and the server queries the infrared spectrogram of the specified hormone in the spectrogram database according to the detection request to serve as the target infrared spectrogram.

In another approach, a library of cell spectra may be created for a sample in a spectral database, and infrared spectra of samples having the same characteristics may be stored in one of the cell spectra libraries.

For example, a library of cell spectra is created for the fifth edition of Renminbi, for apples at different times (e.g., growth period, maturity period, removed, etc.), for human bodies at different body temperatures, and so on

The user can download one or more cell spectrum libraries from the server and store the cell spectrum libraries locally in the mobile terminal according to the requirements.

For example, if a user runs a store and the currency of the banknote is very fluid, a library of cell spectra created for the fifth edition of RMB could be downloaded.

In this way, the cell spectrum library of the hormone can be stored locally in the mobile terminal, and the infrared spectrum is searched in the cell spectrum library of the hormone to be used as the target infrared spectrum.

If the target infrared spectrogram is stored in the server, the server can calculate the similarity between the hormone infrared spectrogram and the target infrared spectrogram and feed back the calculation result to the mobile terminal.

If the target infrared spectrogram is stored in the mobile terminal, the mobile terminal can calculate the similarity between the hormone infrared spectrogram and the target infrared spectrogram. If the similarity is higher than a preset threshold, the two matching can be considered to be successful, otherwise, the two matching is considered to be failed. If the hormone infrared spectrogram is successfully matched with the preset target infrared spectrogram, the fact that the hormone in the current body of the target user and the hormone in the body of the sample user have the same components is indicated, and the fact that the hormone in the body of the target user has the same type of hormone of the sample user can be considered.

And step 605, detecting content information of the hormone corresponding to the hormone type information in the target user.

In one embodiment, while a sample user containing a given hormone is detected by near-infrared light and an infrared spectrogram is obtained, the content of the hormone in the sample user can be detected, and a correlation between the infrared spectrogram and content information is established for the hormone.

In this embodiment, the content information of the hormone corresponding to the target infrared spectrogram successfully matched (with the hormone infrared spectrogram) can be extracted according to the correlation, and the content information of the hormone can be set as the content information of the hormone corresponding to the hormone type information in the target user (i.e. in vivo).

And 606, generating emotion information of the target user according to the hormone category information and the content information.

In one embodiment, an emotion mapping table may be established in advance for different emotions and their corresponding hormonal characteristics as a hormonal model. Wherein, the emotion mapping table records the emotion information corresponding to the hormone types and the content ranges thereof with mapping relations.

In this embodiment, the emotion mapping table may be searched according to the hormone category information and the content information, corresponding emotion information corresponding to the hormone category information and the content information may be determined in the emotion mapping table, and the emotion information may be extracted to generate emotion information of the target user.

And 607, counting the emotion information to obtain statistical information when the emotion information belongs to a preset negative emotion type.

By applying the embodiment of the invention, part of the emotion information can be set as negative emotion types in advance, such as anxiety, horror, depression and the like.

These negative Mood types are clinical manifestations of some target users with affective Disorders (food Disorders), such as Major depression (Major depression Disorder), minor depression (dynamic Disorder), and so on. For these target users with affective disorders, emotional monitoring thereof may be enhanced.

In a specific implementation, if it is detected that the emotion information of the target user belongs to a negative emotion type, information such as a duration, a frequency, environmental information (e.g., a place, a song being played, a video being played, etc.) of the target user may be counted.

And 608, generating emotion prompt information when the statistical information meets a preset condition.

In the embodiment of the invention, different conditions can be set for different statistical information, and if the conditions are met, the condition that the user is in an unstable emotion state can be shown.

For example, for the duration, a duration threshold may be set as a condition; for the frequency, a frequency threshold value can be set as a condition; for the environment information, specific environment information (such as a specific place, a specific song, a specific video, etc.) may be set as a condition, and the like.

If the statistical information obtained by counting the emotions of the target user satisfies the corresponding condition, it can indicate that the target user is in an emotional unstable state, and generate the corresponding emotional alert information, for example, "xiaoming is in a worried state for 2 hours, please note".

Step 609, sending the emotion prompt information to a related mobile terminal to display the emotion prompt information.

By applying the embodiment of the invention, the mobile terminals of other users (such as guardians, community nursing staff, attending doctors and the like) can be associated with the mobile terminal of the target user.

The emotion prompt information generated aiming at the target user can be sent to the associated mobile terminal, the emotion prompt information is displayed in the associated mobile terminal, and other users are prompted to carry out treatment such as nursing and psychotherapy on the target user.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Third embodiment

Referring to fig. 8, which is a block diagram illustrating a mobile terminal according to an embodiment of the present invention, the mobile terminal 800 shown in fig. 8 is configured with a molecular sensor, which may specifically include the following modules:

a molecular sensor driving module 801, configured to drive the molecular sensor to emit near-infrared light to a target user, where the molecular sensor receives hormone feature light reflected by the target user;

a hormone detection module 802, configured to detect, according to the hormone feature light, hormone category information included in the target user;

and an emotion information generation module 803, configured to generate emotion information of the target user by using the hormone category information.

In one embodiment of the present invention, referring to the block diagram of the hormone detection module shown in fig. 9, the hormone detection module 802 may further include the following sub-modules:

the hormone infrared spectrogram drawing submodule 8021 is used for drawing a hormone infrared spectrogram by adopting the hormone characteristic light;

a target infrared spectrogram matching sub-module 8022, configured to match the hormone infrared spectrogram with a preset target infrared spectrogram;

and the hormone query submodule 8023 is configured to query, when the matching is successful, hormone category information corresponding to the target infrared spectrogram, as the hormone category information included in the target user.

In an embodiment of the present invention, referring to a block diagram of the emotion information generation module shown in fig. 10, the emotion information generation module 803 may further include the following sub-modules:

a content information detection submodule 8031, configured to detect content information of the hormone corresponding to the hormone category information in the target user;

and the content information generating submodule 8032 is configured to generate emotion information of the target user according to the hormone category information and the content information.

In an embodiment of the present invention, referring to the block diagram of the content information detection sub-module shown in fig. 11, the content information detection sub-module 8031 further includes the following units:

the content information extraction unit 80311 is used for extracting content information of hormone corresponding to the successfully matched target infrared spectrogram;

a content information setting unit 80312, configured to set the content information of the hormone as content information of the hormone corresponding to the hormone category information in the target user.

In an embodiment of the present invention, referring to the block diagram of the content information generation sub-module shown in fig. 12, the content information generation sub-module 8032 may further include the following units:

an emotion mapping table search unit 80321, configured to search an emotion mapping table according to the hormone category information and the content information;

an emotion information determination unit 80322, configured to determine, in the emotion mapping table, emotion information corresponding to the hormone category information and the content information;

and an emotion information extraction unit 80323, configured to extract the emotion information, and generate emotion information of the target user.

On the basis of fig. 8, optionally, referring to fig. 13, the mobile terminal 800 may further include the following modules:

the emotion information counting module 804 is used for counting the emotion information to obtain statistical information when the emotion information belongs to a preset negative emotion type;

an emotion prompt information generation module 805, configured to generate emotion prompt information when the statistical information meets a preset condition;

an emotional prompt information sending module 806, configured to send the emotional prompt information to an associated mobile terminal, so as to display the emotional prompt information.

Third embodiment

Fig. 14 is a block diagram of a mobile terminal according to another embodiment of the present invention. The mobile terminal 1400 shown in fig. 14 includes: at least one processor 1401, memory 1402, at least one network interface 1404, other user interfaces 1403, and molecular sensors 1406. The various components in mobile terminal 1400 are coupled together by bus system 1405. It will be appreciated that bus system 1405 is used to enable communications among the components connected. The bus system 1405 includes a power bus, a control bus, and a status signal bus, in addition to the data bus. For clarity of illustration, however, the various buses are labeled as bus system 1405 in fig. 14.

User interface 1403 may include, among other things, a display, a keyboard, or a pointing device (e.g., a mouse, trackball, touch pad, or touch screen, among others.

It will be appreciated that the memory 1402 in embodiments of the invention may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile memory may be a Read-only memory (ROM), a programmable Read-only memory (PROM), an erasable programmable Read-only memory (erasabprom, EPROM), an electrically erasable programmable Read-only memory (EEPROM), or a flash memory. The volatile memory may be a Random Access Memory (RAM) which functions as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (staticiram, SRAM), dynamic random access memory (dynamic RAM, DRAM), synchronous dynamic random access memory (syncronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM ), Enhanced Synchronous DRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1402 of the systems and methods described in connection with the embodiments of the invention is intended to comprise, without being limited to, these and any other suitable types of memory.

In some embodiments, memory 1402 stores elements, executable modules or data structures, or a subset thereof, or an expanded set thereof as follows: an operating system 14021 and application programs 14022.

The operating system 14021 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, for implementing various basic services and processing hardware-based tasks. The application 14022 contains various applications, such as a media player (MediaPlayer), a Browser (Browser), and the like, for implementing various application services. A program implementing a method according to an embodiment of the invention may be included in the application 14022.

In the embodiment of the present invention, the processor 1401 is configured to drive the molecular sensor to emit near infrared light to a target user, and the molecular sensor receives hormone feature light reflected by the target user, by calling a program or an instruction stored in the memory 1402, specifically, a program or an instruction stored in the application 14022; detecting hormone type information contained in the target user according to the hormone characteristic light; and generating emotion information of the target user by adopting the hormone category information.

The methods disclosed in the embodiments of the present invention described above may be applied to the processor 1401, or may be implemented by the processor 1401. Processor 1401 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by instructions in the form of hardware integrated logic circuits or software in the processor 1401. The processor 1401 may be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory 1402, and a processor 1401 reads information in the memory 1402 and performs the steps of the above method in combination with hardware thereof.

It is to be understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or any combination thereof. For a hardware implementation, the processing units may be implemented within one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units configured to perform the functions described herein, or a combination thereof.

For a software implementation, the techniques described in this disclosure may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described in this disclosure. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.

Optionally, the processor 1401 is further configured to: drawing a hormone infrared spectrogram by using the hormone characteristic light; matching the hormone infrared spectrogram with a preset target infrared spectrogram; and when the matching is successful, inquiring hormone type information corresponding to the target infrared spectrogram to serve as the hormone type information contained in the target user.

Optionally, the processor 1401 is further configured to: detecting content information of hormone corresponding to the hormone category information in the target user; and generating emotion information of the target user according to the hormone type information and the content information.

Optionally, the processor 1401 is further configured to: extracting hormone content information corresponding to the successfully matched target infrared spectrogram; and setting the content information of the hormone as the content information of the hormone corresponding to the hormone category information in the target user.

Optionally, the processor 1401 is further configured to: searching an emotion mapping table according to the hormone type information and the content information; determining emotion information corresponding to the hormone type information and the content information in the emotion mapping table; and extracting the emotion information to generate the emotion information of the target user.

Optionally, the processor 1401 is further configured to: when the emotion information belongs to a preset negative emotion type, counting the emotion information to obtain statistical information; generating emotion prompt information when the statistical information meets a preset condition; and sending the emotion prompt information to an associated mobile terminal to display the emotion prompt information.

The mobile terminal 1400 can implement each process implemented by the mobile terminal in the foregoing embodiments, and is not described here again to avoid repetition.

Fifth embodiment

Fig. 15 is a schematic structural diagram of a mobile terminal according to another embodiment of the present invention. Specifically, the mobile terminal 1500 in fig. 15 may be a mobile phone, a tablet computer, a Personal Digital Assistant (PDA), or a vehicle-mounted computer.

The mobile terminal 1500 in fig. 15 includes a Radio Frequency (RF) circuit 1510, a memory 1520, an input unit 1530, a display unit 1540, a processor 1560, an audio circuit 1570, a wifi (wireless fidelity) module 1580, a power supply 1590, and a molecular sensor 1591.

The input unit 1530 may be used, among other things, to receive numeric or character information input by a user and to generate signal inputs related to user settings and function control of the mobile terminal 1500. Specifically, in the embodiment of the present invention, the input unit 1530 may include a touch panel 1531. The touch panel 1531, also referred to as a touch screen, can collect touch operations of a user (e.g., operations of the user on the touch panel 1531 by using a finger, a stylus, or any other suitable object or accessory) thereon or nearby, and drive the corresponding connection device according to a preset program. Alternatively, the touch panel 1531 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts it to touch point coordinates, and sends the touch point coordinates to the processor 1560, and can receive and execute commands from the processor 1560. In addition, the touch panel 1531 may be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1531, the input unit 1530 may also include other input devices 1532, and the other input devices 1532 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

Among other things, the display unit 1540 may be used to display information input by the user or information provided to the user, and various menu interfaces of the mobile terminal 1500. The display unit 1540 may include a display panel 1541, and optionally, the display panel 1541 may be configured in the form of an LCD or an organic light-emitting diode (OLED).

It should be noted that the touch panel 1531 may cover the display panel 1541 to form a touch display screen, and when the touch display screen detects a touch operation thereon or nearby, the touch display screen is transmitted to the processor 1560 to determine the type of touch event, and then the processor 1560 provides a corresponding visual output on the touch display screen according to the type of touch event.

The touch display screen comprises an application program interface display area and a common control display area. The arrangement modes of the application program interface display area and the common control display area are not limited, and can be an arrangement mode which can distinguish two display areas, such as vertical arrangement, left-right arrangement and the like. The application interface display area may be used to display an interface of an application. Each interface may contain at least one interface element such as an icon and/or widget desktop control for an application. The application interface display area may also be an empty interface that does not contain any content. The common control display area is used for displaying controls with high utilization rate, such as application icons like setting buttons, interface numbers, scroll bars, phone book icons and the like.

The processor 1560 is a control center of the mobile terminal 1500, connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions of the mobile terminal 1500 and processes data by operating or executing software programs and/or modules stored in the first memory 1521 and calling data stored in the second memory 1522, thereby performing overall monitoring of the mobile terminal 1500. Processor 1560 may include one or more processing units.

In an embodiment of the present invention, the processor 1560 is configured to drive the molecular sensor to emit near infrared light to the target user by invoking a software program and/or module stored in the first memory 1521 and/or data stored in the second memory 1522, and the molecular sensor receives the hormone signature light reflected by the target user; detecting hormone type information contained in the target user according to the hormone characteristic light; and generating emotion information of the target user by adopting the hormone category information.

Optionally, processor 1560 is also configured to: drawing a hormone infrared spectrogram by using the hormone characteristic light; matching the hormone infrared spectrogram with a preset target infrared spectrogram; and when the matching is successful, inquiring hormone type information corresponding to the target infrared spectrogram to serve as the hormone type information contained in the target user.

Optionally, processor 1560 is also configured to: detecting content information of hormone corresponding to the hormone category information in the target user; and generating emotion information of the target user according to the hormone type information and the content information.

Optionally, processor 1560 is also configured to: extracting hormone content information corresponding to the successfully matched target infrared spectrogram; and setting the content information of the hormone as the content information of the hormone corresponding to the hormone category information in the target user.

Optionally, processor 1560 is also configured to: searching an emotion mapping table according to the hormone type information and the content information; determining emotion information corresponding to the hormone type information and the content information in the emotion mapping table; and extracting the emotion information to generate the emotion information of the target user.

Optionally, processor 1560 is also configured to: when the emotion information belongs to a preset negative emotion type, counting the emotion information to obtain statistical information; generating emotion prompt information when the statistical information meets a preset condition; and sending the emotion prompt information to an associated mobile terminal to display the emotion prompt information.

Therefore, in the embodiment of the invention, the molecular sensor is configured in the mobile terminal, the molecular sensor emits near infrared light to the target user and receives the reflected hormone characteristic light, and the molecular sensor detects the hormone type information contained in the body of the user by detecting the molecular characteristics of the hormone, so that the emotion information is generated for the target user.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A method for detecting emotion, wherein the method is applied to a mobile terminal, and the mobile terminal is provided with a molecular sensor, and the method comprises the following steps:

the hormone type information comprises hormone type information, concentration information and change rate information of the concentration;

generating emotion information of the target user by adopting the hormone category information;

wherein the step of detecting the hormone kind information included in the target user based on the hormone feature light includes:

drawing a hormone infrared spectrogram by using the hormone characteristic light;

matching the hormone infrared spectrogram with a preset target infrared spectrogram;

when the matching is successful, inquiring hormone type information corresponding to the target infrared spectrogram to serve as hormone type information contained in the target user;

the target infrared spectrogram is an infrared spectrogram obtained by detecting a sample containing specified hormone by adopting near infrared light, and the infrared spectrogram is stored in a spectrogram database, wherein the spectrogram database comprises information for marking the sample after detecting the infrared spectrogram of the sample by using a molecular sensor;

wherein after the step of generating mood information of the target user using the hormone category information, the method further comprises:

when the emotion information belongs to a preset negative emotion type, counting the emotion information to obtain statistical information; the statistical information comprises duration information, frequency information and environment information;

generating emotion prompt information when the statistical information meets a preset condition;

sending the emotion prompt information to an associated mobile terminal to display the emotion prompt information;

the emotion information is generated by searching matching information suitable for the type information of the hormone, the concentration information and the change rate information of the concentration in a hormone model and extracting emotion information marked by the matching information, wherein the hormone model is established for different types of emotions and corresponding hormone characteristics in advance;

the molecular sensor comprises a light source and a receiver;

a slit is arranged in the receiver, the reflector is used as a first-stage dispersion device, the grating is used as a second-stage dispersion device, the reflector is used as a third-stage dispersion device, emitted light enters the slit, enters the grating after being reflected by the reflector, enters the reflector after being diffracted by the grating, and is reflected by the reflector to acquire a vibration spectrum.

2. The method of claim 1, wherein the step of using the hormone category information to generate mood information for the target user comprises:

detecting content information of hormone corresponding to the hormone category information in the target user;

and generating emotion information of the target user according to the hormone type information and the content information.

3. The method according to claim 2, wherein the step of detecting the content information of the hormone corresponding to the hormone category information in the target user comprises:

extracting hormone content information corresponding to the successfully matched target infrared spectrogram;

and setting the content information of the hormone as the content information of the hormone corresponding to the hormone category information in the target user.

4. The method of claim 2, wherein the step of generating mood information of the target user according to the hormone kind information and the content information comprises:

searching an emotion mapping table according to the hormone type information and the content information;

determining emotion information corresponding to the hormone type information and the content information in the emotion mapping table;

and extracting the emotion information to generate the emotion information of the target user.

5. A mobile terminal, characterized in that the mobile terminal is configured with a molecular sensor, the mobile terminal comprising:

the hormone detection module is used for detecting the hormone type information contained in the target user according to the hormone characteristic light; the hormone type information comprises hormone type information, concentration information and change rate information of the concentration;

the emotion information generation module is used for generating emotion information of the target user by adopting the hormone category information;

wherein the hormone detection module comprises:

the hormone infrared spectrogram drawing submodule is used for drawing a hormone infrared spectrogram by adopting the hormone characteristic light;

the target infrared spectrogram matching sub-module is used for matching the hormone infrared spectrogram with a preset target infrared spectrogram;

the hormone inquiry submodule is used for inquiring the hormone type information corresponding to the target infrared spectrogram when the matching is successful, and the hormone type information is used as the hormone type information contained in the target user;

wherein, still include:

the emotion information counting module is used for counting the emotion information to obtain statistical information when the emotion information belongs to a preset negative emotion type; the statistical information comprises duration information, frequency information and environment information;

the emotion prompt information generation module is used for generating emotion prompt information when the statistical information meets a preset condition;

the emotion prompt information sending module is used for sending the emotion prompt information to an associated mobile terminal so as to display the emotion prompt information;

the molecular sensor comprises a light source and a receiver;

6. The mobile terminal of claim 5, wherein the emotion information generation module comprises:

the content information detection submodule is used for detecting the content information of the hormone corresponding to the hormone category information in the target user;

and the content information generation submodule is used for generating the emotion information of the target user according to the hormone type information and the content information.

7. The mobile terminal of claim 6, wherein the content information detection sub-module comprises:

the content information extraction unit is used for extracting the content information of the hormone corresponding to the successfully matched target infrared spectrogram;

and the content information setting unit is used for setting the content information of the hormone as the content information of the hormone corresponding to the hormone category information in the target user.

8. The mobile terminal of claim 6, wherein the content information generation sub-module comprises:

the emotion mapping table searching unit is used for searching an emotion mapping table according to the hormone type information and the content information;

the emotion information determining unit is used for determining emotion information corresponding to the hormone category information and the content information in the emotion mapping table;

and the emotion information extraction unit is used for extracting the emotion information and generating the emotion information of the target user.