WO2015176287A1 - Method and apparatus for communication by using text information - Google Patents

Abstract

Embodiments of the present invention provide a method and apparatus for communication by using text information. In the present invention, a facial image of a user who is inputting text information is acquired; an emotion of the user is recognized according to the facial image; and text information that indicates the recognized emotion is determined and sent according to the emotion and the text information to be sent. By means of the present invention, the sent text information for indicating an emotion of a user can express the emotion of the user, and by combining the text information with the emotion, the semantics of the text information sent by the user can be clearly expressed, and the accuracy of information expression can be improved.

Description

 Method and device for applying text information for communication

 The present invention relates to the field of communications technologies, and in particular, to a method and apparatus for communicating text information. Background technique

 With the rapid development of communication technologies, mobile terminals are becoming more and more powerful, and the scope of use and environment are becoming more diverse. For example, mobile terminals, personal digital assistants, and personal computers are currently used in various mobile terminals. Kind of instant messaging software to communicate.

 When the mobile terminal uses the instant messaging software to communicate, text information, voice, and pictures can be transmitted when the communication service data is transmitted. At present, the application of text information for data transmission of communication services is more common in the application of voice and pictures for communication service data transmission. When text information is used for communication service data transmission, the text information sent is the original text information input by the user. However, the same text information sent by the user in different scenarios may express different semantics, for example, the user sends in different emotions. The same text content will express different emotions of the user. The emotions may include the most basic emotional expressions such as emotions, such as "we break up". This text message is sent when the user is joking, and the expression is more happy. Emotions can be sent when the user is more serious. The expression will be more sentimental emotions. Therefore, the existing way of applying text information to communicate is difficult to accurately express the user's emotions, and the accuracy of information expression is not high. Summary of the invention

 Embodiments of the present invention provide a method and apparatus for applying text information for communication to improve the accuracy of information expression.

 In a first aspect, a method for applying text information for communication includes:

 Obtaining a facial image of the user;

 Identifying an expression of the user according to the facial image;

Determining and transmitting a text message characterizing the expression according to the expression and text information to be sent Interest.

 In combination with the first aspect, in a first implementation manner, the method further includes:

 Obtain the voice information of the user;

 Identifying the user's expression based on the facial image includes:

 Identifying an initial expression of the user according to the facial image;

 And correcting the initial expression according to the voice information to obtain a corrected expression; and using the corrected expression as a user's expression.

 With reference to the first aspect or the first implementation manner of the first aspect, in the second implementation manner, determining, according to the expression and the text information to be sent, the text information that is used to represent the expression, includes:

 Calling an emoticon to characterize the expression;

 Sending the emoticon and the text information to be sent.

 With reference to the first aspect or the first implementation manner of the first aspect, in a third implementation manner, determining, according to the expression and the text information to be sent, the text information that is used to represent the expression, includes:

 Obtaining a text format corresponding to the recognized expression according to a mapping relationship between different expressions and different text formats;

 The text format of the text information to be transmitted is modified to the obtained text format, and the modified text information is sent.

 With reference to the first aspect or the first implementation manner of the first aspect, in a fourth implementation manner, determining, according to the expression and the text information to be sent, the text information that is used to represent the expression, includes:

 Calling an emoji to characterize the expression, and

 Obtaining a text format corresponding to the recognized expression according to a mapping relationship between different expressions and different text formats;

Modifying a text format of the text information to be sent into the obtained text format, and transmitting the emoticon and the modified text information. In combination with the second implementation manner of the first aspect or the fourth implementation manner of the first aspect, in the fifth implementation manner, sending the emoji and the text information includes:

 Attach an emoji to the text message;

 Sending text information to which the emoji is attached.

 In combination with any of the foregoing implementation manners of the first aspect, in the sixth implementation manner, before determining the text information that represents the expression, the method further includes:

 Make sure the user has not entered text information for the set length of time.

 With reference to any of the foregoing implementation manners of the first aspect, in the seventh implementation manner, before acquiring the facial image of the user, the method includes:

 When detecting that the preset opening control for processing the text information to be sent is turned on, starting the imaging device for acquiring the facial image of the user;

 Get the user's facial image, including:

 The facial image of the user is acquired by the activated imaging device.

 With reference to the second implementation manner of the first aspect, the fourth implementation manner of the first aspect, the fifth implementation manner of the first aspect, or the sixth implementation manner of the first aspect, in the eighth implementation manner, The emoji includes at least one of an emoticon picture, a symbol combination, and an emoticon animation.

 In a second aspect, a method for applying text information for communication includes:

 Receiving text information;

 Parsing the text format of the text information;

 Obtaining an expression corresponding to the text format according to a mapping relationship between different expressions and different text formats;

 Decrypting an emoticon to characterize the expression according to the expression;

 The received text information and the emoji are displayed.

 In a third aspect, an apparatus for applying text information for communication is provided, the apparatus comprising an acquiring unit, an identifying unit, a determining unit, and a sending unit, where

 The acquiring unit is configured to acquire a facial image of the user;

The identifying unit is configured to identify, according to the facial image acquired by the acquiring unit User's expression;

 The determining unit is configured to determine, according to the text information to be sent and the expression recognized by the identifying unit, text information that represents the expression;

 The sending unit is configured to send text information that is determined by the determining unit and that represents the expression. With reference to the third aspect, in a first implementation, the acquiring unit is further configured to: obtain voice information of a user;

 The identification unit is configured to:

 Identifying an initial expression of the user according to the facial image;

 And correcting the initial expression according to the voice information to obtain a corrected expression; and using the corrected expression as a user's expression.

 With reference to the third aspect, or the first implementation manner of the third aspect, in the second implementation manner, the determining unit is configured to:

 After the recognition unit recognizes the expression of the user, an emoticon for characterizing the expression is invoked;

 The sending unit is configured to:

 Sending the emoji and text information to be sent.

 With reference to the third aspect, or the first implementation manner of the third aspect, in a third implementation manner, the determining unit is configured to:

 After the recognition unit identifies the user's expression, according to the mapping relationship between different expressions and different text formats, the text format corresponding to the recognized expression is obtained, and the text format of the text information to be sent is modified into the acquired location. Text format

 The sending unit is configured to:

 Send the modified text information.

 With reference to the third aspect, or the first implementation manner of the third aspect, in the fourth implementation manner, the determining unit is configured to:

After the recognition unit recognizes the expression of the user, the emoticon used to represent the expression is invoked, and Obtaining a text format corresponding to the recognized expression according to a mapping relationship between different expressions and different text formats, and modifying a text format of the text information to be sent into the obtained text format; the sending unit is configured to send The emoji and the modified text information.

 With the second implementation of the third aspect, or the fourth implementation manner of the third aspect, in a fifth implementation manner, the determining unit is configured to: add an emoticon to the text information; a sending unit, configured to: send text information to which the emoji is attached.

 With reference to any one of the foregoing implementation manners of the third aspect, in a sixth implementation manner, the determining unit is configured to:

 Before determining the textual information characterizing the expression, it is determined that the user has not entered the text information for the set length of time.

 In combination with any of the foregoing implementations of the third aspect, the apparatus further includes a detecting unit and a starting unit, where

 The detecting unit is configured to detect an open state of a preset open control for processing text information to be sent;

 The initiating unit is configured to: when the detecting unit detects that the preset opening control for processing the text information to be sent is turned on, starting an imaging device for acquiring a facial image of the user; In:

 The facial image of the user is acquired by the activated imaging device.

 With reference to the second implementation manner of the third aspect, the fourth implementation manner of the third aspect, the fifth implementation manner of the third aspect, or the sixth implementation manner of the third aspect, in the eighth implementation manner, The emoticon called by the determining unit includes at least one of an emoticon picture, a symbol combination, and an emoticon animation.

 In a fourth aspect, an apparatus for applying text information for communication is provided, the apparatus comprising a receiving unit, a parsing unit, an obtaining unit, a calling unit, and a display unit, where

 The receiving unit is configured to receive text information;

The parsing unit is configured to parse a text format of the text information received by the receiving unit, and the acquiring unit is configured to obtain a mapping relationship between different emoticons and different text formats. Taking an expression corresponding to the text format parsed by the parsing unit;

 The calling unit is configured to invoke an emoticon to represent the emoticon according to the expression acquired by the acquiring unit;

 The display unit is configured to display text information received by the receiving unit and the emoticon called by the calling unit.

 A fifth aspect, an apparatus for applying text information for communication, including an input device, a transmitter, a processor, a memory, and a bus, wherein the input device, the transmitter, and the memory pass through the bus The processor is connected, wherein

 The memory is configured to store program code executed by the processor;

 The input device is configured to acquire a facial image of the user;

 The processor is configured to invoke a program stored in the memory, and a facial image acquired by the input device, identify an expression of the user according to the facial image, and determine, according to the text information to be sent and the expression Characterizing the textual information of the expression;

 The transmitter is configured to send text information that characterizes the expression.

 With reference to the fifth aspect, in a first implementation manner, the input device is further configured to:

 Obtain the voice information of the user;

 The processor is configured to: according to the facial image, identify an expression of the user: according to the facial image, identify an initial expression of the user;

 And correcting the initial expression according to the voice information to obtain a corrected expression; and using the corrected expression as a user's expression.

 With reference to the fifth aspect, or the first implementation manner of the fifth aspect, in a second implementation manner, the processor is configured to:

 After identifying the user's expression, calling an emoticon to characterize the expression; the transmitter, for:

 Sending text information to be sent and the emoticon called by the processor.

With reference to the fifth aspect, or the first implementation manner of the fifth aspect, in a third implementation manner, the processor is configured to: After identifying the user's expression, obtaining a text format corresponding to the recognized expression according to a mapping relationship between different expressions and different text formats;

 Modifying a text format of the text information to be sent into the obtained text format;

 The transmitter is configured to:

 Send the modified text information.

 With reference to the fifth aspect, or the first implementation manner of the fifth aspect, in a fourth implementation manner, the processor is configured to:

 After identifying the expression of the user, calling the emoticon used to represent the expression, and acquiring a text format corresponding to the recognized expression according to a mapping relationship between different expressions and different text formats, and transmitting the text information to be sent The text format is modified to the obtained text format; the transmitter is configured to:

 Sending an emoticon called by the processor and the modified text information of the processor.

 With reference to the second implementation manner of the fifth aspect, or the fourth implementation manner of the fifth aspect, in a fifth implementation manner, the processor is configured to:

 Attach an emoji to the text message;

 The transmitter is configured to:

 Sending text information to which the emoji is attached.

 With reference to any of the foregoing implementation manners of the fifth aspect, in a sixth implementation manner, the processor is configured to:

 Before determining the textual information characterizing the expression, it is determined that the user has not entered the text information for the set length of time.

 With reference to any one of the foregoing implementation manners of the fifth aspect, in a seventh implementation manner, the processor is configured to detect a preset state of an open control for processing text information to be sent; When the detector detects that the preset opening control for processing the text information to be sent is turned on, the camera device for acquiring the facial image of the user is activated;

The processor is configured to acquire a facial image of the user by using the camera device that is activated. Combining the second implementation manner of the fifth aspect, the fourth implementation manner of the fifth aspect, and the fifth party The fifth implementation manner of the fifth aspect, or the sixth implementation manner of the fifth aspect, in the eighth implementation manner, the emoticon invoked by the processor includes at least one of an emoticon image, a symbol combination, and an emoticon animation.

 According to a sixth aspect, an apparatus for applying text information for communication includes an output device, a receiver, a processor, a memory, and a bus, wherein the output device, the receiver, the processor, and the memory are both Connected to the bus, wherein

 The memory is configured to store program code executed by the processor;

 The receiver is configured to receive text information;

 The processor is configured to invoke a program stored in the memory, parse a text format of the text information received by the receiver, and acquire a mapping corresponding to the text format according to a mapping relationship between different expressions and different text formats. An expression; an emoticon for characterizing the expression is invoked according to the expression;

 The output device is configured to output text information received by the transceiver and an emoticon called by the processor.

 The method and device for transmitting text by using the text information provided by the embodiment of the present invention obtains the facial expression of the user by obtaining the obtained facial image of the user, and determines and sends the text representing the facial expression of the user according to the obtained user facial expression and the text information to be sent. The information of the user can express the user's current emotion more accurately. Therefore, the text information of the sent user's expression can express the user's emotion through the invention, and the text information and the emotion can be combined to express the user clearly. The semantics of textual information improves the accuracy of information expression. DRAWINGS

 FIG. 1 is a flowchart of a first method for implementing text message communication according to an embodiment of the present invention;

 FIG. 2 is a flowchart of a second method for implementing text message communication according to an embodiment of the present invention;

FIG. 3 is a flowchart of a third method for implementing text information communication according to an embodiment of the present invention; Figure

 FIG. 4 is a flowchart of a fourth method for implementing text information communication according to an embodiment of the present invention;

 FIG. 5 is a flowchart of a fifth method for implementing text message communication according to an embodiment of the present invention;

 6A is a first structural diagram of an apparatus for transmitting text information by using an embodiment of the present invention;

 6B is a second structural diagram of an apparatus for communicating text information according to an embodiment of the present invention;

 FIG. 7 is a third structural diagram of an apparatus for communicating text information according to an embodiment of the present invention;

 FIG. 8 is a fourth structural diagram of an apparatus for communicating text information by using an embodiment of the present invention; FIG.

 FIG. 9 is a fifth structural diagram of an apparatus for communicating text information according to an embodiment of the present invention. detailed description

 The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without making creative labor are within the scope of the present invention.

The mobile terminal can provide a function for the user to communicate with the application text information such as short message transmission, and the process of applying the text information for communication, usually the text initiator inputs the text information, and then sends the input completed text information to the target reception. In addition, the communication between the sender and the receiver is implemented. The embodiment of the invention provides a method for applying text information to communicate, and sending the user's emotion to the target receiver through the text information input by the message initiator, so that the target receiver can combine the emotion of the message initiator and the content of the text message. Get exactly what the message originator wants The semantics of expression.

 FIG. 1 is a flowchart of a method for communicating text information by using an embodiment of the present invention. As shown in FIG. 1, the method includes:

 S101: Acquire a facial image of the user.

 Specifically, in the embodiment of the present invention, the sensor with the image collection function in the mobile terminal can be activated to collect the facial image of the user, for example, the facial image of the user can be collected by a camera disposed on the smart phone. .

 In the embodiment of the present invention, the user may select when to obtain the facial image of the user according to the actual situation. For example, in the embodiment of the present invention, the facial image may be acquired when the user opens the text input box, or after the user completes the text information input. , to obtain facial images.

 S102: Identify the user's expression according to the acquired facial image.

 In the embodiment of the present invention, the facial feature information of the user can be obtained according to the facial image acquired in S102. The facial feature information of the user may include information such as a lip angle, a pupil width, and a face length width. Based on the obtained facial feature information, the user's expression can be determined. For example, according to the obtained facial feature information such as the lip angle, the pupil width and the face length, the basic mouth opening state, the eye closing state, and the face changing state can be obtained, and then the user and the empirical model can be combined to determine the user. Expression.

 In the embodiment of the present invention, the face image collected by the face recognition technology can be recognized by using a face recognition technology to obtain an expression of the user. The specific implementation of the face recognition technology in the embodiments of the present invention may employ a face recognition technology such as an overall recognition method, a local recognition method, a deformation extraction method, a motion extraction method, a geometric feature method, or a face feature method in the prior art.

 For example, in the embodiment of the present invention, when the face recognition method is used for face recognition, the bottom-up manner can be used to find representative structural features (eyes, nose, mouth, etc.) on the human face, and extract the edges, Characteristics such as brightness, deformation, texture, and color are compared with the overall features for face detection and recognition.

S103: Determine and transmit text information representing the expression recognized in S102 according to the text information to be transmitted and the expression recognized in S102. In the embodiment of the present invention, the text information to be sent may be processed according to the text information to be sent and the user expression determined in S102, and the text information to be sent is processed into a form capable of expressing the user's expression, and the text information is processed. The form is sent, that is, the text information representing the recognized expression is sent.

 The text information to be sent in the embodiment of the present invention may be the text information directly input by the user in the text input box by using the input method, or may be the text information that is copied and pasted in the text input box, which is to be sent in the embodiment of the present invention. The text information may also be text information obtained by converting the voice information, which is not limited in the embodiment of the present invention.

 Optionally, in the embodiment of the present invention, according to the text information to be sent and the user expression determined in S102, text information representing the recognized expression is determined and sent, and various manners may be flexibly selected, for example, text information that can be sent along with the user. Sending some emoticons that characterize the user's expression, which may be, for example, at least one of an emoticon, a combination of symbols, and an emoticon. In the embodiment of the present invention, a text format representing different expressions may be preset, and after the user's expression is determined, the text format of the input text information is modified, for example, the font color or font size is modified, so that the modified text format can be expressed. User's expression. The facial image of the user is obtained, and the user's expression is obtained, and according to the obtained user's expression and the text information to be sent, the text information representing the user's expression is determined and transmitted, and the user's expression can accurately express the current emotion of the user, so the present invention is The sent text information representing the user's expression can express the user's emotion. Through the combination of the text information and the emotion, the semantics of the text information sent by the user can be clearly expressed, and the accuracy of the information expression can be improved.

 Optionally, in the embodiment of the present invention, in order to further improve the accuracy of the information expression, in addition to acquiring the facial image of the user, the embodiment of the present invention may also collect the voice information of the user, and use the voice information to identify the expression according to the facial image. For correction, the specific implementation process can be as shown in Figure 2.

 SlOla: Get the face image of the user.

The process of obtaining the image of the user's face in the embodiment of the present invention is similar to the step S101 in the foregoing embodiment, and details are not described herein again. SlOlb: Get the user's voice information.

 Specifically, the language signals of different language tones have different structural features and distribution rules in terms of time structure, amplitude structure, fundamental frequency configuration, and formant structure. In the embodiment of the present invention, a voice input device such as a microphone can be used. The voice signal of the user who inputs the text information is collected and input, and then the voice signal collected and input is applied to further improve the accuracy of the expression recognition.

 It should be noted that, in the embodiment of the present invention, the execution order of the SlOla and the SlOlb is in no particular order, and the SlOla may be executed first, or the SlOlb may be executed first, which is not limited in the embodiment of the present invention.

 Optionally, in the embodiment of the present invention, the process of determining the expression of the user in S102 may be implemented in the following manner:

 S102a: According to the facial image acquired in the SlOla, the initial expression of the user is recognized. S102b: Correct the initial expression determined in S102a according to the voice information acquired in the SlOlb, obtain the corrected expression, and use the corrected expression as the expression of the user.

 In the embodiment of the present invention, the expression recognized by the facial image is corrected by the voice information, and the corrected expression is used as the expression of the user, which can improve the accuracy of the expression recognition and further improve the accuracy of the information expression.

 For example, in the embodiment of the present invention, the initial expression recognized by the user's facial image is an expression that the user is unhappy. When the expression is corrected by the voice information, the initial expression of the recognition may be corrected by the size of the voice spoken by the user, when the user speaks the voice. When it is relatively large, the user's expression is considered to be anger. When the user's voice is relatively small, the user's expression is considered sad.

 It should be further noted that, in the embodiment of the present invention, the execution order of SlOlb and S102a is not in any order, and S102a may be executed first, or S101b may be executed first.

 S103: Determine and send text information that represents a user's expression

Optionally, in the embodiment of the present invention, an open control for processing whether to send the text information may be set, and the user may control whether the open information is opened or not according to an actual situation, and select whether to process the text information to be sent as capable of being characterized. The form of the user's expression. For example, an open control for triggering processing of the text information may be preset in the display interface of the mobile terminal. In the detection of the pre When the open control for processing the text information is turned on, the sensor for acquiring the facial image of the user can be started, and the corresponding information is collected. For example, the sensor can be an imaging device disposed in the mobile terminal, and the camera device is The user's facial image is collected.

 Of course, the sensor activated in the embodiment of the present invention may further comprise a sound collecting device, and the voice information of the user is collected by the sound collecting device.

 In the embodiment of the present invention, according to the text information to be sent and the recognized user expression, the text information representing the recognized user expression is determined and sent, which may be preferably as follows:

 A: The emoticon used to represent the recognized expression is called, and the called emoticon and the text information to be sent are sent.

 B: obtaining a text format corresponding to the recognized expression according to a mapping relationship between different expressions and different text formats; modifying a text format of the text information to be sent into the obtained text format, and transmitting the modified text information .

 C: calling an emoticon for characterizing the expression, and obtaining a text format corresponding to the recognized expression according to a mapping relationship between different expressions and different text formats; modifying a text format of the text information to be sent to the acquired Text format, and send the called emoji and modified text information. The method is described in detail.

 In a preferred embodiment of the present invention, an emoticon for characterizing an expression is first sent as an example for explanation.

 In the embodiment of the present invention, the user A sends the text information content "we break up" to the user B as an example, and the specific implementation process is as shown in FIG. 3:

 S201: User A starts an open control for processing the text information to be sent.

 S202: Start an imaging device that acquires a facial image of the user A.

 S203: The camera device collects the face image of the user A and recognizes the expression of the user A.

 In the embodiment of the present invention, it is assumed that the user A is a user who is joking with the user B and is recognized by the camera device.

A's expression is a smiley face. S204: Call an emoticon to represent the recognized expression according to the expression recognized in S203. Specifically, the emoticon used to represent the recognized expression in the embodiment of the present invention may include at least one of an emoticon picture, a symbol combination, and an emoticon animation.

 In the embodiment of the present invention, the emoticons sent in the embodiment of the present invention may use different calling modes, for example, the emoticons are emoticons and emoticons. In the embodiment of the present invention, the emoticons corresponding to the currently recognized emoticons may be called from the emoticon database. The picture serves as the desired emoji. For example, if the emoji is a symbol combination, in the embodiment of the present invention, the corresponding symbol can be called from the symbol database and combined into an emoji that represents the currently recognized expression.

 S205: Send the emoji and the text information input by the user to the user B.

 Specifically, in the embodiment of the present invention, the emoticon and the text information input by the user may be sent in time, or may be simultaneously sent. In the embodiment of the present invention, the emoticon is preferably attached to the text information input by the user, and then the text information to which the emoticon is attached is transmitted.

In the embodiment of the present invention, an emoticon representing a smiley face may be added to the text information, and an emoticon indicating a smiley face may be added. For example, in the embodiment of the present invention, an emoticon ^Λ - ^Λ is added to the text information, and an emoticon is attached. The text message can be expressed as "We break up, ^Λ - ^Λ ".

 In the embodiment of the present invention, the user inputs the text information in the text input box as an example. Alternatively, in the embodiment of the present invention, the input of the original text information is not affected, and the user may input the sentence or input after the input is completed. An emoticon characterizing the emoticon is attached to the text information. Generally, the user inputs the sentence or completes the input of the text information, which can be generally reflected in the duration of the user inputting the text. The embodiment of the present invention can monitor the state of the user inputting the text information; and the user does not input the text information during the set time period. When the input text information is attached, an emoticon characterizing the recognized expression is attached. The duration of the above settings can be customized by the user, for example, the duration can be set to 1.5 seconds.

 Of course, the form of adding the emoticon in the embodiment of the present invention is not limited to the above manner. For example, in the embodiment of the present invention, the system may also perform the adding port of the emoticon after the system detects that the user submits the input completion operation.

In the embodiment of the present invention, the text information sent to the user 表征 to represent the user's Α expression is “we break up, ^Λ — ^Λ ”, and is not the user's original input text information “we break up”, so it is used After receiving the text information, the user B can know that the user A is happy now, and then it can be known that the user A is joking.

Incidentally, embodiments of the present invention is added to the end of the text information entered by the user emoticon ^{Λ - Λ,} is a schematic illustration only, the lead that is not limited, for example, may be added at the front end of the input text information, of course, The emoji can also be other emoji such as an emoticon animation.

 It should be further noted that, after performing S203 in the embodiment of the present invention, the voice information of the user may be acquired by using the voice collection device, the expression determined in S203 is corrected, the corrected expression is obtained, and the corrected expression is obtained. Expression, as the user's expression. The facial image of the user obtains the expression of the user, and the corresponding emoticon is called according to the obtained facial expression of the user, and the text information representing the emoticon is sent in the form of the emoticon and the original text information to be sent, so that the sent text information can express the user's Emotion, through the combination of text information and emotions, can more clearly express the semantics of text information sent by users and improve the accuracy of information expression.

 Another embodiment of the present invention is described by taking a text format of a modified text information as an example. The embodiment of the present invention still uses the user A to send the text information content "We break up" to the user B as an example, and the specific implementation process is as shown in FIG. 4:

 S301: User A starts an open control for processing the text information to be sent.

 S302: Start an imaging device that acquires facial feature information of the user A.

 S303: The camera device collects the face image of the user A and recognizes the expression of the user A.

 In the embodiment of the present invention, it is assumed that the user A is joking with the user B, and the expression of the user A recognized by the camera device is a smiley expression.

 S304: Obtain a text format corresponding to the recognized case according to a mapping relationship between different expressions and different text formats.

In the embodiment of the present invention, a mapping relationship between different expressions and different text formats is preset, for example, a happy, happy, and the like corresponds to a text format in which the font is a square body, the font color is yellow, and the font size is a fourth size; Expressions such as sadness correspond to text formats in which the font is bold, the font color is red, and the font size is number 3. After the user's expression that is inputting the text information is identified in the embodiment of the present invention, the text format corresponding to the recognized expression may be obtained according to the mapping relationship between the preset, different expressions and different text formats.

 For example, in the embodiment of the present invention, the expression of the user A recognized by the camera device is a smiley face expression, and the text format in which the font is a square book body, the font color is yellow, and the font size is four.

 S305: Modify the text format of the text information input by the user to the obtained text format, and send the modified text information to the user B.

 Specifically, in the embodiment of the present invention, the text format of the text information "we break up" input by the user may be modified into a text format in which the font is a square book body, the font color is yellow, and the font size is four, and then the modified text is sent. Text information.

 It should be noted that, after performing S303 in the embodiment of the present invention, the voice information of the user A may be acquired by using the voice collection device, the expression determined in S303 is corrected, the corrected expression is obtained, and the corrected expression is obtained. , as the user's expression.

It should be further noted that, in the embodiment of the present invention, the two methods of processing the text format by adding an emoticon and modifying the text information may be used alone or in combination. For example, in the embodiment of the present invention, the two methods may be used in combination. Text information is attached to the emoji and the text format is modified. The text information sent can be "We break up, ^Λ - ^Λ ", where the font is a square book body, the font color is yellow, and the font size is four. The facial image of the user is recognized, and the user's expression is recognized. According to the correspondence between the different expressions and the text format, the text format corresponding to the recognized user's expression is obtained, and the text information to be sent is modified by the corresponding text format, that is, the text input by the user The text format of the information is processed into a text format capable of expressing the user's expression, so that the sent text information can express the user's emotion. By combining the text information and the emotion, the semantics of the text information sent by the user can be clearly expressed, and the information expression can be improved. Accuracy.

In another embodiment of the present invention, the method for transmitting text information by modifying the text format of the text information is described as an example of a method in which the target receiving party executes the application text information for communication. In the embodiment of the present invention, the user A sends a message "We break up" to the user B, and the process of the user B receiving the text information is described. The specific implementation process is as shown in FIG. 5:

 S401: User B receives the text information sent by User A.

 In the embodiment of the present invention, user B receives the content of the text information sent by user A as "we break up,".

 S402: Parse the text format of the received text information.

 Specifically, the text format of the text information parsed in the embodiment of the present invention is that the font is a square book body, the font color is yellow, and the font size is four.

 S403: Acquire an expression corresponding to the text format according to a mapping relationship between different expressions and different text formats.

 In the embodiment of the present invention, a mapping relationship between different expressions and different text formats is preset, for example, a happy, happy, and the like corresponds to a text format in which the font is a square body, the font color is yellow, and the font size is a fourth size; Expressions such as sadness correspond to text formats in which the font is bold, the font color is red, and the font size is number 3.

 After the text format of the received text information is parsed in the embodiment of the present invention, the expression corresponding to the currently parsed text format may be obtained according to a mapping relationship between the preset and different expressions and different text formats.

 Specifically, in the embodiment of the present invention, the expression corresponding to the text format in which the font is a square font, the font color is yellow, and the font size is four, is a happy expression.

 S404: According to the expression, an emoticon for characterizing the expression is called.

 Specifically, the emoticon used to represent the recognized expression in the embodiment of the present invention may include at least one of an emoticon, a symbol combination, and an emoticon.

In the embodiment of the present invention, the emoticons sent in the embodiment of the present invention may use different calling modes, for example, the emoticons are emoticons and emoticons. In the embodiment of the present invention, the emoticons corresponding to the currently recognized emoticons may be called from the emoticon database. The picture serves as the desired emoji. For example, if the emoji is a symbol combination, in the embodiment of the present invention, the corresponding symbol can be called from the symbol database and combined into an emoji that represents the currently recognized expression. Specifically, the expression obtained in Examples S403 pleased embodiment of the present invention, may call ^"Λ - Λ" as emoticons.

 S405: Display the received text information and emoji.

Specifically, the content of the message displayed on the user side of the embodiment of the present invention may be "we break up, ^Λ - ^Λ ", so the user can know that the user is joking and avoids misunderstanding. The information is parsed in a text format, and according to the parsed text format, the expression of the sender of the message is obtained, and the corresponding emoticon is called according to the obtained user expression, and the corresponding emoticon is displayed, so that the sender of the message can be more accurately expressed. Expression, improve the accuracy of information expression.

 The device for communicating by using the text information provided by the above embodiment, the embodiment of the present invention further provides a device 600 for applying text information for communication, and FIG. 6A is a device for communicating text information according to an embodiment of the present invention. 600 is a schematic diagram. In FIG. 6A, the apparatus includes an obtaining unit 601, an identifying unit 602, a determining unit 603, and a sending unit 604, where

 The obtaining unit 601 is configured to acquire a facial image of the user.

 The identifying unit 602 is configured to identify the expression of the user according to the facial image acquired by the obtaining unit 601.

 The determining unit 603 is configured to determine text information that represents the expression according to the text information to be sent and the expression recognized by the identifying unit 602.

 The sending unit 604 is configured to send the text information that is determined by the determining unit 603 to represent the expression. In the first implementation manner, the acquiring unit 601 is further configured to: obtain voice information of the user.

 The identification unit 602 is configured to:

 Identifying the initial expression of the user based on the facial image;

 Correcting the initial expression according to the voice information, and obtaining the corrected expression;

 The corrected expression is used as the user's expression.

In the second implementation manner, the determining unit 603 is configured to: After the recognition unit 602 recognizes the expression of the user, the emoticon used to represent the expression is called; the sending unit 604 is configured to:

 Send emoji and text information to be sent.

 In the third implementation manner, the determining unit 603 is configured to:

 After the recognition unit 602 recognizes the expression of the user, according to the mapping relationship between different expressions and different text formats, the text format corresponding to the recognized expression is obtained, and the text format of the text information to be sent is modified into the acquired text format. .

 The sending unit 604 is configured to:

 Send the modified text information.

 In the fourth implementation manner, the determining unit 603 is configured to:

 After the recognition unit 602 recognizes the expression of the user, the emoticon used to represent the expression is invoked, and according to the mapping relationship between the different expressions and the different text formats, the text format corresponding to the recognized expression is obtained, and the text to be sent is acquired. The text format of the information is modified to the obtained text format.

 The sending unit 604 is configured to send the emoticon and the modified text information.

 In the fifth implementation manner, the determining unit 603 is configured to: add an emoticon to the text information.

 The sending unit 604 is configured to: send the text information with the emoticon attached.

 In the sixth implementation manner, the determining unit 603 is configured to:

 Before determining the text information characterizing the expression, it is determined that the user has not entered the text information within the set length of time. The device for communicating the application text information provided by the foregoing embodiment of the present invention further includes a detecting unit 605 and a starting unit 606, as shown in FIG. 6B, wherein

 The detecting unit 605 is configured to detect an open state of the preset open control for processing the text information to be sent.

The starting unit 606 is configured to detect, in the detecting unit 605, the preset text to be sent When the opening control of the information processing is turned on, the image capturing device for acquiring the image of the user's face is activated. Correspondingly, the obtaining unit 601 is configured to: acquire the facial image of the user by the activated imaging device.

 In the eighth implementation manner, the emoticon called by the determining unit 603 includes at least one of an emoticon picture, a symbol combination, and an emoticon animation.

 The apparatus shown in FIG. 6A and FIG. 6B can be used to perform the method shown in FIG. 1 to FIG. 4, which is not detailed enough for the related description of the apparatus shown in FIG. 6A and FIG. 6B in the embodiment of the present invention. For reference, refer to the related description of FIG. 1 to FIG. 4, and details are not described herein again.

 The device for transmitting text by using the text information provided by the embodiment of the present invention obtains the facial expression of the user by obtaining the facial image of the user, and determines and sends the text information representing the expression of the user according to the obtained user expression and the text information to be sent. Since the user's expression can express the user's current emotion more accurately, the text information representing the user's expression can be sent to express the user's emotion through the invention, and the text sent by the user can be clearly expressed through the combination of the text information and the emotion. The semantics of information, improve the accuracy of information expression.

 The apparatus 600 for communicating by using the text information provided by the foregoing embodiment, the embodiment of the present invention further provides an apparatus 700 for applying text information for communication. As shown in FIG. 7A, the apparatus includes a transmitter 701, a processor 702, and a memory 703, a bus 704, and an input device 705, wherein the transmitter 701, the memory 703, and the input device 705 are both connected to the processor 702 via a bus 704, where

 The memory 703 is configured to store program code executed by the processor 702.

 The input device 705 is configured to acquire a facial image of the user. Specifically, the input device 705 for acquiring a facial image of the user may be a camera or an image capturing device.

 The processor 702 is configured to call the program stored in the memory 703 and the face image acquired by the input device 705, identify the user's expression according to the called facial image, and determine the text information representing the expression according to the text information and the expression to be sent.

 The transmitter 701 is configured to send text information that represents the expression.

In the embodiment of the present invention, the processor 702 can be on a single chip, multiple chips, or multiple electronic components. Implementation, and can use a variety of architectures, including dedicated or embedded processors, dedicated processors and controllers.

 The memory 703 is operatively coupled to the processor 702, including read only memory (ROM), random access memory (RAM), or a hard drive, etc., and the information may reside on a removable storage medium and loaded or installed as needed. To the device 600 for applying textual information for communication, the removable storage medium includes, for example, a memory card, a floppy disk, a magnetic tape, and a network component.

 The input device 705 may be one or more, and may be integrated with the processor 702 or the like or may be a separate peripheral device (for example, a scanner, a camera or a speaker, etc.), if the input device 705 is a peripheral device, The processor 702 is connected by a wired connection (eg, a cable/port) or a wireless connection (eg, Bluetooth).

 In the first implementation, the input device 705 is further configured to: obtain voice information of the user; specifically, the input device 705 for acquiring user voice information may be a voice acquiring device, such as a microphone or the like.

 The processor 702 can identify the user's expression according to the facial image as follows: according to the facial image, the initial expression of the user is recognized;

 Correcting the initial expression according to the voice information, and obtaining the corrected expression;

 The corrected expression is used as the user's expression.

 In a second implementation, the processor 702 is configured to:

 After the user's expression is recognized, the emoticon used to represent the expression is called.

 Transmitter 701 for:

 Send the text message to be sent and the emoticon called by the processor.

 In a third implementation, the processor 702 is configured to:

 After identifying the user's expression, according to the mapping relationship between different expressions and different text formats, obtaining a text format corresponding to the recognized expression;

 Modify the text format of the text information to be sent to the obtained text format.

 Transmitter 701 for:

Send the modified text information. In a fourth implementation, the processor 702 is configured to:

 After recognizing the user's expression, calling the emoticon used to represent the emoticon, and obtaining a text format corresponding to the recognized emoticon according to the mapping relationship between the different emoticons and the different text formats, and texting the text information to be sent The format is modified to the text format obtained.

 Transmitter 701 for:

 Send the emoticon called by the processor and the modified text information of the processor.

 In a fifth implementation, the processor 702 is configured to:

 Attach an emoji to the text message;

 Transmitter 701 for:

 Send a text message with an emoji attached.

 In a sixth implementation, the processor 702 is configured to:

 Before determining the text information characterizing the expression, it is determined that the user has not entered the text information within the set length of time. In combination with any of the foregoing implementation manners, in a seventh implementation manner, the processor 702 is configured to detect a preset state of an open control for processing the text information to be sent, where the preset is detected, When the open control for processing the text information to be sent is turned on, the input device for acquiring the facial image of the user is activated; and the facial image of the user is acquired by the activated input device.

 In an eighth implementation, the emoticon invoked by the processor 702 includes at least one of an emoticon, a combination of symbols, and an emoticon.

 The apparatus shown in FIG. 7A and FIG. 7B can be used to perform the method shown in FIG. 1 to FIG. 4, which is not detailed enough for the related description of the apparatus shown in FIG. 7A and FIG. 7B in the embodiment of the present invention. For reference, refer to the related description of FIG. 1 to FIG. 4, and details are not described herein again.

The device for transmitting text by using the text information provided by the embodiment of the present invention obtains the facial expression of the user by obtaining the facial image of the user, and determines and sends the text information representing the expression of the user according to the obtained user expression and the text information to be sent. Since the user's expression can express the user's current emotion more accurately, the text information representing the user's expression can be sent to express the user's emotion through the invention, and the text sent by the user can be clearly expressed through the combination of the text information and the emotion. The semantics of information, improve the accuracy of information expression. The method for performing communication based on the application text information provided in the foregoing embodiment, the embodiment of the present invention further provides an apparatus 800 for applying text information for communication. As shown in FIG. 8, the apparatus includes a receiving unit 801, a parsing unit 802, and an acquisition. a unit 803, a calling unit 804, and a display unit 805, wherein

 The receiving unit 801 is configured to receive text information.

 The parsing unit 802 is configured to parse the text format of the text information received by the receiving unit 801.

 The obtaining unit 803 is configured to obtain an expression corresponding to the text format parsed by the parsing unit 802 according to a mapping relationship between different emoticons and different text formats.

 The calling unit 804 is configured to invoke an emoticon used to represent the expression acquired by the acquiring unit 803 according to the expression acquired by the obtaining unit 803.

 The display unit 805 is configured to display the text information received by the receiving unit 801 and the emoticon called by the calling unit 804.

 The emoticon called by the calling unit 804 to represent the expression acquired by the obtaining unit 803 in the embodiment of the present invention includes at least one of an emoticon picture, a symbol combination, and an emoticon animation.

 The device shown in FIG. 8 can be used to perform the method shown in FIG. 5. For the description of the device shown in FIG. 8 in the embodiment of the present invention, the related description of FIG. 5 can be referred to. , will not repeat them here.

 The device for transmitting text by using the text information provided by the embodiment of the present invention obtains the facial expression of the user by obtaining the facial image of the user, and determines and sends the text information representing the expression of the user according to the obtained user expression and the text information to be sent. Since the user's expression can express the user's current emotion more accurately, the text information representing the user's expression can be sent to express the user's emotion through the invention, and the text sent by the user can be clearly expressed through the combination of the text information and the emotion. The semantics of information, improve the accuracy of information expression.

The device 800 for communicating by using the text information provided by the above embodiment, the embodiment of the present invention further provides a device 900 for applying text information for communication. As shown in FIG. 9, the device includes an output device 901, a receiver 902, and processing. The device 903, the memory 904, and the bus 905, wherein the output device 901, the receiver 902, the processor 903, and the memory 904 are all connected to the bus 905, where The memory 904 is configured to store program code executed by the processor 903.

 The receiver 902 is configured to receive text information.

 The processor 903 is configured to call a program stored in the memory 904, parse the text format of the text information received by the receiver 902, and obtain an expression corresponding to the text format according to a mapping relationship between different expressions and different text formats; An emoji used to characterize an expression.

 The output device 901 is configured to output text information received by the receiver 902 and an emoticon called by the processor 903.

 In the embodiment of the present invention, the processor 903 can be implemented on a single chip, a multi-chip or a plurality of electronic components, and can adopt various architectures, including a dedicated or embedded processor, a dedicated processor, and a controller.

 The memory 904 is operatively coupled to the processor 903, including a read only memory (ROM), a random access memory (RAM), or a hard drive, etc., and the information may also reside on a removable storage medium and be loaded or installed as needed. To the apparatus 900 for communicating text information, the removable storage medium includes, for example, a memory card, a floppy disk, a magnetic tape, and a network component.

 An output device 901 is operatively coupled to the processor 903 for outputting text information received by the receiver 902 and emoticons invoked by the processor 903, and outputting various intermediate and final results of the process by the processor 903.

 The device shown in FIG. 9 of the embodiment of the present invention can be used to perform the method shown in FIG. 5. For the description of the device shown in FIG. 9 in the embodiment of the present invention, the relevant description of FIG. , will not repeat them here.

 The device for transmitting text by using the text information provided by the embodiment of the present invention obtains the facial expression of the user by obtaining the facial image of the user, and determines and sends the text information representing the expression of the user according to the obtained user expression and the text information to be sent. Since the user's expression can express the user's current emotion more accurately, the text information representing the user's expression can be sent to express the user's emotion through the invention, and the text sent by the user can be clearly expressed through the combination of the text information and the emotion. The semantics of information, improve the accuracy of information expression.

Those skilled in the art will appreciate that embodiments of the invention may be provided as a method, system, or Computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can be embodied in the form of one or more computer program products embodied on a computer-usable storage medium (including but not limited to disk storage, CD-ROM, optical storage, etc.) in which computer usable program code is embodied.

 The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowcharts and/or block diagrams, and combinations of flow and/or blocks in the flowcharts and/or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

 The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

 These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Although the preferred embodiment of the invention has been described, it will be apparent to those skilled in the art that, Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and The spirit and scope of the embodiments of the present invention are departed. Thus, if the modifications and variations of the embodiments of the invention are within the scope of the claims and the equivalents thereof, the invention Changes and variants.

Claims

Rights request  A method for applying text information for communication, comprising:  Obtaining a facial image of the user;  Identifying an expression of the user according to the facial image;  Based on the expression and the text information to be transmitted, text information characterizing the expression is determined and transmitted.  2. The method of claim 1, wherein the method further comprises:  Obtain the voice information of the user;  Identifying the user's expression based on the facial image includes:  Identifying an initial expression of the user according to the facial image;  And correcting the initial expression according to the voice information to obtain a corrected expression; and using the corrected expression as a user's expression.  The method according to claim 1 or 2, wherein determining and transmitting the text information characterizing the expression according to the expression and the text information to be sent includes:  Calling an emoticon to characterize the expression;  Sending the emoticon and the text information to be sent.  The method according to claim 1 or 2, wherein determining and transmitting the text information characterizing the expression according to the expression and the text information to be sent includes:  Obtaining a text format corresponding to the recognized expression according to a mapping relationship between different expressions and different text formats;  The text format of the text information to be transmitted is modified to the obtained text format, and the modified text information is sent.  The method according to claim 1 or 2, wherein determining and transmitting the text information characterizing the expression according to the expression and the text information to be sent includes:  Calling an emoji to characterize the expression, and According to the mapping relationship between different expressions and different text formats, obtaining and corresponding to the recognized expression Text format;  The text format of the text information to be transmitted is modified to the obtained text format, and the emoticon and the modified text information are transmitted.  The method according to any one of claims 1 to 5, characterized in that, before determining the text information characterizing the expression, the method further comprises:  Make sure the user has not entered text information for the set length of time.  7. A method for applying text information for communication, comprising:  Receiving text information;  Parsing the text format of the text information;  Obtaining an expression corresponding to the text format according to a mapping relationship between different expressions and different text formats;  Decrypting an emoticon to characterize the expression according to the expression;  The received text information and the emoji are displayed.  A device for transmitting text information, comprising: an obtaining unit, an identifying unit, a determining unit, and a sending unit, wherein  The acquiring unit is configured to acquire a facial image of the user;  The identifying unit is configured to identify an expression of the user according to the facial image acquired by the acquiring unit;  The determining unit is configured to determine, according to the text information to be sent and the expression recognized by the identifying unit, text information that represents the expression;  The sending unit is configured to send text information that is determined by the determining unit and that represents the expression. The device according to claim 8, wherein the acquiring unit is further configured to: acquire voice information of the user;  The identification unit is configured to:  Identifying an initial expression of the user according to the facial image; And correcting the initial expression according to the voice information to obtain a corrected expression; and using the corrected expression as a user's expression. The device according to claim 8 or 9, wherein the determining unit is configured to: after the recognition unit recognizes the expression of the user, invoke an emoticon to represent the expression;  The sending unit is configured to:  Sending the emoji and text information to be sent.  The device according to claim 8 or 9, wherein the determining unit is configured to: after the recognition unit identifies the user's expression, according to a mapping relationship between different expressions and different text formats, Obtaining a text format corresponding to the recognized expression, and modifying a text format of the text information to be sent into the obtained text format;  The sending unit is configured to:  Send the modified text information.  The device according to claim 8 or 9, wherein the determining unit is configured to: after the recognition unit recognizes the expression of the user, invoke an emoticon to represent the expression, and  Obtaining a text format corresponding to the recognized expression according to a mapping relationship between different expressions and different text formats, and modifying a text format of the text information to be sent into the obtained text format; the sending unit is configured to send The emoji and the modified text information.  The device according to any one of claims 8 to 12, wherein the determining unit is configured to:  Before determining the textual information characterizing the expression, it is determined that the user has not entered the text information for the set length of time.  14. An apparatus for applying text information for communication, comprising: a receiving unit, a parsing unit, an obtaining unit, a calling unit, and a display unit, wherein  The receiving unit is configured to receive text information; The parsing unit is configured to parse a text format of the text information received by the receiving unit, and the acquiring unit is configured to obtain, according to a mapping relationship between different emoticons and different text formats, parsing with the parsing unit An expression corresponding to the text format; The calling unit is configured to invoke an emoticon to represent the expression according to the expression acquired by the acquiring unit;  The display unit is configured to display text information received by the receiving unit and the emoticon called by the calling unit.  15. An apparatus for communicating text information, comprising: an input device, a transmitter, a processor, a memory, and a bus, wherein the input device, the transmitter, and the memory pass through the bus Connected to the processor, wherein  The memory is configured to store program code executed by the processor;  The input device is configured to acquire a facial image of the user;  The processor is configured to invoke a program stored in the memory and a facial image acquired by the input device, identify an expression of the user according to the facial image, and determine a representation according to the text information to be sent and the expression Text information of the expression;  The transmitter is configured to send text information that characterizes the expression.  The device of claim 15, wherein the input device is further configured to: acquire voice information of the user;  The processor is configured to: according to the facial image, identify an expression of the user: according to the facial image, identify an initial expression of the user;  And correcting the initial expression according to the voice information to obtain a corrected expression; and using the corrected expression as a user's expression.  The device according to claim 15 or 16, wherein the processor is configured to: after identifying the expression of the user, invoke an emoticon to represent the expression; In:  Sending text information to be sent and the emoticon called by the processor.  The device according to claim 15 or 16, wherein the processor is configured to: after identifying the user's expression, acquiring and identifying according to a mapping relationship between different expressions and different text formats The text format corresponding to the expression; Modifying a text format of the text information to be sent into the obtained text format; The transmitter is configured to:  Send the modified text information.  The device according to claim 15 or 16, wherein the processor is configured to: after identifying the expression of the user, invoke an emoticon to represent the expression, and different according to different expressions a mapping relationship between the text formats, obtaining a text format corresponding to the recognized expression, and modifying a text format of the text information to be sent into the obtained text format; the transmitter, configured to:  Sending an emoticon called by the processor and the modified text information of the processor.  The device according to any one of claims 15 to 19, wherein the processor is configured to:  Before determining the textual information characterizing the expression, it is determined that the user has not entered the text information for the set length of time.  21. An apparatus for communicating text information, comprising: an output device, a receiver, a processor, a memory, and a bus, wherein the output device, the receiver, the processor, the memory Connected to the bus, wherein  The memory is configured to store program code executed by the processor;  The receiver is configured to receive text information;  The processor is configured to invoke a program stored in the memory, parse a text format of the text information received by the receiver, and acquire a mapping corresponding to the text format according to a mapping relationship between different expressions and different text formats. An expression; an emoticon for characterizing the expression is invoked according to the expression;  The output device is configured to output text information received by the receiver and an emoticon called by the processor.