KR100736541B1 - Online integrated system of personal characters - Google Patents

Abstract

The present invention discloses an online integrated system of personal characters capable of integrating personalized characters on the mobile and the Internet, and giving a user's emotion.

The system according to the present invention is connected to various communication networks through a gateway (G / W), in response to the service request of the user terminal for processing the operation and facial expressions for the PI (PI) according to the voice pattern, character recognition module engine; A PI server for converting and storing a plurality of contents provided from the MCP server so as to be processed in an engine, and storing an original for the PI; A subscriber server that stores and manages PI service members and registration service information for subscribers; And a service logic server for receiving a corresponding character or caricature from a plurality of types of servers using PI, and requesting service execution to an engine according to a service registered with the subscriber server 103. Include. Therefore, the present invention provides an integrated character on the network, create a variety of services, there is an effect that can maximize the synergy effect by sharing the content with the Internet.

Heterogeneous Network, Communication, Character, Emotion, Personalized Content, PAI, PI

Description

Online integration system of personal character {SYSTEM FOR UNIFICATION PERSONAL CHARACTER IN ONLINE NETWORK}

1 is a block diagram showing an online integrated system according to the present invention.

FIG. 2 is a diagram illustrating the engine of FIG. 1.

3 is a flowchart for explaining the main operation of the present invention.

<Explanation of symbols for main drawings>

101: service logic server 103: subscriber server

105: engine 107: PI server

109: user terminal 203: display algorithm

205 process algorithm 207 recognition algorithm

209: Lip Sync Module 211: Dancing Module

213: PI Management and Image Processing Module 215: PI Distribution Module

217: media conversion module 219: game character conversion module

221: speech pattern recognition module 223: character recognition module

The present invention relates to communication content, and more specifically, to implement the character of the individual having a unique image, music, text, sound, emotions, etc. for each person online, and the character is integrated operation management on the mobile and the Internet An online integrated system of personal characters that can be.

Characters are characters appearing in novels, cartoons, plays, etc., and with the recent expansion of multimedia services, the use of animated characters is increasing. In particular, due to the explosive expansion of the Internet, the use of avatar characters as a means of replacing themselves on the Internet is increasing rapidly.

Currently, the avatar market is only supplying images created by designers, and shows a technical limitation in that it cannot serve the user's 'self alteration', which is the meaning of avatars. In other words, in expressing themselves on the Internet through avatars, various needs of users cannot be satisfied. Based on such a problem, a character capable of emphasizing the image characteristics of each user has been recently used, which includes a first step of providing a user with a sample image for a component of a character previously stored according to a user's request; A second step of synthesizing sample images of each character element selected by the user by parts to generate a character having a feature highlighting by parts; And according to a third step of changing the characteristic information of the image for the character component which is already synthesized as part of the character according to the user's request.

In addition, in the character generation method described above, the user is provided with sample images in a bitmap manner, and allows the user to select a sample image that best suits his or her taste among the sample images, and the server simply combines them to create an avatar. It is configured and provided to the user.

However, characters such as avatars have not been revived due to changes in the communication environment and the living environment of the user, and are inevitably limited to simple graphics. That is, in the mobile communication market, there are coloring, mybell, picture friends, etc. In the internet market, there are many kinds of item businesses including avatars, cyworld, emoticons, and game characters, but the user's personal character is a carrier. There is no choice but to individualize it by network or by network. Therefore, the content of such a service is currently used only for the service provider, and the burden on the subscriber is not only large, but also causes a problem that synergy between users and companies is not generated.

The present invention was created to solve such a problem, and an object of the present invention is to enable the personal character to be linked on the mobile and the Internet, the system of online integration of personal characters that can continuously induce the interest of subscribers In providing.

Another object of the present invention is to provide a personalized character that can be shared between mobile and the Internet in response to images, music, characters, and emotions, thereby expressing personal emotions as multidimensional three-dimensional content on a hot stamper, It is to provide an online integrated system of personal characters that can be provided as a new model.

Another object of the present invention is to implement a personalized character with a caricature, an image of a unique photo, a terminal wallpaper, and the like, coloring, music such as BGM, letters such as letters, voices, emotions such as behavior patterns, etc. It provides a thorough personalization of the character, and provides an online integrated system of the personal character that can achieve the quality of the virtual service by matching each other between the personalized character and the user.

The on-line integrated system of the personal character according to the aspect of the present invention for achieving the above object is a mobile communication network, including a voice message server (VMS), multimedia server (MMC), media server (MS) and switch (MSC), wired Or the Internet including wireless, an ASP network having an MCP server for content information management, a heterogeneous access network including a WAP gateway and a multimedia server (MMS) for heterogeneous network access, the mobile communication network, the Internet, an ASP network, and a heterogeneous access network. In a communication system for providing personalized content (hereinafter referred to as PI) based on a communication network composed of gateways (G / W) for interconnection, the PI includes images, music, and text. Expresses the user's emotion and emotion according to a predetermined pattern, and includes a content providing system mounted on the communication network through media conversion between heterogeneous networks. And that is characterized.

According to a preferred embodiment of the present invention, the PI is any one of a character, a caricature or a video, and is provided as Internet content and mobile content.

The internet content may be any one of an avatar, a cyworld, an emoticon, and a game character, and the mobile content may be any one of a coloring, a mybell, and a picture friend.

In addition, the content providing system is connected to various communication networks through the gateway (G / W), in response to the service request of the user terminal to process the operation and facial expressions for the PI (PI) according to the voice pattern, character recognition Engine for; A PI server for converting and storing and managing a plurality of contents provided from the MCP server so as to be processed by the engine, and storing originals for the PI; A subscriber server that stores and manages PI service members and registration service information for subscribers; And a service logic server requesting service execution to the engine according to a service registered with the subscriber server 103 after receiving the corresponding character or caricature from a plurality of types of servers using the PI. Server).

The PI may be any one of an image PI, a music PI, a character PI, and an emotion PI.

In addition, the video PI may be any one of a personalized character, a capture feature, a unique photo, and a terminal background, and the music PI may be a coloring or a call background sound (BGM), and the text PI may be used. Is characterized by mobile lettering.

The engine may further include a display algorithm for realizing a LipSync mode for the image PI and a Dancing mode for the image PI; Process algorithms for performing graphics processing and data conversion; And a recognition algorithm for speech pattern and character recognition.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

First, the 'personalized character' described in the present invention is content (character, caricature, video, etc.) expressing the emotions, emotions, etc. of the user, including images, music, and characters. Therefore, since terms for 'personalized character' or 'caricature', 'video', etc. may be used incorrectly in the present invention, the contents will be named PI (Personal Identity) to prevent the confusion of terms. .

1 is a block diagram showing an online integrated system of a personal character according to the present invention. As shown, a mobile communication network including a voice message server (VMS), a multimedia server (MMC), a media server (MS), and a switchboard (MSC), the Internet including a wired or wireless network, and an MCP server for content information management. Based on a communication network consisting of a heterogeneous access network including an ASP network, a WAP gateway for heterogeneous network access, and a multimedia server (MMS), and a gateway (G / W) for interconnection between the mobile communication network, the Internet, an ASP network, and a heterogeneous access network. So;

The engine 105 is connected to various communication networks through the gateway G / W, and processes an operation and an expression for the PI based on voice patterns and text recognition in response to a service request of the user terminal 109. And a PI server 107 for converting and storing and managing a plurality of contents provided from the MCP server so as to be processed in the engine 105, and for storing an original for the PI. After receiving the character or caricature from the subscriber server 103 for storing and managing the PI subscriber and registration service information for the subscriber, and a plurality of servers using the PI, the subscriber server ( According to the service registered as 103, it is configured as a service logic server 101 (Service Logic Server) for requesting the service execution to the engine 105.

The PI is classified into an image PI, a music PI, a character PI, an emotional PI, and the like, and the image PI may be a personalized character, a capture, a unique Pictures, terminal wallpapers, and so on. In addition, the music PI is a coloring, a call background sound (BGM), the text PI is a lettering, and the emotion PI is a voice, an action pattern, or the like.

2 is a block diagram showing the main functions of the engine according to the present invention. As shown, the engine 105 may include a display algorithm 203 for realizing a lip sync mode 209 for an image PI and a dancing mode 211 for a PI. A process algorithm 205 for performing graphics processing and data conversion and a recognition algorithm 207 for speech pattern and character recognition. The lip-sync module 209 of the display algorithm follows the shape of the mouth according to the subscriber's voice, such as a character, a picture, or the like, and represents eye blinking, facial expression change, and light movement as necessary. The lip sync for the video PI may replace the caller's video during the video call. The dancing module 211 represents various motions and dances for the image PI.

Meanwhile, the process algorithm 205 distributes the PI management and image processing module 213 and the PI to various nodes in various communication networks, or transmits the PI to various Internet companies, and provides predetermined authentication and authority. PI distribution module 215 for executing service signatures and the like, and various data (PI-characters, homepage images, music, etc.) for various video telephone networks, terminals, etc. And a media convergence function 217 that performs a format conversion, and a game for converging a corresponding PI so that the internet game environment can be transferred from a mobile or a mobile to the internet in conjunction with a game engine of an internet game provider. A character conversion module 219 is included.

The PI management and image processing module 213 is a video telephone network, multimedia system (MMS), a variety of forms for the PI, such as 2D, 3D characters, upper body, the whole body through a codec (Codec), In providing to the terminal, the Internet, etc., various effects such as background processing, item combination, advertisement addition, and the like are performed.

In addition, the recognition algorithm 207 may be a voice pattern recognition module 221 for recognizing a call voice of a user, and a text recognition module 223 for recognizing a character input from the user terminal 109. For the voice pattern recognition module, the voice of the user is analyzed, converted into textual information, and the contents of the call are recognized through the text recognition. The contents of the call analyzed using the recognition algorithm are for giving emotion to the PI, and the expression, voice, and motion of the PI, that is, the character or the caricature, are varied according to the contents of the call.

3 is a flowchart for explaining the main operation of the present invention.

In operation S301, the user terminal 109 accesses the subscriber server 103 through a communication network such as a mobile communication network or the Internet. The user enters subscriber information according to a predetermined procedure and performs registration according to an authentication procedure. When the registration is completed, enter the step S303, the user sets the PI. The PI selects content of a plurality of types of characters, caricatures, and the like provided from an MCP server. If necessary, the user may upload his own picture, video, and the like to set the PI. The MCP server registers a subscriber service for a user, and stores and manages content information about a PI selected by the user. The original information of the content of the PI is stored in the subscriber server 103.

Thereafter, in step S305, the user terminal 109 executes a service for receiving a preset PI in using various media services, network types, and various terminals. In step S307, the service logic server 101 determines whether a video phone replacement image service is requested. The service request may be automatically executed by the user terminal 109 during the video call or upon initial service registration. The video phone alternative image service is a motion tracking of its own PI instead of its appearance during a video call of the user terminal 109. The service logic server 101 instructs the engine 105 to execute a service to execute such a video telephone replacement image service.

In step S309, the engine 105 activates the voice pattern recognition module function of the recognition algorithm 207 to recognize the voice pattern input from the user terminal 109 during the video call. Since speech recognition is currently provided with a number of solutions, a detailed description thereof will be omitted. The speech pattern recognition module 221 converts a user's call content into textual information and detects a vowel (English vowel, Korean vowel, etc.) among the text information. The detection result is then transmitted to the lip sync module 209 of the display algorithm 203.

In step S311, the lip sync module 209 performs an image change, ie, Lip-Sync, on a character or a caricature of a PI selected by a user. At this time, a graphic change corresponding to the textified vowel information is made. Here, the user may provide an image change for the PI using a key button of the user terminal 109. The image change represents a change in the expression of the character or the caricature, and various effects such as a pleasant expression, a sad expression, and an angry expression are added according to a preset key button. If necessary, the voice pattern recognition module 221 detects a call voice pattern of the user and may automatically set the expression of the PI according to the preset voice pattern.

The lip sync module 209 may be applied when a video message call, ie, its own PI is lip synced or motion tracked, and receives a video call to the video terminal of the called party. In addition, the PI distribution module 215 may be used to perform a video message call in conjunction with the Internet messenger. This allows the user's PI to motion track or lip-sync through a cam of the user terminal 109, which is a wired PC, to perform video call reception to the video terminal of the called party.

The engine 105 interlocks the voice pattern recognition module 221 and the lip sync module 209 to recognize a voice pattern for a call voice or a recorded caller voice provided from the user terminal 109. The multimedia message added with the lip sync of the PI may be transmitted to the called terminal. Therefore, the above-mentioned video call replacement image service can artificially represent an image by replacing the caller with the PI instead of the caller's video image during a video call between the user (sender) and the called party.

On the other hand, as a result of the determination in step S307, if the video telephone replacement image service is not executed, the process proceeds to step S313. The service logic server 101 determines whether the user terminal 109 requests to execute a video telephone coloring service. Video telephony coloring service is a video pi (PI) preset from the user to dance the latest fashion, or to exhibit a variety of motion. In step S315, the service logic server 101 performs a service request to the engine 105 to execute the video telephone coloring service.

The engine 105 activates the dancing module 211 of the display algorithm 203. The dancing module 211 adds a graphic change to the image PI based on a dance motion corresponding to the dance music along with a plurality of preset pieces of dance music information. Meanwhile, in step S317, the engine 105 starts the PI distribution module 215 of the process algorithm 205. The PI distribution module 215 distributes the dance motion for the image PI based on user selection, through various nodes in various communication networks. For example, a corresponding image PI may be provided as a mini room or a skin background. That is, the engine 105 may be connected to the gateway G / W to transmit the image PI to the Internet, or may be transmitted to another communication network through a heterogeneous network access network.

The PI distribution may be added with authentication, authority, service signature, etc. for the user. In addition, the process algorithm 205 performs a media conversion according to a video telephone network or a terminal capability or the Internet through the media convergence function 217 in transmitting the image PI to the heterogeneous network. In other words, the engine 105 performs transcoding and format conversion on the image PI.

Here, when the service logic server 101 determines that the PI is applied to an internet game or a mobile game, the service logic server 101 notifies the engine 105 of this. Engine 105 executes game character transformation module 219 of process algorithm 205. The character conversion module 219 performs convergence so that the PI can be mounted on an internet game or a mobile game. Convergence converts for mobile, internet games, etc., the conversion format may be provided by the game company or based on a pre-stored conversion format.

On the other hand, if it is determined in step S313 that the service logic server 101 determines that the video telephone coloring service is not executed, the process proceeds to step S319 and the service logic server 101 notifies the engine 105 of the alert service. request. The alert service attaches its PI when using a short message (SMS) arrival notification, a call reception notification, or a message notification service of a 1mm service line. Accordingly, the receiver receives a PI corresponding to the sender when the message is received, and the PI may notify the message through a number of graphic changes.

As described above, the on-line integrated system of the personal character according to the present invention by applying the PI (personalized character, caricature, etc.) in the mobile communication network, Internet network and various networks, homepage, community, messenger, Use the same PI for online games and mobile games, and express individual emotions and feelings about PI, and provide your own unique emotions and images in the virtual world. There is.

In addition, the present invention provides an integrated character on the network, create a variety of services, maximize the synergy effect by sharing the content with the Internet, strengthen the market dominance through the activation of video telephony and independent acquisition of related technologies and IPR It is effective to let.

What has been described above is merely an embodiment of the present invention, and is not limited to the embodiment of the present invention, and as claimed in the following claims, without departing from the gist of the present invention, ordinary knowledge in the field to which the present invention belongs. Anyone having the technical spirit of the present invention to the extent that various changes can be made.

Claims (15)

Mobile network including voice message server (VMS), multimedia server (MMC), media server (MS) and switchboard (MSC), Internet including wired or wireless, ASP network with MCP server for content information management, heterogeneous Personalized content based on a heterogeneous access network including a WAP gateway and a multimedia server (MMS) for network access, and a communication network composed of a gateway (G / W) for interconnection between the mobile communication network, the Internet, an ASP network, and a heterogeneous access network. In the communication system for providing a PI, hereinafter, The PI may express a user's emotion and emotion including a video, music, and text according to a predetermined pattern, and include a content providing system mounted on the communication network through media conversion between heterogeneous networks. Online integrated system of personal characters. The method of claim 1, wherein the eye (PI), Any one of a character or a caricature or a video, the online integrated system of the personal character, characterized in that provided in the Internet content and mobile content. The method of claim 2, wherein the Internet content, Online integrated system of personal characters, characterized in that any one of the avatar, cyworld, emoticons, game characters. The method of claim 2, wherein the mobile content, Online integrated system of the personal character, characterized in that one of the coloring, My Bell, picture friends. According to claim 1, The content providing system, An engine connected to various communication networks through the gateway (G / W) and processing an operation and facial expression for the PI according to voice patterns and text recognition in response to a service request from a user terminal; A PI server for converting and storing and managing a plurality of contents provided from the MCP server so as to be processed by the engine, and storing originals for the PI; A subscriber server that stores and manages PI service members and registration service information for subscribers; And After receiving the character or caricature from a plurality of types of servers using the PI, a service logic server requesting service execution to the engine according to a service registered with the subscriber server 103. Online integration system of a personal character, characterized in that it comprises a). The method according to claim 1 or 5, wherein the PI (PI), On-line integrated system of the personal character, characterized in that any one of the image PI, the music PI, the character PI, the emotional PI. The image eye of claim 6, An online integrated system of personal characters, characterized in that any one of a personalized character, capacitive, unique photo, terminal background. The method of claim 6, wherein the music PI, An integrated system of personal characters characterized in that it is coloring or call background sound (BGM). The method of claim 6, wherein the letter PI, Online integrated system of personal characters, characterized in that the mobile lettering. The engine according to any one of claims 6 to 9, A display algorithm for realizing a LipSync mode for an image PI and a Dancing mode for the image PI; Process algorithms for performing graphics processing and data conversion; And An online integrated system of personal characters, comprising a recognition algorithm for speech patterns and character recognition. The lip sync module of claim 10, wherein The video PI follows a user's voice according to the subscriber's voice, and is a graphic change such as blinking eyes, facial expressions, and light movements. The method of claim 10, wherein the process algorithm, A PI management and image processing module for adding graphic effects to the PI; A PI distribution module for distributing the PI to various nodes in various communication networks or delivering the PIs to various Internet providers, and for executing predetermined authentication, authority, service signature, etc .; A media convergence function for performing data transcoding and format conversion for various PIs so as to be suitable for various video telephone networks, terminals, and the like; And In conjunction with the game engine of the Internet game provider, the personal character online comprising a game character conversion module for converging the PI so that the Internet game environment can be transferred from mobile or mobile to the Internet. Integrated system. The method of claim 10, wherein the PI management and image processing module, Providing various forms of the PI to a video telephone network, a multimedia system (MMS), a terminal, the Internet, etc. through a codec; The recognition algorithm may include a voice pattern recognition module for recognizing a call voice of a user and a text recognition module for recognizing a character input from a user terminal. The voice pattern recognition module of claim 5 or 13, After analyzing the user's call voice, converting it into textual information, and analyzing the content of the call based on the recognition algorithm through the character recognition, and starting the engine based on the analysis result of the PI An online integrated system of personal characters, characterized by deforming facial expressions. delete

Images