CN1878119A - Method and system for realizing multimedia information communication in on-line game system - Google Patents

Abstract

The invention discloses a method and a system for realizing multimedia information communication in two online game systems. The main idea of the first type is: the game client interacts with the game server, the game server obtains the information of the target game client, and forwards the multimedia information sent by the game client to the target game client according to the information of the target game client. The second method for realizing multimedia information communication in an online game system and the main idea of the system are: the game client interacts with the game server, the game client obtains information such as the target game client address from the game server, and the game client address and other information, and directly send the multimedia information to the target game client. The method and system for realizing multimedia information communication between the two online game systems of the present invention realizes multimedia information communication between game clients inside the online game system, simplifies user operations, and reduces system resource consumption.

Description

Method and system for realizing multimedia information communication in online game system

technical field

The invention relates to a technology for realizing multimedia information communication in a network service system, in particular to a method and system for realizing multimedia information communication in an online game system.

Background technique

At present, the types of online games are constantly enriched, and the functions are increasingly powerful, and the game user base is growing at an extremely fast rate. The online game system mainly includes a game server and a game client. Each game client has at least one game account to log into the game server, and the game account, password and registration information are all stored in the game server, and each game account corresponds to a game role. One or more online games can run on the game server; a large online game can also run on multiple computer servers. These games all support online text communication, and text messages can be sent to users in the same game. In the field of mobile games, the GS standard formulated by the Open Mobile Alliance OMA also provides a framework specification for a game platform GP that can run multiple online games.

Users can use text to communicate during the game, which requires the user to operate the keyboard, which brings inconvenience to the user and affects the game experience. Therefore, more and more users have put forward the need for multimedia information communication in the game. .

In order to meet this requirement, the current implementation is usually to use an independent multimedia information communication system outside the game system, such as using instant communication tools such as QQ, MSN, Skype, and GICQ.

Referring to FIG. 1 , FIG. 1 is a schematic diagram of the structure and principle of voice communication when using online game services in the prior art. In FIG. 1 , the instant messaging tool QQ is used as an example for illustration. The online game system is mainly composed of a game server 110 and a game client 101 in the client 100. The game server 110 and the game client 101 perform game data interaction to realize game business functions.

Wherein, in order to realize voice communication, the client 100 also includes a QQ client 102, the QQ client 102 receives the voice information input by the user through the existing voice input/output device 103 of the client 100, converts it into voice data and sends it to the target The QQ client 102 in the client machine 100 of the game user. After the QQ client 102 in the client computer of the target game user receives the voice data, it converts it into a voice signal and outputs it to the target user through the voice input/output device 103 .

In practical applications, game users need to constantly add, delete, and update the list of communication objects of the instant messaging client according to changes in game objects, and the operation of the instant messaging client will also affect the use of the game client. For example, game users may receive some unrelated game messages instant message. Especially in mobile online games, because mobile terminals generally have much lower computing and storage capabilities than computers and smaller screens, they are not suitable for running two client systems at the same time, and it is still inconvenient for users to use.

Contents of the invention

In view of this, the first main purpose of the present invention is to provide a method for implementing multimedia information communication in an online game system, which enables multimedia information communication in the online game system without requiring other multimedia information communication tools.

A second main object of the present invention is to provide an online game system capable of multimedia information communication.

The third main purpose of the present invention is to provide another method for implementing multimedia information communication in an online game system. This method also does not need other multimedia information communication tools to implement multimedia information communication in the online game system.

A fourth main object of the present invention is to provide another online game system capable of multimedia information communication.

In order to achieve the first aspect of the above object, the present invention provides a method for realizing multimedia information communication in an online game system. The method pre-sets the multimedia information receiving conditions of the game client on the game server, and the process of performing multimedia information communication includes the following steps: :

A. The game client interacts with the game server to establish a multimedia data transmission channel;

B. The game client converts the multimedia signal input by the user into multimedia data, and sends it to the game server through the multimedia data transmission channel;

C. After the game server receives the multimedia data, it determines the target game client for receiving the multimedia information according to the preset receiving conditions of the game client for multimedia information;

D. The game server sends the multimedia data to the target game client through the multimedia data transmission channel;

E. The target game client converts the received multimedia data into a multimedia signal and outputs it to the user.

Wherein, the multimedia information reception condition of the game client may include one or more of the following:

a1, set in the game, the game client of the game character within the predetermined range around the game character corresponding to the game client game account can receive multimedia information; then the method for determining the target game client described in step C is:

The game server obtains the game account of the game character within a predetermined range according to the position of the game character corresponding to the game account sending the multimedia data, and determines the game client corresponding to the obtained game account as the target game client;

a2. Set the game client of the game role that has a predetermined game relationship with the game client game account to be able to receive multimedia information; then the method for determining the target game client described in step C is:

The game server obtains the game account of the game character having a predetermined game relationship with the game account according to the game account sending the multimedia data, and determines the game client corresponding to the obtained game account as the target game client;

a3, setting the designated target game client in the multimedia data packet can receive multimedia information; then the method for determining the target game client described in step C is:

The game server reads the information of the specified target game client from the multimedia data packet, and determines the specified target game client as the target game client.

The process of establishing a multimedia data transmission channel between the game client and the game server described in step A may include:

A1. The game client sends a request to the game server to establish a multimedia data channel;

A2. After the game server accepts the request, designate a port for receiving multimedia data, and return the information of the receiving port to the game client; or the game server returns the information of a designated port for receiving multimedia data to the game client;

A3. The game client opens a communication channel to connect to the port designated by the server, and establishes a multimedia data transmission channel, which is independent of the game data transmission channel.

The process that the game client in step B converts the multimedia signal input by the user into multimedia data may include:

B1. The game client records the input multimedia signal;

B2. The game client encodes the recorded multimedia signal and packs it into multimedia data;

The method for the target game client in step E to convert the multimedia data into a multimedia signal is as follows: the target game client unpacks the multimedia data and decodes it into a multimedia signal.

The multimedia signal may be a voice signal, a video signal or a combination of both.

The step B1 may further include: if the game client receives multimedia data during the recording of the multimedia signal, temporarily storing the received multimedia data; after the recording is completed, converting the received multimedia data into a multimedia signal for output.

The step B2 may further include: the game client adds the information of the game client to the multimedia data, and sends them to the game server together, and the information of the game client is the address or the game account of the game client;

Described step C comprises:

C1. The game server obtains the information of the game client sending the multimedia data from the received multimedia data packet;

C2. Determine the target game client according to the information of the game client and the receiving conditions of the multimedia information.

In the step C: the game server can determine whether the received data is multimedia data according to the port information in the data or the preset multimedia data identifier added to the multimedia data by the game client before sending.

The step C may further include: the game server recognizes the voice data in the received multimedia data, and converts it into text data and sends it to the target game client together with the voice data;

In the step E: the target game client outputs the received text display to the user while outputting the multimedia signal.

The game client can further set in the game server the option of whether to receive multimedia data, or the option of whether to receive the text after speech recognition, or the option of whether to receive multimedia data and the text after speech recognition at the same time;

In the step C, the game server recognizes and sends the voice data according to the option.

The method may further include: setting in the game server in advance a sign that the game client is prohibited from receiving multimedia data;

Said step C further comprises: after determining the target game client, judging whether the target game client is provided with a sign forbidding to receive multimedia data, if so, not sending multimedia data to the target game client; otherwise sending the target game client send multimedia data;

Or pre-set the game client to prohibit receiving multimedia data flag on the game client;

Said step E further includes: after the game client receives the multimedia data, it first judges whether the multimedia data reception prohibition flag is set, if so, does not convert the multimedia data into a multimedia signal and outputs it to the user; otherwise converts the multimedia data into a multimedia signal The signal is output to the user.

Said step D may comprise:

D1. The game server judges whether a multimedia data transmission channel has been established with the target game client, and if so, execute step D3; otherwise, execute step D2;

D2. The game server interacts with the target game client to establish a multimedia data transmission channel;

D3. The game server sends the multimedia data to the target game client through the multimedia data transmission channel.

The process of establishing a multimedia data transmission channel between the game server and the target game client described in step D2 may include:

D21. The game server sends a request for establishing a multimedia data channel to the game client, and the request includes a designated port information for receiving multimedia data;

D22. After accepting the request, the game client opens a communication channel to connect to the port designated by the server, and establishes a multimedia data transmission channel.

The method may further include: when the game client finishes a game, notify the game server to close the multimedia data transmission channel between the game client and the game client;

Or when the game client ends the game abnormally, the game server closes the multimedia data transmission channel with the game client after detecting that the game client is not online.

The step E may further include: the target game client recognizes the voice data in the received multimedia data, and converts the voice data into text; while the target game client outputs the multimedia signal, it outputs the converted text display to user.

The method for the user to input the multimedia signal described in step B can be: the voice input/output device of the client where the game client is located receives the voice signal input by the user; the video input/output device of the client where the game client is located obtains the video signal;

The method for outputting the multimedia signal to the user as described in step E is: play the voice signal by the voice input/output device of the client where the game client is located; play the video signal by the video input/output device of the client where the game client is located.

In order to achieve the second aspect of the above object, the present invention provides an online game system, the system includes: a game server and a client computer equipped with a multimedia signal input/output device and a game client, and the game client includes a game processing module; the game client further includes a multimedia data transmission module;

The game processing module of the game client interacts with the game server, establishes a multimedia data transmission channel, and sends the transmission channel information to the multimedia data transmission module;

The multimedia signal input/output device receives the multimedia signal input by the user and sends it to the multimedia data transmission module of the game client; or receives the multimedia signal from the multimedia data transmission module and outputs it to the user;

The multimedia data transmission module converts the received multimedia signal into multimedia data, and sends the multimedia data to the game server through the multimedia data transmission channel according to the multimedia data transmission channel information; or converts the received multimedia data into a multimedia signal and sends it to the multimedia data input/output devices;

The game server sets the multimedia information receiving condition of the game client, after it receives the multimedia data, determines the target game client according to the game client information and the multimedia information receiving condition for sending the multimedia data, and sends the multimedia data through the multimedia data transmission channel to the target game client.

Wherein, the game server may include a game service unit and a multimedia data processing unit;

The game processing module of the game client interacts with the game service unit in the game server to establish a multimedia data transmission channel, which is independent of the game data transmission channel used to transmit game data;

The game service unit sends the information of the established multimedia data transmission channel to the multimedia data processing unit; and the game service unit sets the multimedia information reception condition of the game client, and obtains the target game client when receiving the multimedia data processing unit. After the information request, obtain the target game client information and return it to the multimedia data processing unit according to the game client information sending the multimedia data and the multimedia information reception condition set;

After the multimedia data processing unit receives the multimedia data sent by the game client through the multimedia data transmission channel, it temporarily stores the data, and sends a request to the game service unit to obtain the information of the target game client; and receives the target game service unit returned After the game client information, it is judged whether a multimedia data transmission channel has been established with the corresponding target game client, and if established, the multimedia data is directly sent to the target game client; otherwise, the game service unit is notified to establish a link with the target game client. After connecting the multimedia data transmission channel between them, the multimedia data is sent to the target game client.

The game server may also include a game service unit and an access unit;

The game processing module of the game client interacts with the game service unit through the access unit in the game server to establish a multimedia data transmission channel;

The game service unit sends the information of the established multimedia data transmission channel to the access unit; and the game service unit sets the multimedia information reception condition of the game client, and after receiving the request for obtaining the target game client information sent by the access unit , according to the game client information for sending multimedia data and the set multimedia information receiving conditions, obtain the target game client information and return it to the access unit;

After the access unit receives the data, it judges whether the data is multimedia data or game data according to the port information or the multimedia data identifier pre-set and added to the multimedia data, and if it is game data, it is sent to the game service unit for game processing; If it is multimedia data, then store the data temporarily, and send a request to obtain the target game client information to the game service unit; after receiving the target game client information returned by the game service unit, determine whether the multimedia has been established with the corresponding game client If the data transmission channel has been established, the multimedia data is directly sent to the target game client; otherwise, the game service unit is notified to establish a multimedia data transmission channel with the target game client, and then the multimedia data is sent to the target game client.

The game server may also include a game service unit, an access unit and a multimedia data processing unit;

The game processing module of the game client interacts with the game service unit through the access unit in the game server to establish a multimedia data transmission channel;

The game service unit sends the information of the established multimedia data transmission channel to the multimedia data processing unit; and the game service unit sets the multimedia information reception condition of the game client, and obtains the target game client information sent by the multimedia data processing unit After the request, obtain the target game client information and return it to the multimedia data processing unit according to the game client information for sending multimedia data and the multimedia information reception conditions set;

After the access unit receives the data, it judges whether the data is multimedia data or game data according to the port information or the multimedia data identifier pre-set and added to the multimedia data, and if it is game data, it is sent to the game service unit for game processing; If it is multimedia data, it is sent to the multimedia data processing unit;

After receiving the multimedia data sent by the access module, the multimedia data processing unit temporarily stores the data, and sends a request to the game service unit to obtain the target game client information; after receiving the target game client information returned by the game service unit , to determine whether a multimedia data transmission channel has been established with the corresponding game client, if established, then directly send the multimedia data to the target game client through the access unit; otherwise notify the game service unit to establish a communication with the target game client After the multimedia data transmission channel, the multimedia data is sent to the target game client through the access unit.

The multimedia data processing unit may further include a speech recognition module;

After the multimedia data processing unit receives the multimedia data including voice data, the voice recognition module recognizes the voice, converts it into text, adds it to the multimedia data and sends it to the target game client.

The access unit may further include a speech recognition module;

After the access unit receives the multimedia data including voice data, the voice recognition module recognizes the voice, converts it into text, adds it to the multimedia data and sends it to the target game client.

The multimedia data transmission module may further include a speech recognition module;

After the multimedia data transmission module receives the multimedia data including voice data, the voice recognition module recognizes the voice, converts it into text, and sends it to the multimedia input/output device together with the converted multimedia signal.

The multimedia signal input/output device may include: voice input/output device and/or video input/output device;

The voice input/output device receives the voice signal input by the user, or outputs to the user the voice signal received from the multimedia data transmission module; video signal.

In order to achieve the third aspect of the above object, the present invention provides a method for realizing multimedia information communication in an online game system. The method sets the multimedia information receiving conditions of the game client on the game server, and the process of performing multimedia information communication includes the following steps:

A. The game client sends a request to the game server to obtain the information of the target game client;

B. After receiving the request, the game server determines the target game client according to the set multimedia information receiving conditions, and returns the target game client information to the game client;

C. The game client converts the multimedia signal input by the user into multimedia data, and sends the multimedia data to the target game client according to the target game client information;

D. After the target game client receives the multimedia data, it converts it into a multimedia signal and outputs it to the user.

The multimedia information receiving conditions of the game client may include one or more of the following:

a1. The game client of the game role that is set within the predetermined range around the game role corresponding to the game client game account in the game can receive multimedia information; then the method for determining the target game client described in step B is:

The game server obtains the game account of the game character within a predetermined range according to the position of the game character corresponding to the game account sending the multimedia data, and determines the game client corresponding to the obtained game account as the target game client;

a2. Set the game client of the game role that has a predetermined game relationship with the game client game account to be able to receive multimedia information; then the method for determining the target game client described in step B is:

The game server obtains the game account of the game character having a predetermined game relationship with the game account according to the game account sending the multimedia data, and determines the game client corresponding to the obtained game account as the target game client;

a3, the designated target game client in the multimedia data packet is set to receive multimedia information; then the method for determining the target game client described in step B is:

The game server reads the information of the specified target game client from the multimedia data packet, and determines the specified target game client as the target game client.

The step B may further include: after receiving the target game client information returned by the server, the game client saves the information and uses it when sending multimedia data to the target game client next time.

The process that the game client in step C converts the user input multimedia signal into multimedia data may include:

C1. The game client records the input multimedia signal;

C2. The game client encodes the recorded multimedia signal and packs it into multimedia data;

The method for the target game client to convert the multimedia data into a multimedia signal in step D is: the target game client unpacks the multimedia data and decodes it into a multimedia signal.

The multimedia signal may be a voice signal, a video signal or a combination of both.

The step C1 may further include: if the game client receives multimedia data during the recording of the multimedia signal, temporarily storing the received multimedia data; after the recording is completed, converting the received multimedia data into a multimedia signal for output.

Said step C may further comprise:

The game client sends a multimedia information transmission request to the target game client, and after the target game client accepts the request, the two parties establish a connection using a communication port preset for transmitting multimedia data to send and receive multimedia data.

The method for sending the multimedia data to the target game client as described in step C may be: using connectionless user datagram protocol to transmit the multimedia data, and transmitting the multimedia data to the target game client via the network.

The step D may further include: the target game client recognizes the voice data in the received multimedia data, and converts the voice data into text; while the target game client outputs the multimedia signal, it displays and outputs the converted text to the user.

The method for the user to input the multimedia signal described in step C can be: the voice input/output device of the client where the game client is located receives the voice signal input by the user; the video input/output device of the client where the game client is located obtains the video signal;

The method of outputting the multimedia signal to the user as described in step D is: play the voice signal by the voice input/output device of the client where the game client is located; play the video signal by the video input/output device of the client where the game client is located.

In order to achieve the fourth aspect of the above object, the present invention provides an online game system, the system includes: a game server and a client computer equipped with a multimedia signal input/output device and a game client, the game client includes a game Processing module; characterized in that: the game client further includes a multimedia data transmission module;

The game processing module of the game client sends a request for obtaining target game client information to the game server, and sends the target game client information returned by the game server to the multimedia data transmission module;

The multimedia signal input/output device receives the multimedia signal input by the user and sends it to the multimedia data transmission module of the game client; or receives the multimedia signal from the multimedia data transmission module and outputs it to the user;

The multimedia data transmission module converts the received multimedia signal into multimedia data, and sends the multimedia data to the target game client according to the information of the target game client; or converts the received multimedia data into a multimedia signal and sends it to the multimedia signal input/output equipment;

The game server sets the multimedia information reception condition of the game client, after it receives the information request of the target game client, determines the target game client according to the game client information for sending multimedia data and the multimedia information reception condition set, and sets the target game client Game client information is returned to the game client.

Wherein, the multimedia data transmission module may further include a speech recognition module;

After the multimedia data transmission module receives the multimedia data including voice data, the voice recognition module recognizes the voice, converts it into text, and sends it to the multimedia signal input/output device together with the converted multimedia signal.

The multimedia signal input/output device may include: voice input/output device and/or video input/output device;

The voice input/output device receives the voice signal input by the user, or outputs to the user the voice signal received from the multimedia data transmission module; video signal.

It can be seen from the above-mentioned technical solutions that the first online game system of the present invention realizes the method for multimedia information communication and the first online game system interacts with the game server through the game client, and the game server interacts with the game server according to the information of the game client and the preset game The multimedia information reception condition of the client terminal obtains the information of the target game client, and forwards the multimedia information sent by the game client to the target game client. The second online game system realizes the multimedia information communication method and the second online game system. The game client interacts with the game server through the game client. The game client obtains information such as the address of the target game client from the game server. address and other information, and directly send the multimedia information to the target game client. It realizes multimedia information communication inside the online system, simplifies user operations, and reduces system resource consumption.

Description of drawings

FIG. 1 is a schematic diagram of the structure and principle of voice communication when using online game services in the prior art.

Fig. 2 is the flowchart of multimedia information communication when using online game service in the first preferred embodiment of the present invention;

The online gaming system of the second preferred embodiment of the present invention of Fig. 3;

Fig. 4 is the flow chart of carrying out multimedia information communication when using the online game service in the embodiment shown in Fig. 3;

Fig. 5 is the online game system of the third preferred embodiment of the present invention;

FIG. 6 is a flow chart of multimedia information communication when using online game services in the embodiment shown in FIG. 5;

Fig. 7 is the online game system of the fourth preferred embodiment of the present invention;

FIG. 8 is a flow chart of multimedia information communication when using online game services in the embodiment shown in FIG. 7;

Fig. 9 is the online game system of the fifth preferred embodiment of the present invention;

FIG. 10 is a flow chart of multimedia information communication when online game service is used in the embodiment shown in FIG. 9 .

Detailed ways

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and five embodiments.

The invention provides two methods and systems for realizing multimedia information communication in online game systems. The main idea of the first type is: the game client interacts with the game server, and the game server obtains the target game client information according to the information of the game client and the pre-set multimedia information receiving conditions of the game client, and sends the multimedia information sent by the game client Forward to the target game client.

The second method for realizing multimedia information communication in an online game system and the main idea of the corresponding system are: the game client interacts with the game server to obtain information such as the address of the target game client, and the game client, based on the obtained address and other information, Directly send multimedia information to the target game client.

The following five preferred embodiments are used to describe the above two implementation methods and systems in detail respectively.

First preferred embodiment:

This embodiment is the above-mentioned first implementation method. In this embodiment, the structure of the game server and the game client is not modified, but the multimedia data processing flow is added, and the multimedia information reception conditions of the game client are preset on the game server. . Referring to FIG. 2, FIG. 2 is a flow chart of multimedia information communication when online game service is used in the first preferred embodiment of the present invention. The process includes the following steps:

In step 201, the game client interacts with the game server to establish a multimedia data transmission channel.

This step is relatively simple to implement: the game client sends a request to the game server to establish a multimedia data channel according to the command input by the user; after the game server accepts the request, it designates a port for receiving multimedia data and sends Return to the game client. If the game server has already designated a port for receiving multimedia data, then the port information can be directly returned to the game client. The game client opens a communication channel to connect to the port specified by the server, and establishes a multimedia data transmission channel. The multimedia data transmission channel established in the present invention can be independent of the game data transmission channel, that is, a communication port different from that used for sending and receiving game data, and the specific bearer protocol can be packet data communication protocols such as TCP/IP, UDP, SIP, and HTTP.

Step 202, the game client receives the multimedia signal input by the user and records it. The multimedia signal in the present invention is a voice signal or a video signal, or a combination of a voice signal and a video signal.

In this step, the game client first receives an instruction input by the user through an input device such as a button or a touch screen, enters the state of sending multimedia data, and starts recording multimedia signals. In this step, the multimedia signal can be recorded as multimedia data in a file format.

During the recording period, if the multimedia data packet sent by the game server is received, it will not be played temporarily, so as not to affect the recording. After the recording is completed, the multimedia data packet to be output will be converted into a multimedia signal and then played.

Step 203, the game client obtains the multimedia signal stream according to the recording completion instruction input by the user, and then compresses and codes the multimedia signal stream, then packs it into multimedia data, and adds game client information such as the address of the game client or the game account number, through The established multimedia data transmission channel is sent to the game server.

Step 204, the game server determines the target game client according to the game client information and the preset multimedia information receiving conditions of the game client, and judges whether the client has established a multimedia data transmission channel with the server, and if so, executes Step 206; otherwise, execute step 205.

In this step, the game server determines the target game client according to the information of the game client sending the multimedia data, such as address or game account, and the multimedia information reception conditions of the game client. Usually the game server will store the corresponding relationship between the address of the game client and the game account, so no matter whether the information of the game client received by the game server is either the address or the game account, it can be converted into another one according to the above corresponding relationship. . This conversion is mainly because the game server often communicates with the game client based on the address of the game client, such as the IP address, and the game server generally needs the game account information of the game client when determining the target game client according to the receiving conditions of the multimedia information. When receiving the multimedia data packet sent by the game client, the address information of the game client can be obtained directly, and then the address information is converted into game account information according to the corresponding relationship, and then the target game client is determined according to the game account and multimedia information receiving conditions. Of course, the game account information may also be included directly in the multimedia data packet sent by the game client, so as to reduce the system processing load caused by the conversion by the game server.

In this embodiment, the multimedia information receiving condition includes at least one of the following:

1. Set in the game, the game client of the game character within the predetermined range around the game character corresponding to the game account of the game client can receive multimedia data. In this manner, the game server obtains the game account of the game character within a predetermined range according to the position of the game character corresponding to the game account sending the multimedia data, and determines the game client corresponding to the obtained game account as the target game client.

The location information is coordinates or area identification. The game server will record and update the position information of the game character in the game in real time, and the position information is coordinates. The position information of the game map and the character is represented by coordinates, and other game characters located within a preset radius range of the game character sending the multimedia data can receive the multimedia information. That is, after the game server receives the multimedia data, it determines the game account that can receive the multimedia data according to the position information of the game character corresponding to the game account that sent the multimedia data, and the preset radius or square range, that is, the game server queries and obtains Those game accounts whose location information is within the predetermined range of the game character's location, then send the multimedia data to the game client corresponding to these game accounts. In this way, users corresponding to other characters located near the game character can receive multimedia information. If the game character sending the multimedia data is located in a closed area in the game map, such as a room, the game server is further limited within the closed area.

In addition, the game map can also be divided into some areas, each area corresponds to an area identifier, and the game character in the same area as the game character sending the multimedia data can receive the multimedia information. That is, after receiving the multimedia data, the game server determines the game account that can receive the multimedia data according to the region where the game character corresponding to the game account that sends the multimedia data is located, and then sends the multimedia data to the game client corresponding to the game account. When a game character enters or leaves an area, the corresponding position information of the game character stored on the game server is updated, and the position information is an area identifier. The areas in the game may correspond to scenes or map areas in the game, such as rooms, squares, game tables, and so on.

2. Set the game client of the game character that has a predetermined game relationship with the game account of the game client to be able to receive multimedia information. In this way, the game server obtains the game account of the game character having a predetermined game relationship with it according to the game client information such as the game account that sends the multimedia data, and determines the game client corresponding to the obtained game account as the target game client. The relationship of the game account can be companion, opponent or viewer.

For example, the game characters in the same game room or game table can receive multimedia information, that is, an organizational unit in the game, such as companions or opponents in games such as chess and cards, or viewers can receive multimedia information. After the game server receives the multimedia data, according to the above settings, the game characters located in the same game room or game table as the game account sending the multimedia data are determined as receivable users, and the game client addresses of these game accounts are obtained. This method has nothing to do with the position of the game character, and is suitable for chess and card games and battle games.

The game server records the relationship between game accounts, and the relationship between companions and opponents in the game is generally recorded on the game server at the beginning of the game, and the game server will update in real time, such as when a spectator joins.

3. Set the target game client specified in the multimedia data packet to be able to receive multimedia data, that is, directional multimedia information communication. In this way, the game client adds information such as the object identifier of the recipient, such as the game account or account list, into the multimedia data packet. After receiving the data packet, the game server determines the target game client according to the recipient information specified in the multimedia data packet, that is, the target game client information.

The conditions set above can limit the multimedia data to be sent within a reasonable range, instead of broadcasting to all users, the multimedia data has a large amount of data and is not suitable for broadcasting like text information. The multimedia information reception conditions are usually set in the game processing flow by the game server, and the game server may include a program processing flow for processing one or more multimedia information reception conditions. For example, RPG role-playing games can adopt the above-mentioned first multimedia information receiving condition, chess and card games can adopt the second multimedia information receiving condition, and the third multimedia information receiving condition can be adopted in all types of games.

Step 205, the game server interacts with the target game client to establish a multimedia data transmission channel. In this step, the game server initiates a request to the target game client, and sends the port information for receiving multimedia data specified in step 201 to the target game client. After the target game client accepts the request, it opens a communication channel to connect to the port specified by the server to establish a multimedia data transmission channel. In fact, the multimedia data transmission channel is the corresponding relationship between the communication ports established when the game server and the game client communicate. The multimedia data transmission between the corresponding ports of the game server and the game client can be carried by a connected TCP/IP, or Hosted over connectionless UDP.

Step 206, the game server sends the multimedia data to the target game client through the established multimedia data transmission channel.

In step 207, the target game client unpacks, decodes, and decompresses the multimedia data, and then outputs it to the user.

In this embodiment, the game client can also set a flag that prohibits receiving multimedia data, and this setting can be saved on the game client or on the game server. If it is saved in the game client, it can reject the request according to the setting when receiving the request from the game server to establish a multimedia data channel; it can also not unpack the multimedia data according to the setting and output the multimedia data to the user. Of course, this setting is preferably saved on the game server, so that the game server checks this setting before sending multimedia data, and judges whether the sign of prohibiting receiving multimedia data is set, and if so, does not send multimedia data to it. Compared with setting not to output the received multimedia data, it avoids occupying communication network resources.

Second preferred embodiment:

This embodiment is the above-mentioned first implementation method. In this embodiment, the structure of the game server and the game client is modified, and the game server pre-sets the multimedia information receiving conditions of the game client. Referring to Fig. 3, Fig. 3 is an online game system according to a second preferred embodiment of the present invention. The online game system includes: n clients 300 and a game server 310 . Wherein, the client 300 includes a game client 301 and a multimedia signal input/output device 302 , and the game client 301 includes a game processing module 303 and a multimedia data transmission module 304 . The game server 310 includes a multimedia data processing unit 311 and a game service unit 312 .

In addition to the game processing module 303 of the game client 301 in the present embodiment carrying out game data interaction with the game service unit 312 in the game server 310 to realize game functions, the game processing module 303 also interacts with the game service unit 312 to establish multimedia Data transmission channel. After setting up the multimedia data transmission channel, the game processing module 303 in the game client 301 sends the transmission channel information to the multimedia data transmission module 304; the game service unit 312 in the game server 310 sends the transmission channel information to the multimedia data processing Unit 311.

The multimedia signal input/output device 302 of the game client 301 may include an audio signal input/output device or a video input/output device. It receives the multimedia signal input by the user and sends it to the multimedia data transmission module 304, or receives the multimedia signal from the multimedia data transmission module 304 and outputs it to the user.

The multimedia data transmission module 304 of the game client 301 receives the multimedia signal sent by the multimedia signal input/output device 302, converts it into multimedia data, and sends it to the server 310 through the multimedia data transmission channel according to the multimedia data transmission channel information; or transmits the multimedia data according to the multimedia data transmission channel information. The channel information receives the multimedia data sent by the server 310 through the multimedia data transmission channel, converts it into a multimedia signal and sends it to the multimedia signal input/output device 302 .

The game service unit 312 of the game server 300 not only stores game service logic for game processing, but also sets multimedia information receiving condition program processing logic. It receives the request for obtaining the target game account that includes the game account of the multimedia data sent by the multimedia data processing unit 311, and identifies the game account that can receive the multimedia data of the game account according to the sender's game client information and the set multimedia information receiving conditions. Send to the multimedia data processing unit 311. In this embodiment, the condition for receiving multimedia information set by the game service unit 312 is the same as that in Embodiment 1, and will not be repeated here.

The multimedia data processing unit 311 receives multimedia data through the multimedia data transmission channel according to the multimedia data transmission channel information. And according to the game client information such as the game account in the received multimedia data packet, request the game service unit 312 to obtain the target game client information, after obtaining the target game client information that can receive the multimedia data sent by the game client, according to the Information such as the game account ID, the multimedia data is sent to the target game client through the multimedia data transmission channel. Before sending the multimedia data, the multimedia data processing unit 311 first judges whether the server has established a multimedia data transmission channel with the target game client, if established, then directly sends; if not established, then notifies the game service unit 312 to establish a multimedia data channel After the channel is established, the multimedia data processing unit 311 sends the multimedia data through the multimedia data channel.

In practical applications, one or more dedicated computers can be set up as the multimedia data processing unit 311 .

Referring to FIG. 4 , FIG. 4 is a flow chart of multimedia information communication when online game service is used in the embodiment shown in FIG. 3 . The process includes the following steps:

Step 401, the game processing module of the game client interacts with the game service unit to establish a multimedia data transmission channel. This step is basically the same as step 201 in Embodiment 1, and will not be repeated here.

Step 402, the game service unit sends the multimedia data channel information to the multimedia data processing unit; the game processing module sends the multimedia data channel information to the multimedia data transmission module.

Step 403, the multimedia data transmission module of the game client receives and records the multimedia signal input by the user through the multimedia signal input/output device. This step is basically the same as step 202 in Embodiment 1, and will not be repeated here.

Step 404, the multimedia data transmission module obtains the audio stream according to the recording completion instruction input by the user, and then compresses and encodes the audio information stream and/or video information stream, packs them into multimedia data, and adds the game account number and IP address of the game client and other game client information are sent to the game server through the established multimedia data transmission channel.

Step 405, the multimedia data processing unit of the game server receives the multimedia data through the multimedia data transmission channel, interacts with the game service unit, determines the target game client, and acquires the information of the target game client.

In this step, the multimedia data processing unit sends to the game service unit a request for obtaining target game client information that includes the game client information for sending multimedia data, and the game service unit receives the information according to the sender's game client information and preset multimedia information reception conditions. , determine the target game client, and send the game account identifier that can receive the multimedia information sent by the game client to the multimedia data processing unit.

Step 406, the multimedia data processing unit judges whether the target game client has established a multimedia data transmission channel with the server, if yes, execute step 408; otherwise, execute step 407.

Step 407, notify the game service unit to interact with the game processing module of the target game client to establish a multimedia data transmission channel. The process of establishing a multimedia data channel in this step is basically the same as step 205 in Embodiment 1, and will not be repeated here.

Step 408, the multimedia data processing unit sends the multimedia data to the multimedia data transmission module of the target game client through the established multimedia data transmission channel.

In step 409, the multimedia data transmission module of the target game client unpacks and decodes the multimedia data, and outputs the multimedia data to the user through the multimedia signal input/output device.

The third preferred embodiment:

This embodiment is also the above-mentioned first implementation method. In this embodiment, the structures of the game server and the game client are modified, and the game server pre-sets the multimedia information receiving conditions of the game client. Referring to Fig. 5, Fig. 5 is an online game system according to a third preferred embodiment of the present invention. The online game system includes: n clients 500 and a game server 510 . Wherein, the client 500 includes a game client 501 and a multimedia signal input/output device 502 , and the game client 501 includes a game processing module 503 and a multimedia data transmission module 504 . The game server 510 includes an access unit 511 and a game service unit 512 .

The game processing module 503 of the game client 501 interacts with game data through the access unit 511 in the game server 510 and the game service unit 512 to realize game functions, and the game processing module 503 also interacts with the game service unit 512 through the access unit 511. Interaction, establishing a multimedia data transmission channel, and messages can be exchanged in the form of game data during the interaction process.

After the multimedia data transmission channel is established, the game processing module 503 in the game client 501 sends the transmission channel information to the multimedia data transmission module 504; the game service unit 512 in the game server 510 sends the transmission channel information to the access unit 511.

In this embodiment, the multimedia signal input/output device 502 of the game client 501 may include an audio signal input/output device or a video input/output device. It receives the multimedia signal input by the user and sends it to the multimedia data transmission module 504, or receives the multimedia signal from the multimedia data transmission module 504 and outputs it to the user.

The multimedia data transmission module 504 of the game client 501 receives the multimedia signal sent by the multimedia signal input/output device 502, converts it into multimedia data, and sends it to the server 510 through the multimedia data transmission channel according to the multimedia data transmission channel information; or transmits the multimedia data according to the multimedia data transmission channel information. The channel information receives the multimedia data sent by the server 510 through the multimedia data transmission channel, converts it into a multimedia signal and sends it to the multimedia signal input/output device 502 .

The access unit 511 in the game server 510 is used for accessing data messages of different protocols, such as TCP protocol, WAP protocol, and short message. After the access unit 511 receives the data, it judges whether it is multimedia data or game data according to the input port information or the multimedia data identifier that is preset and added to the multimedia data. If it is game data, it is sent to the game service unit 512. If it is multimedia data data, the data is temporarily stored, and according to the sending multimedia data game client information contained in the data, send to the game service unit 512 a request for obtaining the target game client information including the sending multimedia data game account, and the game service unit 512 according to the sending The information of the party game client and the preset multimedia information receiving conditions determine the target game client, and send the information of the target game client that can receive the multimedia data sent by the game client to the access unit 511. The access unit 511 sends the information to the target game client through the multimedia data transmission channel according to the target game client information.

Before sending the multimedia data, the access unit 511 first judges whether the server has established a multimedia data transmission channel with the target game client, if established, then directly sends; if not established, then notifies the game service unit 512 to establish a multimedia data channel, After the channel is established, the access unit 511 sends the multimedia data through the multimedia data channel.

In practical applications, multimedia data can also be sent to the game service unit 512, and the game service unit 512 can judge whether it is multimedia data data. If it is multimedia data, it can be forwarded to the target game client through the access unit 511. In this way, Compared with this embodiment, it consumes more system resources and is generally not used.

The game service unit 512 of the game server 500 not only stores game service logic for game processing, but also sets multimedia information receiving conditions. It receives the target game client information request sent by the access unit 511 and includes the game client information for sending multimedia data. The game client information of the multimedia data is sent to the access unit 511 . In this embodiment, the multimedia information receiving condition set by the game service unit 512 is the same as that in Embodiment 1, and will not be repeated here.

Referring to FIG. 6 , FIG. 6 is a flow chart of multimedia information communication when online game service is used in the embodiment shown in FIG. 5 . The process includes the following steps:

In step 601, the game processing module of the game client interacts with the game service unit through the access unit to establish a multimedia data transmission channel. This step is basically the same as step 201 in Embodiment 1, and will not be repeated here.

Step 602, the game service unit sends the multimedia data channel information to the access unit; the game processing module sends the multimedia data channel information to the multimedia data transmission module.

Step 603, the multimedia data transmission module of the game client receives and records the multimedia signal input by the user through the multimedia signal input/output device. This step is basically the same as step 202 in Embodiment 1, and will not be repeated here.

Step 604, the multimedia data transmission module obtains the audio stream according to the recording completion instruction input by the user, then compresses and codes the audio stream, and packs it into multimedia data; and adds the game account of the game client, and/or IP address and other game clients The information is sent to the game server through the established multimedia data transmission channel.

Step 605, the access unit of the game server receives the data, and judges whether the data packet is multimedia data or game data according to the port information in the data packet or the preset multimedia data identification, if it is multimedia data, then perform step 607; if it is a game data, step 606 is executed.

Step 606, the access unit sends the game data to the game service unit for game processing.

Step 607, the access unit temporarily stores the multimedia data, and interacts with the game service unit according to the information of the game client sending the multimedia data included in the data, determines the target game client, and acquires the target game client information.

In this step, the access unit sends to the game service unit a request for obtaining target game client information including the game client information such as the game account for sending multimedia data, and the game service unit receives the information according to the sender’s game client information and preset multimedia information. The condition is to determine the target game client, and send the information of the target game client that can receive the multimedia data sent by the game client to the access unit.

Step 608, the access unit judges whether the target game client has established a multimedia data transmission channel with the server, if yes, execute step 610; otherwise, execute step 609.

Step 609, the game service unit interacts with the game processing module of the target game client through the access unit to establish a multimedia data transmission channel. This step is basically the same as step 205 in Embodiment 1, and will not be repeated here.

Step 610, the access unit sends the multimedia data to the multimedia data transmission module of the target game client through the established multimedia data transmission channel.

In step 611, the multimedia data transmission module of the target game client unpacks, decodes and decompresses the multimedia data, and outputs the multimedia data to the user through the multimedia signal input/output device.

Fourth preferred embodiment:

This embodiment is also the above-mentioned first implementation method. In this embodiment, the structures of the game server and the game client are modified, and the game server pre-sets the multimedia information receiving conditions of the game client. Referring to Fig. 7, Fig. 7 is an online game system according to a fourth preferred embodiment of the present invention. The online game system includes: n clients 700 and a game server 710 . Wherein, the client 700 includes a game client 701 and a multimedia signal input/output device 702 , and the game client 701 includes a game processing module 703 and a multimedia data transmission module 704 . The game server 710 includes an access unit 711 , a game service unit 712 and a multimedia data processing unit 713 .

The game processing module 703 of the game client 701 performs game data interaction with the game service unit 712 through the access unit 711 in the game server 710 to realize game functions, and the game processing module 703 also interacts with the game service unit 712 through the access unit 711. Interaction, establishing a multimedia data transmission channel, and messages can be exchanged in the form of game data during the interaction process.

After the multimedia data transmission channel is established, the game processing module 703 in the game client 701 sends the transmission channel information to the multimedia data transmission module 704; the game service unit 712 in the game server 710 sends the transmission channel information to the access unit 711.

In this embodiment, the multimedia signal input/output device 702 of the game client 701 may include an audio signal input/output device or a video input/output device. It receives the multimedia signal input by the user and sends it to the multimedia data transmission module 704, or receives the multimedia signal from the multimedia data transmission module 704 and outputs it to the user.

The multimedia data transmission module 704 of the game client 701 receives the multimedia signal sent by the multimedia signal input/output device 702, converts it into multimedia data, and sends it to the server 710 through the multimedia data transmission channel according to the multimedia data transmission channel information; or transmits the multimedia data according to the multimedia data transmission channel information. The channel information receives the multimedia data sent by the server 710 through the multimedia data transmission channel, converts it into a multimedia signal and sends it to the multimedia data input/output device 702 .

The access unit 711 in the game server 710 is used for accessing data messages of different protocols, such as TCP protocol, WAP protocol, and short message. After receiving the data, the access unit 711 judges whether it is multimedia data or game data according to the port information or the preset multimedia data identifier added to the multimedia data. If it is game data, it is sent to the game service unit 712. If it is multimedia data, it is sent to the multimedia data processing unit 713.

The multimedia data processing unit 713 temporarily stores the multimedia data, and sends to the game service unit 712 a request for obtaining target game client information including the game client information for sending the multimedia data according to the game client information for sending the multimedia data contained in the data, and the game The service unit 712 determines the target game client according to the sender game client information and preset multimedia information receiving conditions, and sends the game client information that can receive the multimedia data sent by the game client to the multimedia data processing unit 713 . The multimedia data processing unit 713 transmits the multimedia data transmission channel to the target game client through the access unit 711 according to the game account of the target game client.

Before sending the multimedia data, the multimedia data processing unit 713 first judges whether the server has established a multimedia data transmission channel with the target game client, if established, then directly sends it through the access unit 711; if not established, then notifies the game service unit 712 establishes a multimedia data channel. After the channel is established, the multimedia data processing unit 713 uses the multimedia data transmission channel to send the multimedia data through the access unit 711 .

The game service unit 712 of the game server 700 not only stores game service logic for game processing, but also sets multimedia information reception conditions. It receives the target game client information request sent by the multimedia data processing unit 713 and includes the game client information for sending multimedia data, and can receive the game client according to the sender game client information and the set multimedia information receiving conditions. The game client information of the sent multimedia data is sent to the multimedia data processing unit 713 . In this embodiment, the voice reception conditions set by each game client stored in the game service unit 712 are the same as those in Embodiment 1, and will not be repeated here.

In addition, the multimedia data processing unit of the game server in the embodiment shown in Fig. 3 and Fig. 7 can also include a voice recognition unit, and after the multimedia data processing unit receives the multimedia data comprising voice data, the voice is recognized by the voice recognition module, And convert it into text, add it to the multimedia data and send it to the target game client. The multimedia input/output device of the target game client can output the received text display to the user while outputting the multimedia signal.

The game client can set whether to receive the option of multimedia data in the game server, or whether to receive the option of the text after the voice recognition, or whether to receive the option of the text after the multimedia data and the voice recognition simultaneously; Voice receiving option Send voice, text or send voice and text at the same time, so that the same voice information can be sent to the game client in different forms.

Similarly, the access unit of the game server in the embodiment described in Fig. 5 may also include a voice recognition module; after the access unit receives the multimedia data comprising voice data, the voice is recognized by the voice recognition module and converted into text , added to the multimedia data and sent to the target game client.

Of course, the voice recognition module can also be set in the game client, for example, in the multimedia data transmission module of the game client in the embodiments shown in FIG. 3 , FIG. 5 , and FIG. 7 . After the multimedia data transmission module receives the multimedia data containing voice data, the voice is recognized by the voice recognition module, and converted into text, and sent to the multimedia signal input/output device together with the converted multimedia signal, and the multimedia signal input/output device The received text display can be output to the user while outputting the multimedia signal.

Such processing can make the client computer that is shielded from voice communication or the client computer that is not suitable for receiving voice, such as the surrounding environment noisy, or used in the case of hearing impairment, etc., also receive corresponding information.

Referring to FIG. 8 , FIG. 8 is a flow chart of multimedia information communication when online game service is used in the embodiment shown in FIG. 7 . The process includes the following steps:

Step 801, the game processing module of the game client interacts with the game service unit through the access unit to establish a multimedia data transmission channel. This step is basically the same as step 201 in Embodiment 1, and will not be repeated here.

Step 802, the game service unit sends the multimedia data channel information to the access unit; the game processing module sends the multimedia data channel information to the multimedia data transmission module.

Step 803, the multimedia data transmission module of the game client receives and records the multimedia signal input by the user through the multimedia signal input/output device. This step is basically the same as step 202 in Embodiment 1, and will not be repeated here.

Step 804, the multimedia data transmission module obtains the audio stream according to the recording completion instruction input by the user, then compresses and encodes the audio information stream and/or video information stream, and packs it into multimedia data; and adds the game account and/or The game client information such as the IP address is sent to the game server through the established multimedia data transmission channel.

Step 805, the access unit of the game server receives the data, and judges whether the data packet is multimedia data or game data according to the port information in the data packet or the preset multimedia data identification, if it is multimedia data, then execute step 807; data then go to step 806.

Step 806, the access unit sends the game data to the game service unit for game processing.

Step 807, the access unit sends the multimedia data to the multimedia data processing unit.

Step 808, the multimedia data processing unit temporarily stores the multimedia data, and interacts with the game service unit to determine the target game client and obtain the target game client information according to the game client information contained in the data, such as the game account for sending the multimedia data.

In this step, the multimedia data processing unit sends to the game service unit a request for obtaining target game client information that includes sending multimedia data game client information, and the game service unit according to the sender game client information and preset multimedia information receiving conditions, Determine the target game client, and send the information of the game client capable of receiving the multimedia data sent by the game client to the multimedia data processing unit.

Step 809, the multimedia data processing unit judges whether the target game client has established a multimedia data transmission channel with the server, if yes, execute step 811; otherwise, execute step 810.

Step 810, the game service unit interacts with the game processing module of the target game client through the access unit to establish a multimedia data transmission channel. This step is basically the same as step 205 in Embodiment 1, and will not be repeated here.

Step 811, the multimedia data processing unit transmits the multimedia data to the multimedia data transmission module of the target game client through the access unit and using the established multimedia data transmission channel.

Step 812: After the multimedia data transmission module of the target game client unpacks, decodes and decompresses the multimedia data, it outputs the multimedia data to the user through the multimedia signal input/output device.

In the above four embodiments, if the user ends a game, the game processing module of the game client notifies the game server to close the multimedia data transmission channel with the game client. If the game client ends the game abnormally, the game server closes the multimedia data transmission channel with the game client after detecting that the game client is offline.

Fifth preferred embodiment:

This embodiment is the second implementation method above. In this embodiment, the structure of the game client is modified, and the game server pre-sets the multimedia information receiving conditions of the game client. Referring to Fig. 9, Fig. 9 is an online game system according to a fifth preferred embodiment of the present invention. The system includes: n clients 900 and a game server 910 . Wherein, the client 900 includes a game client 901 and a multimedia signal input/output device 902 , and the game client 901 includes a game processing module 903 and a multimedia data transmission module 904 .

The game processing module 903 of the game client 901 interacts with the game data of the game server 910 to realize game functions, and the game processing module 903 also interacts with the game server 910 to obtain information such as the address of the target game client, and sends the information to the multimedia Data transmission module 902 .

The game server 900 in this embodiment not only stores game service logic for game processing, but also sets multimedia information receiving conditions. It receives the request for obtaining the target game client information sent by the game processing module 903, and returns the game client information that can receive the multimedia data sent by the game client to the The game processing module 903 of the game client 901 , the game processing module 903 sends the identification to the multimedia data transmission module 904 . In this embodiment, the condition for receiving multimedia information set by the game server 910 may be the same as that in Embodiment 1, and will not be repeated here.

The multimedia data transmission module 904 receives the multimedia signal sent by the multimedia signal input/output device 902, converts it into multimedia data, and sends it to the target game client according to the address information of the target game client; or receives the multimedia data sent by the target game client, and converts The multimedia signal is sent to the multimedia data input/output device 902 . The multimedia data transmission module 904 of this embodiment can also add a speech recognition module, and the specific method is completely the same as that of the first to fourth embodiments described above, and will not be repeated here.

The multimedia signal input/output device 902 may include an audio signal input/output device, and may also include a video input/output device. It receives the multimedia signal input by the user and sends it to the multimedia data transmission module 904, or receives the multimedia signal from the multimedia data transmission module 904 and outputs it to the user.

Referring to FIG. 10 , FIG. 10 is a flow chart of multimedia information communication when online game service is used in the embodiment shown in FIG. 9 . The process includes the following steps:

Step 10, the game processing module of the game client sends a request to the game server to acquire information of the target game client according to the command input by the user.

Step 11, the game server determines the target game user according to the sender's game client information and the set multimedia information receiving conditions, and returns the game client information that can receive the multimedia data sent by the game client, such as the game account ID, to The game processing module of the game client.

Step 12, the game processing module sends the game client information to the multimedia data transmission module.

Step 13, the multimedia data transmission module of the game client receives the multimedia signal input by the user through the multimedia signal input/output device, and performs recording. This step is basically the same as step 202 in Embodiment 1, and will not be repeated here.

Step 14, the multimedia data transmission module obtains the audio stream according to the recording completion instruction input by the user, then compresses and encodes the audio stream and/or video information stream, and packs it into multimedia data; and adds the game account number and/IP address of the game client Wait for the game client information, and send the target game client according to the target game client information.

The game client first sends a multimedia information transmission request to the target game client. After the target game client accepts the request, that is, after the two clients have negotiated and determined to communicate multimedia data, they use the communication port preset for transmitting multimedia data. Establish a connection and send and receive multimedia data.

In this embodiment, the multimedia data may be transmitted by using the connectionless User Datagram Protocol (UDP), and transmitted to the target game client via the network.

Step 15, after the multimedia data transmission module of the target game client unpacks and decodes the multimedia data accordingly, it is sent to the output buffer, and the audio signal input/output device and/or video input/output of the multimedia signal input/output device The device outputs to the user.

In this embodiment, after the game client receives the address of the target game client returned by the server, it can save the received address and use it when sending multimedia data next time. In this way, it is no longer necessary to go through the game server, which greatly reduces the load on the game server.

The multi-media signal input/input device of the client where the game client is located in the above-mentioned five preferred embodiments can all include a voice input/output device and/or a video input/output device, and the voice input/output device receives the voice input by the user Signal; get video signal by video input/output device; play voice signal by voice input/output device; play video signal and display text by video input/output device.

In addition, in practical applications, individualized multimedia information receiving conditions can also be set by each game client and stored in the game server, instead of using the unified multimedia information receiving conditions set by the game server, such as the personalized multimedia information set by the game client. The information receiving condition is that the game account that satisfies the set user attributes can receive multimedia information. The user attributes can be information such as age, gender, points, etc. The personalized multimedia information receiving conditions set by each game client can be the same as the above-mentioned first one by the game. The multimedia information reception conditions set by the server are used in combination. After the game server determines the game account according to the first multimedia information reception condition, it further selects a game account that satisfies the conditions according to the personalized multimedia information reception conditions set by the game client. The multimedia information sent by the game client is sent to the target game client corresponding to the finally selected game account. Moreover, the game server can also add information such as account name, nickname, and other information of the client game account that sends the multimedia data into the multimedia data packet and send it to the target game client. The target game client, while outputting the multimedia signal, can display the information of the game account that sends the multimedia data, such as account name, nickname, avatar, etc., according to the information. This enables the receiving user to clearly know the source of the speech.

The invention is applicable to the Internet and mobile communication networks based on packet data communication, such as online games in 3G mobile communication networks.

It can be seen from the above-mentioned embodiments that the two online game systems of the present invention realize multimedia information communication methods and systems thereof, which realize multimedia information communication within the online system without resorting to other information transmission tools, thus simplifying user operations. Reduced system resource consumption.

Claims (37)

1, a kind of online game system realizes the method for multimedia information communication, it is characterized in that, the method presets the multimedia information receiving condition of game client in game server, the process of carrying out multimedia information communication comprises the following steps: A. The game client interacts with the game server to establish a multimedia data transmission channel; B. The game client converts the multimedia signal input by the user into multimedia data, and sends it to the game server through the multimedia data transmission channel; C. After the game server receives the multimedia data, it determines the target game client for receiving the multimedia information according to the preset receiving conditions of the game client for multimedia information; D. The game server sends the multimedia data to the target game client through the multimedia data transmission channel; E. The target game client converts the received multimedia data into a multimedia signal and outputs it to the user. 2. The method according to claim 1, wherein the multimedia information receiving conditions of the game client include one or more of the following: a1, set in the game, the game client of the game character within the predetermined range around the game character corresponding to the game client game account can receive multimedia information; then the method for determining the target game client described in step C is: The game server obtains the game account of the game character within a predetermined range according to the position of the game character corresponding to the game account sending the multimedia data, and determines the game client corresponding to the obtained game account as the target game client; a2. Set the game client of the game role that has a predetermined game relationship with the game client game account to be able to receive multimedia information; then the method for determining the target game client described in step C is: The game server obtains the game account of the game character having a predetermined game relationship with the game account according to the game account sending the multimedia data, and determines the game client corresponding to the obtained game account as the target game client; a3, setting the designated target game client in the multimedia data packet can receive multimedia information; then the method for determining the target game client described in step C is: The game server reads the information of the specified target game client from the multimedia data packet, and determines the specified target game client as the target game client. 3. The method according to claim 1, wherein the process of establishing a multimedia data transmission channel between the game client and the game server in step A includes: A1. The game client sends a request to the game server to establish a multimedia data channel; A2. After the game server accepts the request, designate a port for receiving multimedia data, and return the information of the receiving port to the game client; or the game server returns the information of a designated port for receiving multimedia data to the game client; A3. The game client opens a communication channel to connect to the port designated by the server, and establishes a multimedia data transmission channel, which is independent of the game data transmission channel. 4. The method according to claim 1, wherein the process of converting the multimedia signal input by the user into multimedia data by the game client in step B comprises: B1. The game client records the input multimedia signal; B2. The game client encodes the recorded multimedia signal and packs it into multimedia data; The method for the target game client in step E to convert the multimedia data into a multimedia signal is as follows: the target game client unpacks the multimedia data and decodes it into a multimedia signal. 5. The method according to claim 4, wherein the multimedia signal is a voice signal, a video signal or a combination of both. 6. The method according to claim 4, wherein said step B1 further comprises: if the game client receives multimedia data during the recording of multimedia signals, temporarily storing the received multimedia data; The received multimedia data is converted into a multimedia signal output. 7. The method according to claim 4 or 5, wherein said step B2 further comprises: the game client adds the information of the game client to the multimedia data, and sends them to the game server together, and the information of the game client is The address or game account of the game client; Described step C comprises: C1. The game server obtains the information of the game client sending the multimedia data from the received multimedia data packet; C2. Determine the target game client according to the information of the game client and the receiving conditions of the multimedia information. 8. The method according to claim 1, characterized in that in step C: the game server identifies the multimedia data according to the port information in the data or preset and added to the multimedia data by the game client before sending , to determine whether the received data is multimedia data. 9. The method according to claim 1, characterized in that the step C further comprises: the game server recognizes the voice data in the received multimedia data, and converts it into text data and sends it to the target game client together with the voice data end; In the step E: the target game client outputs the received text display to the user while outputting the multimedia signal. 10. The method according to claim 9, wherein the game client further sets in the game server the option of whether to receive multimedia data, or the option of whether to receive voice-recognized text, or whether to receive both multimedia data and voice Options for recognized text; In the step C, the game server recognizes and sends the voice data according to the option. 11. The method according to claim 1, further comprising: setting in the game server in advance a sign that the game client is prohibited from receiving multimedia data; Said step C further comprises: after determining the target game client, judging whether the target game client is provided with a sign forbidding to receive multimedia data, if so, not sending multimedia data to the target game client; otherwise sending the target game client send multimedia data; Or pre-set the game client to prohibit receiving multimedia data flag on the game client; Said step E further includes: after the game client receives the multimedia data, it first judges whether the multimedia data reception prohibition flag is set, if so, does not convert the multimedia data into a multimedia signal and outputs it to the user; otherwise converts the multimedia data into a multimedia signal The signal is output to the user. 12. The method according to claim 1, wherein said step D comprises: D1. The game server judges whether a multimedia data transmission channel has been established with the target game client, and if so, execute step D3; otherwise, execute step D2; D2. The game server interacts with the target game client to establish a multimedia data transmission channel; D3. The game server sends the multimedia data to the target game client through the multimedia data transmission channel. 13. The method according to claim 12, wherein the process of establishing a multimedia data transmission channel between the game server and the target game client in step D2 includes: D21. The game server sends a request for establishing a multimedia data channel to the game client, and the request includes a designated port information for receiving multimedia data; D22. After accepting the request, the game client opens a communication channel to connect to the port designated by the server, and establishes a multimedia data transmission channel. 14. The method according to claim 1, 3, 12 or 13, further comprising: when the game client ends a game, informing the game server to close the multimedia data transmission channel with the game client; Or when the game client ends the game abnormally, the game server closes the multimedia data transmission channel with the game client after detecting that the game client is not online. 15. The method according to claim 1, wherein the step E further comprises: the target game client recognizes the voice data in the received multimedia data, and converts the voice data into text; While outputting the multimedia signal, output the converted text display to the user. 16. The method according to claim 1, 9, 11 or 15, characterized in that the method for the user to input multimedia signals in step B is: the voice input/output device of the client where the game client is located receives the input from the user Voice signal; the video signal is obtained by the video input/output device of the client computer where the game client is located; The method for outputting the multimedia signal to the user as described in step E is: play the voice signal by the voice input/output device of the client where the game client is located; play the video signal by the video input/output device of the client where the game client is located. 17. An online game system, comprising a game server and a client installed with a multimedia signal input/output device and a game client, the game client includes a game processing module; it is characterized in that: the game client further includes a multimedia data transfer module; The game processing module of the game client interacts with the game server, establishes a multimedia data transmission channel, and sends the transmission channel information to the multimedia data transmission module; The multimedia signal input/output device receives the multimedia signal input by the user and sends it to the multimedia data transmission module of the game client; or receives the multimedia signal from the multimedia data transmission module and outputs it to the user; The multimedia data transmission module converts the received multimedia signal into multimedia data, and sends the multimedia data to the game server through the multimedia data transmission channel according to the multimedia data transmission channel information; or converts the received multimedia data into a multimedia signal and sends it to the multimedia data input/output devices; The game server sets the multimedia information receiving condition of the game client, after it receives the multimedia data, determines the target game client according to the game client information and the multimedia information receiving condition for sending the multimedia data, and sends the multimedia data through the multimedia data transmission channel to the target game client. 18. The online game system according to claim 17, wherein said game server includes a game service unit and a multimedia data processing unit; The game processing module of the game client interacts with the game service unit in the game server to establish a multimedia data transmission channel, which is independent of the game data transmission channel used to transmit game data; The game service unit sends the information of the established multimedia data transmission channel to the multimedia data processing unit; and the game service unit sets the multimedia information reception condition of the game client, and obtains the target game client when receiving the multimedia data processing unit. After the information request, obtain the target game client information and return it to the multimedia data processing unit according to the game client information sending the multimedia data and the multimedia information reception condition set; After the multimedia data processing unit receives the multimedia data sent by the game client through the multimedia data transmission channel, it temporarily stores the data, and sends a request to the game service unit to obtain the information of the target game client; and receives the target game service unit returned After the game client information, it is judged whether a multimedia data transmission channel has been established with the corresponding target game client, and if established, the multimedia data is directly sent to the target game client; otherwise, the game service unit is notified to establish a link with the target game client. After connecting the multimedia data transmission channel between them, the multimedia data is sent to the target game client. 19. The online game system according to claim 17, characterized in that: said game server includes a game service unit and an access unit; The game processing module of the game client interacts with the game service unit through the access unit in the game server to establish a multimedia data transmission channel; The game service unit sends the information of the established multimedia data transmission channel to the access unit; and the game service unit sets the multimedia information reception condition of the game client, and after receiving the request for obtaining the target game client information sent by the access unit , according to the game client information for sending multimedia data and the set multimedia information receiving conditions, obtain the target game client information and return it to the access unit; After the access unit receives the data, it judges whether the data is multimedia data or game data according to the port information or the multimedia data identifier pre-set and added to the multimedia data, and if it is game data, it is sent to the game service unit for game processing; If it is multimedia data, then store the data temporarily, and send a request to obtain the target game client information to the game service unit; after receiving the target game client information returned by the game service unit, determine whether the multimedia has been established with the corresponding game client If the data transmission channel has been established, the multimedia data is directly sent to the target game client; otherwise, the game service unit is notified to establish a multimedia data transmission channel with the target game client, and then the multimedia data is sent to the target game client. 20. The online game system according to claim 17, characterized in that: said game server includes a game service unit, an access unit and a multimedia data processing unit; The game processing module of the game client interacts with the game service unit through the access unit in the game server to establish a multimedia data transmission channel; The game service unit sends the information of the established multimedia data transmission channel to the multimedia data processing unit; and the game service unit sets the multimedia information reception condition of the game client, and obtains the target game client information sent by the multimedia data processing unit After the request, obtain the target game client information and return it to the multimedia data processing unit according to the game client information for sending multimedia data and the multimedia information reception conditions set; After the access unit receives the data, it judges whether the data is multimedia data or game data according to the port information or the multimedia data identifier pre-set and added to the multimedia data, and if it is game data, it is sent to the game service unit for game processing; If it is multimedia data, it is sent to the multimedia data processing unit; After receiving the multimedia data sent by the access module, the multimedia data processing unit temporarily stores the data, and sends a request to the game service unit to obtain the target game client information; after receiving the target game client information returned by the game service unit , to determine whether a multimedia data transmission channel has been established with the corresponding game client, if established, then directly send the multimedia data to the target game client through the access unit; otherwise notify the game service unit to establish a communication with the target game client After the multimedia data transmission channel, the multimedia data is sent to the target game client through the access unit. 21. The online game system according to claim 18 or 20, characterized in that: said multimedia data processing unit further includes a speech recognition module; After the multimedia data processing unit receives the multimedia data including voice data, the voice recognition module recognizes the voice, converts it into text, adds it to the multimedia data and sends it to the target game client. 22. The online game system according to claim 19, characterized in that: said access unit further comprises a speech recognition module; After the access unit receives the multimedia data including voice data, the voice recognition module recognizes the voice, converts it into text, adds it to the multimedia data and sends it to the target game client. 23. The online game system according to claim 17, 18, 19 or 20, wherein the multimedia data transmission module further includes a speech recognition module; After the multimedia data transmission module receives the multimedia data including voice data, the voice recognition module recognizes the voice, converts it into text, and sends it to the multimedia input/output device together with the converted multimedia signal. 24. The online game system according to claim 17, wherein said multimedia signal input/output device comprises: voice input/output device and/or video input/output device; The voice input/output device receives the voice signal input by the user, or outputs to the user the voice signal received from the multimedia data transmission module; video signal. 25. A method for realizing multimedia information communication in an online game system, characterized in that the method sets the multimedia information receiving conditions of the game client on the game server, and the process of performing multimedia information communication includes the following steps: A. The game client sends a request to the game server to obtain the information of the target game client; B. After receiving the request, the game server determines the target game client according to the set multimedia information receiving conditions, and returns the target game client information to the game client; C. The game client converts the multimedia signal input by the user into multimedia data, and sends the multimedia data to the target game client according to the target game client information; D. After the target game client receives the multimedia data, it converts it into a multimedia signal and outputs it to the user. 26. The method according to claim 25, wherein the multimedia information receiving conditions of the game client include one or more of the following: a1. The game client of the game role that is set within the predetermined range around the game role corresponding to the game client game account in the game can receive multimedia information; then the method for determining the target game client described in step B is: The game server obtains the game account of the game character within a predetermined range according to the position of the game character corresponding to the game account sending the multimedia data, and determines the game client corresponding to the obtained game account as the target game client; a2. Set the game client of the game role that has a predetermined game relationship with the game client game account to be able to receive multimedia information; then the method for determining the target game client described in step B is: The game server obtains the game account of the game character having a predetermined game relationship with the game account according to the game account sending the multimedia data, and determines the game client corresponding to the obtained game account as the target game client; a3, the designated target game client in the multimedia data packet is set to receive multimedia information; then the method for determining the target game client described in step B is: The game server reads the information of the specified target game client from the multimedia data packet, and determines the specified target game client as the target game client. 27. The method according to claim 25, characterized in that said step B further comprises: after the game client receives the target game client information returned by the server, saves the information and sends it to the target game client next time Used for multimedia data. 28. The method according to claim 25, wherein the process of converting the multimedia signal input by the user into multimedia data by the game client in step C comprises: C1. The game client records the input multimedia signal; C2. The game client encodes the recorded multimedia signal and packs it into multimedia data; The method for the target game client to convert the multimedia data into a multimedia signal in step D is: the target game client unpacks the multimedia data and decodes it into a multimedia signal. 29. The method according to claim 28, wherein the multimedia signal is a voice signal, a video signal or a combination of both. 30. The method according to claim 28, characterized in that the step C1 further comprises: if the game client receives multimedia data during the recording of multimedia signals, temporarily storing the received multimedia data; The multimedia data is converted into a multimedia signal output. 31. The method according to claim 25, wherein said step C further comprises: The game client sends a multimedia information transmission request to the target game client, and after the target game client accepts the request, the two parties establish a connection using a communication port preset for transmitting multimedia data to send and receive multimedia data. 32. The method according to claim 25, characterized in that the method of sending multimedia data to the target game client in step C is: using the connectionless user datagram protocol to transmit the multimedia data, and transmitting the multimedia data to the target game client via the network end. 33. The method according to claim 25, characterized in that the step D further comprises: the target game client recognizes the voice data in the received multimedia data, and converts the voice data into text; While outputting the multimedia signal, output the converted text display to the user. 34. The method according to claim 25 or 33, wherein the method for the user to input the multimedia signal in step C is: the voice input/output device of the client machine where the game client is located receives the voice signal input by the user; The video input/output device of the client where the game client is located obtains video signals; The method of outputting the multimedia signal to the user as described in step D is: play the voice signal by the voice input/output device of the client where the game client is located; play the video signal by the video input/output device of the client where the game client is located. 35. An online game system, comprising a game server and a client installed with a multimedia signal input/output device and a game client, the game client includes a game processing module; it is characterized in that: the game client further includes a multimedia data transmission module; The game processing module of the game client sends a request for obtaining target game client information to the game server, and sends the target game client information returned by the game server to the multimedia data transmission module; The multimedia signal input/output device receives the multimedia signal input by the user and sends it to the multimedia data transmission module of the game client; or receives the multimedia signal from the multimedia data transmission module and outputs it to the user; The multimedia data transmission module converts the received multimedia signal into multimedia data, and sends the multimedia data to the target game client according to the information of the target game client; or converts the received multimedia data into a multimedia signal and sends it to the multimedia signal input/output equipment; The game server sets the multimedia information reception condition of the game client, after it receives the information request of the target game client, determines the target game client according to the game client information for sending multimedia data and the multimedia information reception condition set, and sets the target game client Game client information is returned to the game client. 36. The online game system according to claim 35, wherein said multimedia data transmission module further includes a speech recognition module; After the multimedia data transmission module receives the multimedia data including voice data, the voice recognition module recognizes the voice, converts it into text, and sends it to the multimedia signal input/output device together with the converted multimedia signal. 37. The online game system according to claim 35 or 36, wherein said multimedia signal input/output device comprises: voice input/output device and video input/output device; The voice input/output device receives the voice signal input by the user, or outputs to the user the voice signal received from the multimedia data transmission module; video signal.

Images