KR101691124B1 - System and method for providing multi-sharing of multimedia - Google Patents

Abstract

The present invention relates to a system for providing a multi-party multimedia sharing service between a plurality of user terminals via a network, and more particularly to a system for providing a multimedia sharing service between user terminals, A signal control server for performing processing; And a relay server for transmitting and receiving multimedia data for multimedia sharing between user terminals, and a method using the same.

Description

[0001] SYSTEM AND METHOD FOR PROVIDING MULTI-SHARING OF MULTIMEDIA [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a system and a method for providing a multi-party multimedia sharing service, and more particularly, to a system and a method for providing a service that can easily and efficiently share multimedia among a plurality of user terminals over a network.

Recently, a service capable of directly sharing multimedia such as voice and video between user terminals through the Internet and smart phone has recently been proposed.

However, the conventional technology only provides multimedia sharing in a 1: 1 manner, and thus there is a limit in that multimedia can be shared only by a sharer and a participant. Therefore, it is desired to develop a method that can share multimedia among user terminals in a 1: N manner not only in a 1: 1 format.

delete

Japanese Patent Application Laid-Open No. 10-2012-0111859 (published October 11, 2012) Published Japanese Patent Application No. 10-2003-0010938 (published on Mar. 2, 2003) Japanese Patent Application Laid-Open No. 10-2001-0079365 (published on Aug. 22, 2001) Published Patent Publication No. 10-2007-0067927 (published on June 29, 2007)

It is an object of the present invention to provide a system and a method for providing a service that allows a plurality of user terminals to easily and efficiently share multimedia through a network.

It is another object of the present invention to provide a system and method for providing various types of multimedia services while sharing multimedia in a 1: N manner beyond the conventional 1: 1 system.

It is another object of the present invention to provide a system and a method for easily providing a multimedia service even between terminals using different multimedia formats.

The present invention relates to a system for providing a multi-party multimedia sharing service between a plurality of user terminals through a network, comprising: a signal processing unit for managing and controlling connection of a user terminal A signal control server for performing a signaling process; And a relay server for transmitting and receiving multimedia data for multimedia sharing between user terminals.

Here, the signal control server may include: a control manager for controlling the overall operation of the signal control server; A group manager for establishing a session with a user terminal through a network and transmitting / receiving a control signal for a user terminal and a multimedia sharing service in the form of a message; A queue for receiving and storing a message from the group manager; A message detector for detecting whether a message is stored in the queue; And a message analyzing unit for analyzing a message stored in the queue when a signal indicating that the message is stored by the message detecting unit, generating a message corresponding to the message, and transmitting the message to the group manager.

The relay server includes a queue for receiving multimedia data from a user terminal, storing the received multimedia data, and outputting the multimedia data; A converter for transcoding multimedia data or multimedia data stored in the queue to correspond to a multimedia format of another user terminal; An audio transmission manager for transmitting audio data among the multimedia data output from the conversion unit to a user terminal; And a video transmission manager for transmitting the video data among the multimedia data output from the conversion unit to the user terminal.

The conversion unit may convert the multimedia data corresponding to the multimedia format of the corresponding user terminal when the conversion is required by referring to the multimedia format of the other user terminal participating in the multimedia service, and output the converted multimedia data.

According to another aspect of the present invention, there is provided a method for providing a multimedia sharing service by a system for providing a multi-party multimedia sharing service, the method comprising: receiving a multimedia sharing service preparation notification signal from a first user terminal, A first step of transmitting a multimedia sharing invitation announcement signal to a second user terminal, which is another user terminal, correspondingly; A second step of receiving a multimedia sharing service participation request signal including multimedia format information of each of the first user terminal and the second user terminal from the first user terminal and the second user terminal; A third step of receiving multimedia data from the first user terminal according to the multimedia format information of the first user terminal; A fourth step of converting the received multimedia data according to the multimedia format information of the second user terminal; And a fifth step of transmitting the converted multimedia data to the second user terminal.

According to the present invention, it is possible to provide a system and a method for providing a service that can easily and efficiently share multimedia among a plurality of user terminals over a network.

In addition, the present invention can provide a system and a method for providing various types of multimedia services while sharing multimedia in a 1: N manner beyond the conventional 1: 1 method.

In addition, the present invention can provide a system and method for easily providing a multimedia service even between terminals using different multimedia formats.

In addition, according to the present invention, the functions supported by the services of the A / S field, the mobile video broadcast field, and the mobile music broadcast service of a smart terminal requiring a plurality of technical support are basically integrated and provided in each system, Services to be integrated. In addition, when information such as the codec supported by each terminal is wrong, it is possible to share video / audio between different terminals through transcoding, so that the service can be easily expanded.

Conventionally, in order to process one piece of media, a separate processing equipment for each piece of media has been required. On the other hand, the present invention can be applied to a case where only a type of a piece of media added in one platform is added to the interworking standard This has the advantage of reducing investment and operating costs.

In addition, according to the present invention, since a plurality of participants can share multimedia in real time, the service can be easily expanded. In particular, a broadcast-based service such as video / audio can be easily constructed using the platform of the present invention.

In addition, the present invention can provide various services simultaneously by providing various multimedia in a single platform, and can save initial investment cost and investment cost for system operation when providing new media service.

1 is a diagram illustrating a connection relationship between a system 100 for providing a multi-party multimedia sharing service and a user terminal 200 according to the present invention.
2 is a diagram illustrating a connection relationship between the internal configuration of the system 100 and the user terminals 200. As shown in FIG.
3 is a diagram showing the configuration and operation of the signal control server (MMSP-CS, 10).
FIG. 4 is a diagram for explaining the configuration and operation of the relay server 20. FIG.
Fig. 5 is a diagram for explaining the operation of the conversion unit 23. Fig.
FIG. 6 is a flowchart illustrating a method of providing a multimedia sharing service performed by the system 100 according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a connection relationship between a system 100 for providing a multi-party multimedia sharing service and a user terminal 200 according to the present invention.

Referring to FIG. 1, a system 100 for providing a multi-party multimedia sharing service according to the present invention is connected to a plurality of user terminals 200 through a network such as a mobile communication network and the Internet, A 1: N scheme, as well as a 1: 1 sharing service for various multimedia such as a screen, a camera, an image, and a sound of the user terminal 200.

The user terminal 200 is a smart terminal such as a smart phone, a tablet PC, a PC, and a smart TV. The system 100 is operable to share various multimedia in real time by being coupled with the user terminals 200 through a network.

In the present invention, multimedia refers to content data composed of an image, a moving image, a sound, or a combination thereof.

2 is a diagram illustrating a connection relationship between the internal configuration of the system 100 and the user terminals 200. As shown in FIG.

Referring to FIG. 2, a system (MMSP, Multimedia Sharing Platform) 100 is connected to user terminals 200 through a network such as a mobile communication network (3G / LTE) The user terminals 200 interworking with different networks can transmit and receive signals and multimedia in real time. The system 100 receives the multimedia data transmitted from the user terminal 200, which is a single sharer, and transmits the multimedia message to a plurality of participant smart terminals. The system 100 also transmits a signal message sent from a plurality of participant smart terminals to the sharer, So that the terminal can be remotely controlled.

To this end, the system 100 includes a signal control server 10, a relay server 20, a management server 30, a database server 40, and a push server 50.

2, the operation server 30 is a server for managing overall operation of the system 100, and the database server 40 is a server for storing various data required for the system 100 and services. In addition, the push server 50 is a means for processing the push service to the user terminal 200. [ The operation server 30, the database server 40, and the push server 50 are generally known in the art, and a detailed description thereof will be omitted.

Next, the signal control server 10 and the relay server 20 will be described.

A signal control server (MMSP-CS) 10 is a server for performing signal processing for managing and controlling connection of a user terminal 200 to perform a multimedia sharing service between user terminals 200 Respectively.

The signal control server 10 authenticates the user terminal 200 at the start of the multimedia sharing service, and transmits / receives control signals for managing connections such as a service start / end notification signal, an invitation notification / response signal, and the like.

In addition, a session for a multimedia sharing service is formed and managed, and a message received from the user terminal 200 is received and analyzed to perform a corresponding operation, and a corresponding message is transmitted to another user terminal 200 Or transmits a control signal to perform an operation corresponding to the message.

3 is a diagram showing the configuration and operation of the signal control server (MMSP-CS, 10).

Referring to FIG. 3, the signal control server 10 includes a control manager 11, a group manager 12, a queue 13, a message detector 14, and a message analyzer 15.

The control manager 11 includes a group manager 12, a queue 13, a message detector 14, a message manager 15, And manages and controls the operation of the analyzing unit 15 as a whole.

The group manager 12 transmits and receives a control signal for a message, that is, a multimedia sharing service, through a session formed through the network with the user terminal 200.

A queue 13 is a unit for receiving a message received from the user terminal 200 by the group manager 12 from the user terminal 200 and storing the received message.

The message detection unit 14 performs a function of detecting whether or not a message is received in the queue 13.

The message analyzing unit 15 analyzes the message stored in the queue 13, generates a corresponding message, and transmits the message to the group manager 12.

These operate as follows.

That is, when a message is received from any one of the user terminals 200 through the session, the group manager 12 stores the message in the queue 13, and the message detector 14 determines that the message is stored in the queue 13 The message analyzing unit 15 analyzes the message stored in the queue 13 and transmits a message (control signal) corresponding to the message to the group manager 11, Transmits the received message to the user terminals 200 again.

Through the above process, the user terminal 200 and the signal control server 10 can transmit / receive various control signals for performing the multimedia sharing service in a message form. As described above, the control signal includes a signal for authentication processing, a service start / stop notification signal, an invitation notification / response signal, a signal for controlling the operation of the user terminal 200, and the like.

The relay server 20 of FIG. 2 will now be described.

A relay server (MMSP-RS) 20 is responsible for transmitting and receiving multimedia data between the user terminals 200 through a network.

As described above, when a session for multimedia sharing among the user terminals 200 is formed through the network and the signal control server 10, the user terminal 200 can receive multimedia data such as video and audio through the relay server 20, Data is transmitted and received.

At this time, when the type of the multimedia between the user terminals 200 is different, the user terminal 200 can perform transcoding processing for transmission and reception.

FIG. 4 is a diagram for explaining the configuration and operation of the relay server 20. FIG.

4, the relay server 20 includes a relay manager 21, a queue 22, a conversion unit 23, an audio transmission manager 24, and a video transmission manager 25.

The relay manager 21 is a means for controlling the overall operation related to the multimedia sharing service performed by the relay server 20 and includes a queue 22, a conversion unit 23, an audio transmission manager 24, And manages and controls the operation of the manager 25 as a whole. It also performs control for connection management such as port management through the network with the user terminal 200.

The queue 22 is a means for receiving multimedia data from the user terminal 200, storing the multimedia data, and outputting the multimedia data. The queue 22 may comprise a queue for each of the audio data and the video data, stores the multimedia data received from the user terminal 200 through the audio port and the video port, and outputs the multimedia data to the converting unit 23 in a FIFO manner . Here, it is preferable that the audio port and the video port transmit / receive data to / from the user terminal 200 by, for example, a real-time transport protocol (RTP).

The conversion unit 23 takes out the multimedia data stored in the queue 22 and transcodes the multimedia data to correspond to the multimedia format of the other user terminal 200 and transmits the transcoded data to the audio transmission manager 24 or the video transmission manager 25 Function. If no special conversion is required, the multimedia data is transmitted to the audio and video transmission managers 24 and 25 as they are.

At this time, the converting unit 23 generates a header by calculating a time stamp, combines the generated header with the converted multimedia data, and transmits the combined header to the audio and non-video transmitting managers 24 and 25 .

The audio transmission manager 24 and the video transmission manager 25 transmit the audio and video data received from the conversion unit 23 to the user terminal 200 via audio and video ports, respectively.

Fig. 5 is a diagram for explaining the operation of the conversion unit 23. Fig.

5, the converting unit 23 refers to the multimedia format information of another user terminal 200 before transmitting the multimedia data received through the queue 22 to another user terminal 200 relay, or transcoding and transmits the data.

This determination is made by referring to the multimedia format information of the other user terminal 200, for example, when the transmitting user terminal 200 uses the H.264 format and one of the receiving user terminals 200 uses the H.263 format And the other uses the VP8 format, the conversion unit 23 converts the H.264 format into the H.263 format and the VP8 format, respectively.

To this end, the conversion unit 23 includes conversion modules 231, 232, 233, 234, 235 and 236 for performing conversion according to each format.

Each of the conversion modules 231, 232, 233, 234, 235, 236 converts the inputted multimedia data according to the format of the corresponding module, and outputs the converted multimedia data to the audio and video transmission managers 24, 25.

On the other hand, if the conversion is not required, the received multimedia data is directly output to the audio and video transmission managers 24 and 25.

As the relay server 20 is configured as described above, every time a media type is added, only a corresponding module needs to be added to a module involved in transcoding. Therefore, even when the media is expanded, There is no advantage.

FIG. 6 is a flowchart illustrating a method of providing a multimedia sharing service performed by the system 100 according to an embodiment of the present invention.

In FIG. 6, the user terminal 1 (201) refers to a terminal that starts and requests a multimedia sharing service, and the user terminal 2 (202) and the user terminal 3 (203) refer to a terminal receiving a multimedia sharing service.

6, first, the user terminal 1 (201) accesses the signal control server 10 of the system 100 via the network and logs in (S100). Then, the user terminal 1 201 transmits a multimedia sharing service preparation notification signal (S110).

The signal control server 10 of the system 100 transmits a multimedia sharing invitation announcement signal to the user terminal 2 and the user terminal 3 (202, 203) (S120).

Then, the user terminal 1 (201) transmits a multimedia sharing service participation request signal to the system 100 (S140). At this time, the multimedia format information (H.264) of the user terminal 1 (201) is transmitted to the system 100.

Meanwhile, the second user terminal 202 also accesses the signal control server 10 of the system 100 through the network, logs in (S150), and transmits a multimedia sharing service participation request signal (S160). At this time, the multimedia format information (H.263) of the user terminal 2 (202) is transmitted to the system 100.

The signal control server 10 of the system 100 notifies the user terminal 1 201 that the user terminal 2 202 has participated in the multimedia sharing service at step S 170, A signal indicating that the shared service is started is transmitted to the system 100 (S180). Then, the signal control server 10 of the system 100 transmits a signal notifying that the shared service is started to the user terminal 2 (202) (S190).

Next, the user terminal 1 (201) transmits multimedia data, that is, video and audio signals, to the relay server 20 of the system 100 (S200). At this time, the multimedia data is transmitted in H.264 according to the format of the user terminal 1 (201).

The relay server 20 of the system 100 checks the multimedia format information of another user terminal, that is, the user terminal 2 202 in the same manner as described above, and when the multimedia format information of the user terminal 1 201 is different from the multimedia format information of the user terminal 1 A transcoding operation is performed through the converting unit 23 according to the multimedia format of the mobile terminal 202 (S210).

The relay server 20 of the system 100 transmits the converted multimedia, i.e., video and audio signals, to the second user terminal 202 (S220).

Meanwhile, when another user terminal 3 (203) having the multimedia format of VP8 logs into the system 100, the video and audio signals are transmitted to the user terminal 3 (203) through the same process as described above (S230 To S270).

Meanwhile, the multimedia sharing service that can be provided in the multimedia sharing service according to the present invention is as follows.

1) Screen sharing

The screen sharing means a service sharing a screen displayed on the display unit of the user terminal 200 with another user terminal 200. For example, the user terminal 1 (201) captures a screen and transmits it to the system 100, and the system 100 transmits a screen (image) captured by the user terminal 2 (202) 1 201 in real time while controlling the user terminal 1 201 remotely. Screen sharing is possible with 1: 1 participant and 1: N participant.

2) Share camera

Camera sharing refers to a service sharing an image acquired by a camera provided in a user terminal with other user terminals. It is also possible to use 1: 1 method with 1 participant and 1: N method with multiple participants.

3) Music Sharing

Music sharing is a service that shares music stored in a user terminal with other user terminals. This can also be a 1: 1 or 1: N scheme. In addition, music can be shared between a sharer and a plurality of participants via an external music portal server, and music can be shared between sharers / participants by sharing URL information about music.

4) Video Sharing

Video sharing refers to a service that shares a moving picture stored in a user terminal with other user terminals. This can also be a 1: 1 or 1: N scheme. In addition, video can be shared between a sharer and a large number of participants through an external video portal server, and a video can be shared between a sharer / participant by sharing URL information about the video.

5) Additional Media Expansion

For the added multimedia other than the screen sharing, the camera sharing, the music sharing, and the video sharing according to the present invention, only the media type in the interworking standard between the terminal 200 and the system 100 is added, By using the same logic, media expansion is easy.

According to the present invention, it is possible to provide a multimedia sharing service to a plurality of users out of the conventional 1: 1 sharing service. It is also flexible in expanding shared services for various media such as video and voice on a single platform.

The present invention can be applied to the following fields.

1) Customer center remote control service through screen sharing

Such as an A / S center, to access a terminal such as a smart terminal of a sharer, for example, a smart phone or a smart TV, thereby reducing work time.

2) Personal broadcasting through camera sharing

In the case of personal broadcasting, which is provided to a plurality of participants through a smart terminal, a video through a camera is transmitted to a terminal such as a smart phone, a smart TV, a tablet PC, a TV, To transmit / share media video / audio.

3) Game sharing through screen sharing

Captures a screen of a game performed by the sharer's smart terminal, transmits the screen contents to a plurality of participants to share the game contents with the smart terminals of the participants in real time, and transmits the button signals pressed by the participants as well as the sharer through the system 100 It is possible to share a multi-party game by controlling the sharer's terminal.

4) SNS service through music / video sharing

During the SNS between the users, the music / video on the smartphone of the sharer is sent to a large number of participants to share the media in real time with the participant's smart terminal, and when playing SNS through media sharing among the participants, can do.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, If you can see clearly.

100 .. Multimedia Multimedia Sharing Service Providing System
200 ... user terminal
10 ... signal control server
20 ... relay server

Claims (5)

A system for providing a multi-party multimedia sharing service between a plurality of user terminals through a network,
A signal control server for performing signal processing for managing and controlling connection of a user terminal to perform a multimedia sharing service between user terminals; And
A relay server for transmitting and receiving multimedia data for multimedia sharing between user terminals
Lt; / RTI >
The signal control server,
A control manager for controlling overall operation of the signal control server;
A group manager for establishing a session with a user terminal through a network and transmitting / receiving a control signal for a user terminal and a multimedia sharing service in the form of a message;
A queue for receiving and storing a message from the group manager;
A message detector for detecting whether a message is stored in the queue; And
A message analyzing unit for analyzing a message stored in the queue and generating a message corresponding to the message and transmitting the message to the group manager when a signal indicating that the message is stored is received by the message detector;
Lt; / RTI >
The relay server includes:
A queue for receiving and storing multimedia data from a user terminal;
A converter for transcoding multimedia data or multimedia data stored in the queue to correspond to a multimedia format of another user terminal;
An audio transmission manager for transmitting audio data among the multimedia data output from the conversion unit to a user terminal; And
A video transmission manager for transmitting video data among the multimedia data output from the conversion unit to a user terminal,
Lt; / RTI >
Wherein the conversion unit refers to a multimedia format of another user terminal participating in the multimedia service, and converts the multimedia data corresponding to the multimedia format of the corresponding user terminal when the conversion is required, and outputs the converted multimedia data.
delete delete delete A method for providing a multimedia sharing service by a multi-party multimedia sharing service providing system according to claim 1,
A first step of receiving a multimedia sharing service preparation announcement signal from a first user terminal, which is one of the user terminals, and transmitting a multimedia sharing invitation notification signal to a second user terminal corresponding to the other user terminal;
A second step of receiving a multimedia sharing service participation request signal including multimedia format information of each of the first user terminal and the second user terminal from the first user terminal and the second user terminal;
A third step of receiving multimedia data from the first user terminal according to the multimedia format information of the first user terminal;
A fourth step of converting the received multimedia data according to the multimedia format information of the second user terminal; And
And transmitting the converted multimedia data to the second user terminal
The method comprising the steps of:

Images