KR101472013B1 - Server and method for providing music streaming include data of add image - Google Patents

Abstract

The head end server includes a video streaming receiving unit for receiving video streaming including video and sound data from a video streaming server, a sound source streaming receiving unit for receiving sound source stream including only sound data from the sound source streaming server, metadata of sound source streaming A web server interworking unit for receiving image data corresponding to sound source streaming from a web server and a transmitting unit for transmitting a plurality of streams corresponding to a plurality of channels to a device, Transmits streaming to the device, and transmits sound source streaming and image data corresponding to the second channel to the device.

Description

TECHNICAL FIELD [0001] The present invention relates to a server and a method for providing sound source stream including additional data,

A server and method for providing sound source streaming including image data, and a device.

Multimedia broadcasting generally refers to a broadcasting service that provides users with high-quality, high-quality, and high-quality services. Recently, with the development of smart devices, it has become possible to use high-quality broadcasting services on the move. Accordingly, in providing music through an audio channel that professionally provides only music contents, it is possible to provide an image or a moving image previously stored in a smart device or designated by a user. However, in the case of a moving image designated by such a user, since the size of the data is larger than that of the data of the audio channel, providing the music and simultaneously providing the moving image designated by the user may result in inefficient use of the data. In relation to a method of providing additional information in a broadcasting provided to a user, Korean Unexamined Patent Publication No. 2002-0061368 discloses a configuration in which additional information related to broadcasting contents provided to a device is provided to another external device.

Meanwhile, the audio channel provided by IPTV is a kind of radio broadcasting service in which dozens of channels are classified into respective categories and provide music for 365 days and 24 hours. The audio channel (MPEC channel) can provide a high quality music service with a small capacity compared to a high-quality video. However, since the attribute of the IPTV is provided, an empty channel is displayed without any additional image content information to be displayed on the TV screen Or, only a simple equalizer animation is displayed. Accordingly, there is an increasing demand for displaying separate image content information on a blank screen of an audio channel.

It is desirable to display information related to the sound source being reproduced in an empty space of the TV screen while providing the sound source to the user through the audio channel. The meta data collected from the web server is transmitted to the broadcast server, and when the sound source is reproduced, the sound source and the metadata are provided together to the user device. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may be present.

According to an aspect of the present invention, there is provided a video streaming apparatus comprising: a moving picture streaming receiving unit for receiving moving picture streaming including video and sound data from a moving picture streaming server; A web server interworking unit for transmitting metadata of the sound streaming to the web server and receiving the image data corresponding to the sound source streaming from the web server, and transmitting a plurality of streams corresponding to the plurality of channels to the device Wherein the transmitting unit transmits the moving picture stream corresponding to the first channel to the device, and the sound streaming corresponding to the second channel and the image data to the device. .

According to another embodiment of the present invention, there is provided a method of streaming music streaming comprising the steps of: receiving video streaming including video and audio data from a video streaming server; receiving sound streaming including only sound data from the sound streaming server; Transmitting metadata from the web server to the web server, receiving image data corresponding to sound source streaming from the web server, and transmitting a plurality of streams corresponding to the plurality of channels to the device, Transmitting the video streaming corresponding to the first channel to the device, and transmitting the sound streaming and image data corresponding to the second channel to the device.

In another embodiment of the present invention, a video streaming receiving unit receives video streaming including video and sound data from a server. A sound source streaming receiving section for receiving sound source stream including only sound data from the server, a data receiving section for receiving image data corresponding to sound source streaming from the server, a channel selection signal corresponding to any one of a plurality of channels from the user interface And a reproducing unit for reproducing the moving picture streaming through the display of the device when the channel selecting signal corresponding to the first channel is received, wherein the reproducing unit includes a channel selecting signal receiving unit for receiving the channel selecting signal corresponding to the second channel , Reproduce the sound source stream through the speaker of the device, and display the image data on the display.

According to another embodiment of the present invention, there is provided a method for streaming video data, comprising the steps of: receiving moving picture streaming including video and sound data from a server; receiving sound streaming including only sound data from a server; Receiving a channel selection signal corresponding to one of the plurality of channels from the user interface, receiving the channel selection signal corresponding to the first channel, reproducing the video streaming through the display of the device, Reproducing the sound source stream through a speaker of the device when the channel selection signal corresponding to the second channel is received; and displaying the image data on the display while the sound source stream is being reproduced Can be provided.

According to one of the above-mentioned problem solving means, it is possible to provide a high-quality sound source with a relatively small capacity by utilizing a free area of an IPTV audio channel and a TV screen, and to provide meta information related to a sound source to a free area of the TV screen. As a service provider, the burden of network capacity due to the proliferation of the service is small, and information related to good music or interesting music can be obtained from viewers. By gathering information through the web, you can receive the latest information. By synchronizing the music and the meta information through the timeline information provided through the EPG for the audio channel and receiving the music together with the music, the memory overload of the user device can be prevented. Additional additional revenue may be expected by providing an advertising image in a blank area of the TV screen.

1 is a block diagram of an overall system according to an embodiment of the present invention.
2 is a configuration diagram of a head-end server according to an embodiment of the present invention.
3 is a diagram illustrating a service flow of an audio broadcasting according to an embodiment of the present invention.
4 is a view illustrating a service screen according to an embodiment of the present invention.
5 is a configuration diagram of a device according to an embodiment of the present invention.
6 is a flowchart illustrating a method of transmitting streaming according to an embodiment of the present invention.
7 is an operation flowchart showing a method of reproducing streaming according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

1 is a block diagram of an overall system according to an embodiment of the present invention. 1, a system for providing a user with image data related to a sound source provided through an audio channel includes a head end server 10, a device 20, a sound source streaming server 30, a web server 40 And a video streaming server 50. However, the system of FIG. 1 is only one embodiment of the present invention, and therefore, the present invention is not limited to FIG.

Each component of the system shown in FIG. 1 may generally be connected via a network. The network refers to a connection structure in which information can be exchanged between each node such as terminals and servers. One example of such a network is a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) , A WAN (Wide Area Network), a PAN (Personal Area Network), a Bluetooth (Bluetooth), a wireless LAN (Local Area Network) Networks, satellite broadcast networks, analog broadcast networks, Digital Multimedia Broadcasting (DMB) networks, and the like.

The video streaming server 50 may provide video streaming including video and audio data. For example, the video streaming server 50 may provide video streaming such as a real time broadcast channel or VOD content to the head end server 10, and video streaming may be provided to the device 20 through the head end server 10 have.

The sound source streaming server 30 may provide sound source stream including only sound data. As an example, the music source streaming server 30 may provide the music streaming corresponding to the audio channel to the head end server 10, and the music streaming may be provided to the device 20 via the head end server 10.

The web server 40 may acquire music broadcast schedule information from the music source streaming server 30 and may collect metadata related to music through web search. The collected metadata may include an album jacket image of the music, lyrics, image of the corresponding artist, and the like, but may include a plurality of images related to music.

The head end server 10 may receive moving picture streaming including video and sound data from the moving picture streaming server 50 and may receive the sound source stream including only sound data from the sound source streaming server 30. The video streaming may include a moving picture such as a real time broadcasting channel and a VOD, and the sound streaming may include music or sound sources corresponding to the audio broadcasting channel.

The head end server 10 can transmit metadata of the sound streaming to the web server 40, receive the image data corresponding to the sound streaming from the web server 40, and transmit the sound streaming and image data to the device .

The operation of the head end server 10 will be described again in Fig.

The device 20 is a device for displaying broadcast images and advertisement images, and may include a device capable of displaying broadcast images such as a TV, a smart TV, an IPTV, a monitor connected to a PC, and a set-top box connected to a TV. In this case, a device such as a set-top box may be included inside the TV device, and may be connected to the TV device as an external device. However, the type of the device 20 shown in FIG. 1 is merely an example for convenience of explanation, and therefore the type and the type of the device 20 discussed herein are not limited to those shown in FIG. For example, the device 20 may include any type of handheld-based wireless communication device, such as a portable terminal, a smart phone, a smart pad, a tablet PC, etc., that can access a server at a remote location via a network.

The device 20 may receive video streaming including video and audio data from the head end server 10 and may receive audio streaming containing only audio data from the head end server 10, The image data corresponding to the sound source streaming can be received.

The device 20 receives a channel selection signal corresponding to one of the plurality of channels from the user interface, and when the channel selection signal corresponding to the first channel is received, the device 20 reproduces the video streaming through the display of the device , And when the channel selection signal corresponding to the second channel is received, the streaming of the sound source can be reproduced through the speaker of the device and the image data can be displayed on the display.

Such an operation of the device 20 will be described once again in Fig.

2 is a configuration diagram of a head end server 10 according to an embodiment of the present invention. 2, the head end server 10 for transmitting sound source streaming and image data to the device 20 includes a moving picture streaming receiving unit 101, a sound source streaming receiving unit 102, a web server interlocking unit 103, (104) and a streaming editing unit (105). However, the configuration of the head end server 10 shown in FIG. 2 is not limited to those shown in FIG.

The video streaming receiving unit 101 receives moving picture streaming video and sound data from the moving picture streaming server 50. Video streaming can be video streaming such as real-time broadcast channel or VOD. For example, the moving image streaming receiving unit 101 may receive the moving image streaming of the real time broadcasting channel from the moving image streaming server 50.

The sound source streaming receiving unit 102 receives the sound source stream including only sound data from the sound source streaming server 30. The sound source streaming may be referred to as music streaming corresponding to the audio channel and the sound source streaming receiving unit may receive the music streaming from the sound source streaming server 30. [ The sound source streaming receiving unit 102 may receive EPG information including broadcast order information of the music broadcast, or broadcast schedule information from the sound source streaming server 30.

The web server interworking unit 103 transmits the metadata of the sound streaming to the web server 40 and receives the image data corresponding to the sound streaming from the web server 40. [ The web server 40 can detect image data by performing a web crawl based on the received metadata.

For example, the web server interworking unit 103 may transmit, to the web server 40, metadata about the currently played sound source or the sound source scheduled to be played back based on the broadcast schedule information received from the sound source streaming server 30 . The metadata about the sound source may include information related to the sound source such as the playing time of the sound source, the artist information, and the album name. The web server 40 can search images corresponding to sound sources such as an album jacket image, an image of a singer, or lyrics information of a corresponding sound source through the web search. The web server interworking unit 103 can receive the retrieved image data from the web server 40. [

The transmitting unit 104 transmits a plurality of streams corresponding to the plurality of channels to the device 20. [ At this time, the transmitting unit 104 may transmit the moving picture stream corresponding to the first channel to the device 20, and may transmit the sound streaming and image data corresponding to the second channel to the device 20. [ The first channel may be a video broadcast channel or a real time broadcast channel, and the second channel may be an audio channel, which is a radio broadcast channel. The device 20 can display the image data on the display of the device when the sound streaming is reproduced and the device 20 synthesizes the received image data into the i-frame layer, Can be displayed. The eye frame layer may be called a background layer.

The transmitting unit 104 may transmit the sound source stream to the device 20 via the first transmission channel and may transmit the image data to the device 20 via the second transmission channel. In this case, the first transmission channel may be a streaming transmission channel, and the second transmission channel may be a data transmission channel.

The streaming editing unit 105 can edit the sound source stream by adding image data within the sound source stream. The streaming editing unit 105 may edit the streaming so that image data is displayed on the display of the device 20 when reproducing sound source streaming. At this time, the transmitting unit 104 may transmit the edited sound source stream corresponding to the second channel to the device 20.

For example, the streaming editing unit 105 may synchronize the received sound source stream and the image data so that the image data can be displayed on the display of the user's IPTV. If there are a plurality of image data, The images may be displayed sequentially, or the streaming may be edited to display based on an arbitrary order.

Although not shown in the figure, the head end server 10 may further include a channel switching signal receiving unit (not shown) for receiving a channel selecting signal corresponding to one of the plurality of channels from the device 20. [

When receiving the channel selection signal corresponding to one of the channels through the channel switching signal receiving unit (not shown), the transmitting unit 104 receives the channel selecting signal corresponding to the first channel, And upon receipt of the channel selection signal corresponding to the second channel, it can transmit the sound source streaming and the image data to the device 20.

3 is a diagram illustrating a service flow of an audio broadcasting according to an embodiment of the present invention. 3, the sound source streaming server 30 transmits audio broadcast information indicating the audio broadcast order to the head end server 10 (S301), and the head end server 10 transmits the audio broadcast information indicating the audio broadcast order to the web server 40 (S302).

The web server 40 collects image data through web crawling based on the music content metadata of the received broadcast information (S303), and transmits the metadata including the collected image data to the head end server 10 ( S304).

The head end server 10 extracts image data matching the meta information of the digital audio broadcast currently being broadcast from the metadata including the received image data (S305), synchronizes the audio information and the image data (S306) So that image data is displayed during reproduction.

The head end server 10 transmits the synchronized audio information to the device 20 (S307), the device 20 checks the timeline of the audio channel currently being broadcast, and transmits the synchronized audio information The sound source is reproduced on the basis of the speaker (S308) and displayed on the background layer or the eye frame layer of the display. The image data synchronized with the audio information is not stored in the device 20 but is deleted at the same time when the reproduction of the music is terminated and when the next music is reproduced through the device 20, Image data can be received from the head end server 10 and displayed on the display.

4 is a view illustrating a service screen according to an embodiment of the present invention. Referring to FIG. 4, the conventional audio broadcasting screen has no separate video data, and background processing can be performed using a basic background screen. The metadata of the sound source coming through the audio channel can be received from the web server 40 and displayed on the display in synchronization with the audio source. At this time, a plurality of images may be continuously displayed or displayed in a panoramic manner according to the number of images collected by the web server 40, so that the images can be displayed more dynamically. The corresponding image data is deleted from the device 20 and image data corresponding to the next music to be reproduced can be received from the head end server 10 and displayed on the display.

If there is no image data collected from the web server 40, another image such as an advertisement image may be used.

5 is a configuration diagram of a device 20 according to an embodiment of the present invention. The device 20 described in FIG. 5 receives the image data synchronized with the moving image streaming, the sound source streaming, and the sound source streaming from the head end server 10 described with reference to FIGS. 1 and 2, and displays the received image data on the display do. Therefore, the description of the head end server 10 of FIGS. 1 and 2 also applies to the operation of the device 20 of FIG.

5, the device 20 includes a moving picture streaming reception unit 201, a sound source streaming reception unit 202, a data reception unit 203, a channel selection signal reception unit 204, and a playback unit 205. However, the configuration of the device 20 of Fig. 5 is not limited to those exemplified above.

The moving picture streaming receiving unit 201 can receive moving picture streaming including video and sound data from a server and the sound streaming receiving unit 202 can receive sound streaming including only sound data from a server. Meanwhile, the data receiving unit 203 may receive the image data corresponding to the sound source streaming from the server. At this time, the server can be the head end server 10.

The moving picture streaming receiving unit 201 may receive the moving picture streaming directly from the moving picture streaming server 50 and the sound streaming receiving unit 202 may receive the sound streaming stream directly from the sound source streaming server 30. [

The channel selection signal receiving unit 204 may receive a channel selection signal corresponding to one of the plurality of channels from the user interface. For example, the channel selection signal receiving unit 204 may receive a channel selection signal for selecting a real time broadcast channel or a channel selection signal for selecting an audio channel from a remote controller.

When the channel selection signal corresponding to the first channel is received, the playback unit 205 can reproduce the video streaming through the display of the device 20, and when the channel selection signal corresponding to the second channel is received, The sound source streaming is reproduced through the speaker of the sound source 20 and the image data synchronized with the sound source stream can be displayed on the display.

For example, the playback unit 205 can play streaming on a real-time broadcast channel based on a signal for selecting a real-time broadcast channel, reproduce sound streaming based on a signal for selecting an audio broadcast, It is possible to display the image data synchronized with the sound source streaming.

6 is a flowchart illustrating a method of transmitting streaming according to an embodiment of the present invention. FIG. 6 includes steps that are processed in a time-series manner in the head end server 10 described in FIGS. Therefore, even if omitted in the following description, the description of the head end server 10 through Figs. 1 and 2 also applies to Fig.

Referring to FIG. 6, the head end server 10 receives moving picture streaming including video and sound data from the moving picture streaming server 50 (S601), performs streaming of sound sources including only sound data from the sound source streaming server 30 (S602).

The head end server 10 transmits the metadata of the sound source stream to the web server 40 in step S603 and receives the image data corresponding to the sound source stream from the web server 40 in step S604. Thereafter, the head end server 10 transmits a plurality of streams corresponding to the plurality of channels to the device (S605). The head end server 10 transmits the moving picture stream corresponding to the first channel to the device 20 , The sound source stream corresponding to the second channel, and the image data synchronized with the sound source stream to the device 20.

The head end server 10 may edit the sound source stream by adding image data within the sound source stream and may transmit the edited sound source stream corresponding to the second channel to the device 20. [

The head end server 10 receives the channel selection signal corresponding to any one of the plurality of channels from the device 20, and when the received channel selection signal corresponds to the first broadcast channel, 20, and if the received channel selection signal corresponds to the second broadcast channel, the image data synchronized with the sound source streaming and the sound source streaming may be transmitted to the device 20. [

7 is an operation flowchart showing a method of reproducing streaming according to an embodiment of the present invention. FIG. 7 includes steps that are processed in a time-series manner in the device 20 described in FIG. 1 or FIG. Therefore, even if omitted in the following description, the description of the device 20 through Fig. 5 also applies to Fig.

Referring to FIG. 7, the device 20 receives moving picture streaming including video and sound data from the server S701, receives sound source stream including only sound data from the server S702, And receives corresponding image data (S703).

The device 20 receives a channel selection signal corresponding to any one of a plurality of channels from the user interface (S704). When a channel selection signal corresponding to the first channel is received, the device 20 transmits the video stream to the device 20 (S705). When the channel selection signal corresponding to the second channel is received, the sound source streaming is reproduced through the speaker of the device 20 (S706). The device 20 may display the image data on the display of the device 20 (S707) while the sound streaming is reproduced through the speaker of the device 20. [

The method of transmitting the streaming and the method of reproducing the streaming described with reference to Figs. 6 to 7 can also be implemented in the form of a recording medium including instructions executable by the computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

10: Headend server
20: Device
30: Sound source streaming server
40: Web server
50: Video Streaming Server

Claims (20)

In a head-end server,
A video streaming receiving unit for receiving video streaming including video and sound data from a video streaming server;
A sound source streaming receiving unit which receives sound source stream including only sound data from a sound source streaming server;
A web server interworking unit transmitting metadata of the sound source streaming to a web server and receiving image data corresponding to the sound source streaming from the web server;
A transmitter for transmitting a plurality of streams corresponding to a plurality of channels to a device;
And a streaming editing unit for editing the sound source stream by adding the image data in the sound source stream,
Wherein the transmitting unit transmits the moving picture streaming corresponding to the first channel to the device, the edited sound source stream corresponding to the second channel to the device,
Wherein the streaming editing unit edits the sound source stream by adding the image data to the image frame area of the sound source streaming,
Wherein the web server detects the image data by performing a web crawl based on the metadata.
delete delete The method according to claim 1,
Wherein the image data is image data of a plurality of images corresponding to the playback time of the sound source streaming.
5. The method of claim 4,
Wherein the plurality of images are displayed in the device sequentially or randomly during the playback time.
delete delete The method according to claim 1,
Wherein the device displays the image data on a display of the device when playing the sound source stream.
9. The method of claim 8,
Wherein the device displays the image data by compositing the image data into an I Frame Layer.
delete The method according to claim 1,
Further comprising a channel switching signal receiving unit for receiving a channel selecting signal corresponding to one of the plurality of channels from the device,
Wherein the transmitting unit transmits the streaming video to the device when receiving the channel selection signal corresponding to the first channel and transmits the edited streaming source to the device when receiving the channel selection signal corresponding to the second channel Head end server.
In a streaming transmission method,
Receiving video streaming including video and audio data from a video streaming server;
Receiving a sound source stream including only sound data from a sound source streaming server;
Transmitting metadata of the sound source streaming to a web server;
Receiving image data corresponding to the sound source stream from the web server;
Transmitting a plurality of streams corresponding to a plurality of channels to a device; And
And adding the image data within the sound source stream to edit the sound source stream,
Wherein the transmitting of the plurality of streams comprises transmitting the video streaming corresponding to the first channel to the device, transmitting the edited audio streaming corresponding to the second channel to the device,
Wherein editing the streaming comprises: editing the streaming by adding the image data to an image frame region of the streaming source,
Wherein the web server detects the image data by performing a web crawl based on the metadata.
delete 13. The method of claim 12,
Receiving a channel selection signal corresponding to one of a plurality of channels from a device,
Wherein the transmitting of the plurality of streams includes transmitting the video streaming to the device when the channel selection signal corresponding to the first channel is received and receiving the channel selection signal corresponding to the second channel when the channel selection signal corresponding to the first channel is received, To the device.
In a device,
A video streaming receiving unit for receiving video streaming including video and sound data from a server;
A sound source streaming receiving unit for receiving sound source stream including only sound data from a server;
A data receiving unit for receiving image data corresponding to the sound source streaming from a server;
A channel selection signal receiver for receiving a channel selection signal corresponding to any one of a plurality of channels from a user interface; And
And a reproducing unit for reproducing the moving picture streaming through a display of the device when a channel selection signal corresponding to the first channel is received,
Wherein the reproducing unit reproduces the sound source stream through a speaker of the device when the channel selection signal corresponding to the second channel is received and displays the image data on the display,
Wherein the sound source streaming is edited by adding the image data to the image frame area of the sound source streaming by a streaming editing unit of the server,
Wherein the image data is detected by a web server performing a web crawl based on the metadata of the sound streaming.
16. The method of claim 15,
Wherein the server is a head-end server.
16. The method of claim 15,
Wherein the moving picture streaming receiving unit receives the moving picture streaming from the moving picture streaming server,
Wherein the sound source streaming receiving unit receives sound source streaming from a sound source streaming server.
16. The method of claim 15,
And the reproducing unit displays the image data by synthesizing the image data into an I frame layer.
delete A method of playing streaming,
Receiving video streaming including video and audio data from a server;
Receiving sound streaming including only sound data from a server;
Receiving image data corresponding to the sound source stream from a server;
Receiving a channel selection signal corresponding to one of a plurality of channels from a user interface;
Reproducing the moving picture streaming through a display of the device when a channel selection signal corresponding to the first channel is received;
Reproducing the sound source stream through a speaker of the device when a channel selection signal corresponding to the second channel is received; And
Displaying the image data on a display while the sound source stream is being reproduced,
Wherein the step of receiving the sound source stream includes receiving the edited sound source stream by adding the image data to the image frame area of the sound source stream by the streaming editor of the server,
Wherein the image data is detected by a web server performing a web crawl based on the metadata of the sound streaming.

Images