CN104426832A - Multi-terminal multichannel independent playing method and device - Google Patents

Abstract

The invention discloses a multi-terminal multi-channel independent playing method and device, which relate to the technical field of wireless communication, and the method comprises the following steps: establishing a connection between a master terminal and one or more slave terminals; the master terminal acquiring audio data to be played stream, and send the audio data stream to the master terminal audio playback module and the one or more slave terminal audio playback modules respectively through the master terminal playback port; the master terminal audio playback module and the one or more slave terminal audio playback modules The module realizes multi-terminal multi-channel independent playback of the same audio data stream by playing the received audio data streams respectively. The invention uses the powerful wireless interconnection capability of the terminal to play multi-channel stereo audio in an independent channel mode, which greatly facilitates people to experience stereo multimedia sound effects.

Description

A multi-terminal multi-channel independent playback method and device

technical field

The present invention relates to the technical field of wireless communication, in particular to a multi-terminal multi-channel independent playback method and device.

Background technique

At present, terminals such as Android smart phones and MID (Mobile Internet Device, mobile Internet devices) have become very popular. There are rich software on such terminals, which can play high-quality audio and video files offline and online. However, the smart terminal is limited by its own size, and it is difficult to play multi-channel music to reflect the advantages of multi-channel, mainly as follows:

1. Low-end smart terminals often only design one speaker for music playback, which means that multi-channel must be mixed into mono-channel playback during playback. Therefore, no matter how good the multi-channel separation of the audio source is, users can listen to music from any location. The music to be listened to is the same monophonic sound as a monophonic radio.

2. Although there are high-end smart terminals designed to place two speakers on both sides of the fuselage, the distance between the speakers is still too narrow. , the user can feel a certain stereo effect, but when the user's distance from the smart terminal exceeds a certain range, the multi-channel music he hears still feels that it is sent from one point, and he cannot feel the stereo and multi-channel music. sense of space.

3. Almost no smart terminal has more than two speakers for playing music, so the smart terminal cannot play multi-channel audio in an independent channel mode.

Contents of the invention

The purpose of the present invention is to provide a multi-terminal multi-channel independent playback method and device, which solves the problem in the prior art that terminals cannot play multi-channel audio in an independent channel mode.

According to one aspect of the present invention, a multi-terminal multi-channel independent playback method is provided, comprising the following steps:

Establish a connection between the master terminal and one or more slave terminals;

The master terminal obtains the audio data stream to be played, and sends the audio data stream to the master terminal audio playback module and the one or more slave terminal audio playback modules respectively through the master terminal playback port;

The audio playing module of the master terminal and the one or more audio playing modules of the slave terminals respectively play the received audio data streams, so as to realize the multi-terminal multi-channel independent playing of the same audio data stream.

Preferably, the specific steps of establishing a connection between the master terminal and one or more slave terminals include:

The one or more slave terminal connection manager clients send a connection request to the master terminal connection manager server through the WIFI network;

The master terminal connection manager server establishes a connection between the master terminal and one or more slave terminals according to the received connection request.

Preferably, the step of the master terminal acquiring the audio data stream to be played includes:

The main terminal obtains the audio data stream to be played through the audio player;

The master terminal divides the obtained audio data stream into multiple audio data stream units of equal size, and adds ID information before the multiple audio data stream units of equal size;

The main terminal saves the audio data stream unit with the ID information in the virtual sound card driver, and sends it to the audio broadcast service.

Preferably, the step of sending the audio data stream to the master terminal audio playback module and the one or more slave terminal audio playback modules respectively through the master terminal playback port includes:

The main terminal audio playback module directly sends the audio data stream through the main terminal playback port;

The one or more slave terminal audio playback modules obtain the master terminal playback port through the WIFI network to send the audio data stream.

Preferably, the master terminal audio playback module and the one or more slave terminal audio playback modules respectively play the received audio data streams, and the step of realizing the multi-terminal multi-channel independent playback of the same audio data stream includes:

The main terminal audio playback module obtains the currently played audio data stream unit with ID information from the main terminal playback port;

The one or more slave terminal audio playback modules receive and play the audio data stream unit with ID information currently played by the master terminal through the master terminal playback port, so as to realize multi-terminal multi-channel independent playback of the same audio data stream .

According to another aspect of the present invention, a multi-terminal multi-channel independent playback device is provided, including:

Establish a connection module, used to establish a connection between the master terminal and one or more slave terminals;

The audio data stream sending module is used for the master terminal to obtain the audio data stream to be played, and send the audio data stream to the master terminal audio player module and the one or more slave terminal audio player modules respectively through the master terminal playback port;

The playback module is used for the master terminal audio playback module and the one or more slave terminal audio playback modules to respectively play the received audio data streams to realize the multi-terminal multi-channel independent playback of the same audio data stream.

Preferably, the connection establishment module includes:

A sending unit, configured to send a connection request to the main terminal connection manager server through the one or more slave terminal connection manager clients through the WIFI network;

The connection establishment unit is used for the master terminal connection manager server to establish a connection between the master terminal and one or more slave terminals according to the received connection request.

Preferably, the sending audio data stream module includes:

An acquisition unit, configured for the master terminal to acquire the audio data stream to be played through the audio player;

The processing unit is used for the master terminal to divide the obtained audio data stream into multiple audio data stream units of equal size, and add ID information before the multiple audio data stream units of equal size;

The saving unit is used for the main terminal to save the audio data stream unit with the ID information in the virtual sound card driver, and send it to the audio broadcasting service.

Preferably, the sending audio data stream module also includes:

The sending unit is used for the master terminal audio playback module to directly send the audio data stream through the master terminal playback port, and the one or more slave terminal audio playback modules obtain the master terminal playback port through the WIFI network to send the Audio data stream.

Preferably, the playback module includes:

Obtain a playback data stream and a playback unit, for the master terminal audio playback module to obtain the currently played audio data stream unit with ID information from the master terminal playback port, and the one or more slave terminal audio playback modules The audio data stream unit with ID information currently played by the main terminal is received and played through the playing port of the main terminal, so as to realize the multi-terminal multi-channel independent playback of the same audio data stream.

Compared with the prior art, the beneficial effects of the present invention are:

The invention converts the terminal into a multimedia system with multi-channel stereo playback function at zero cost. Compared with the existing stereo sound realized by external multimedia speakers, the invention has the characteristics of no cost, portability and the like.

Description of drawings

Fig. 1 is a flow chart of a multi-terminal multi-channel independent playback method provided by the present invention;

Fig. 2 is a schematic diagram of a multi-terminal multi-channel independent playback device provided by the present invention;

FIG. 3 is a schematic diagram of two terminals implementing stereo playback provided by an embodiment of the present invention;

Fig. 4 is a flow chart of a multi-terminal multi-channel independent playback system provided by an embodiment of the present invention;

5 is a frame diagram of a multi-terminal multi-channel independent playback system provided by an embodiment of the present invention;

Fig. 6 is a main terminal connection management interface diagram provided by an embodiment of the present invention;

Fig. 7 is a schematic diagram of audio data stream segmentation processing provided by an embodiment of the present invention.

Detailed ways

The preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described below are only used to illustrate and explain the present invention, and are not intended to limit the present invention.

Fig. 1 has shown the flow chart of a kind of multi-terminal multi-channel independent playing method provided by the present invention, as shown in Fig. 1, comprises the following steps:

Step S101: establishing a connection between the master terminal and one or more slave terminals;

Step S102: the master terminal obtains the audio data stream to be played, and sends the audio data stream to the master terminal audio playback module and the one or more slave terminal audio playback modules respectively through the master terminal playback port;

Step S103: The audio playback module of the master terminal and the one or more audio playback modules of the slave terminals respectively play the received audio data streams, so as to realize independent playback of the same audio data stream by multiple terminals and multiple channels.

Wherein, the specific steps of establishing the connection between the master terminal and one or more slave terminals include: sending a connection request to the master terminal connection manager server through the one or more slave terminal connection manager clients through the WIFI network ; The master terminal connection manager server establishes a connection between the master terminal and one or more slave terminals according to the received connection request.

Wherein, the step of the master terminal obtaining the audio data stream to be played comprises: the master terminal obtains the audio data stream to be played through an audio player; the master terminal divides the obtained audio data stream into multiple equal-sized audio data stream unit, and add ID information before the multiple audio data stream units of equal size; the master terminal saves the audio data stream unit with ID information in the virtual sound card driver, and sends it to audio broadcasting service.

Wherein, the step of sending the audio data stream to the master terminal audio playback module and the one or more slave terminal audio playback modules respectively through the master terminal playback port includes: the master terminal audio playback module directly plays the audio data stream through the master terminal port to send the audio data stream; the one or more slave terminal audio playback modules obtain the master terminal playback port through the WIFI network to send the audio data stream.

Specifically, the master terminal audio playback module and the one or more slave terminal audio playback modules respectively play the received audio data streams, and realize the steps of multi-terminal multi-channel independent playback of the same audio data stream including: The master terminal audio playback module obtains the currently played audio data stream unit with ID information from the master terminal playback port; the one or more slave terminal audio playback modules receive and play the audio data stream unit through the master terminal playback port. The audio data stream unit with ID information currently played by the main terminal realizes independent playback of the same audio data stream by multiple terminals and multiple channels.

Fig. 2 shows a schematic diagram of a multi-terminal multi-channel independent playback device provided by the present invention, as shown in Fig. 2, including: establishing a connection module 201, which is used to establish a connection between the master terminal and one or more slave terminals; The audio data stream module 202 is used for the master terminal to obtain the audio data stream to be played, and send the audio data stream to the master terminal audio playback module and the one or more slave terminal audio playback modules respectively through the master terminal playback port; The playback module 203 is used for the master terminal audio playback module and the one or more slave terminal audio playback modules to respectively play the received audio data streams to realize independent multi-terminal multi-channel playback of the same audio data stream.

The connection establishment module 201 includes: a sending unit for sending a connection request from the one or more slave terminal connection manager clients to the main terminal connection manager server through the WIFI network; a connection establishment unit for the The master terminal connection manager server establishes a connection between the master terminal and one or more slave terminals according to the received connection request.

The sending audio data stream module 202 includes: an acquisition unit, used for the main terminal to obtain the audio data stream to be played through an audio player; a processing unit, used for the main terminal to divide the obtained audio data stream into multiple Audio data stream units of equal size, and add ID information before the plurality of audio data stream units of equal size; a storage unit, used for the main terminal to store the audio data stream units with ID information in The virtual sound card is driven and sent to the audio broadcast service; the sending unit is used for the master terminal audio playback module to directly send the audio data stream through the master terminal playback port, and the one or more slave terminal audio playback modules Obtain the playback port of the main terminal through the WIFI network to send the audio data stream.

The playback module 203 includes: obtaining a playback data stream and a playback unit, used for the main terminal audio playback module to obtain the currently played audio data stream unit with ID information from the main terminal playback port, and the one or Multiple slave terminal audio playback modules receive and play the audio data stream unit with ID information currently played by the master terminal through the master terminal playback port, so as to realize multi-terminal multi-channel independent playback of the same audio data stream.

Figure 3 shows a schematic diagram of stereo playback of two terminals provided by the embodiment of the present invention. As shown in Figure 3, the left side is the master terminal Master, and the right side is the slave terminal Client. The two terminals are connected through the WIFI network, and the master terminal broadcasts audio through the network. The PCM data is sent to the slave terminal, the slave terminal decodes the sound of the right channel, and the master terminal decodes the sound of the left channel.

A multi-terminal multi-channel independent playback method provided by an embodiment of the present invention is described below with reference to FIG. 4 and FIG. 5 using two Android terminals.

Step 1, the master terminal and the slave terminal establish a WIFI connection;

The master terminal establishes a connection with the slave terminal, and the interconnection transmission medium can be WIFIDirect (a WIFI technology in which two terminals are directly connected), Hostpot/Station (hot spot/terminal), BT (bluetooth) and so on. In the embodiment of the present invention, the master terminal turns on the WIFI hotspot, and then the slave terminal connects to the master terminal's WIFI hotspot to establish a local area network, and the ip addresses of the master terminal and the slave terminal are IPA and IPB respectively.

Step 2, start the connection manager server of the master terminal and the connection manager client of the slave terminal respectively;

The main terminal connection management server is responsible for opening the WIFI hotspot service and opening a specific UDP (UserDatagram Protocol, User Datagram Protocol) port for querying from the terminal; the connection manager client of the slave terminal is responsible for searching for the WIFI hotspot of the main terminal and connect.

Step 3, connect the UDP port provided by the main terminal connection manager server from the terminal connection manager client, and establish a C/S (client/service) mode connection;

When the slave terminal is connected to the WIFI hotspot of the master terminal, check whether the specific UDP port of the master terminal is open. If it is opened, the slave terminal will actively establish a handshake connection with the master terminal through the UDP port, and initiate a playback request from the master terminal to the master terminal. After receiving the connection request, judge whether the connected slave terminal is allowed to connect, and register the slave terminal as the playback client after allowing it.

Step 4, successfully establish a connection between the client terminal connection manager client and the master terminal connection manager server end, set the connection success flag, and set the sound channels played by the master terminal and the slave terminal;

Step 5, the audio player of the main terminal plays, and the PCM audio data stream played is decoded and sent to AudioFlinger through the Android media service for judgment, and then sent to the virtual sound card driver for saving after judgment;

Among them, AudioFlinger is used to judge the current playback mode and the connection status between the master terminal and the slave terminal. If the master terminal and the slave terminal have been connected and are in separate channel playback mode, then the PCM audio data stream will be sent to the virtual sound card driver, and the virtual sound card driver will put the audio data into its own FIFO (First-InFirst-Out) buffer pool, and provide a read interface for the FIFO buffer pool. Wherein, the virtual sound card driver is only used on the master terminal, intercepts the audio PCM (Pulse Code Modulation) stream played by the master terminal, and distributes it to the slave terminals for cooperative playback through the Internet according to the settings.

Step 6, the audio broadcast service reads the PCM audio data stream from the read interface of the FIFO buffer pool, and divides the received PCM audio data stream into PCM audio data stream units of equal size of 88200 bytes, and sends each unit Carry out equal numbering;

Step 7, the audio broadcast service binds a TCP (TransferControl Protocol) port portA on the ip address IPA of the main terminal, and broadcasts the PCM audio data stream on IPA:portA;

The audio broadcasting service of the main terminal provides broadcasting of PCM audio data streams. This audio broadcasting service can provide services for a user-mode process, which is bound to a TCP port of the main terminal after startup. When the slave terminal connects to this TCP port to read data , the audio broadcast service forwards the data read from the FIFO buffer pool driven by the virtual sound card to the slave terminal.

Step 8, the audio broadcast service obtains the PCM audio data stream from the bound TCP port;

The main terminal audio playback module directly obtains the audio data stream from portA bound to the TCP port on the IPA, and obtains the audio data stream from portB bound to the TCP port on the IPA through a network connection such as WIFI from the terminal audio playback module.

Step 9, decoding the acquired PCM audio data stream, and separately extracting the required channel data to form a new PCM audio data stream;

The master terminal audio playback module obtains the audio channel information from the connection management server, and obtains the corresponding channel from the new PCM audio data stream according to the audio channel information, and plays the audio data of the corresponding channel; The management client acquires the audio channel information, and acquires the corresponding channel from the new PCM audio data stream according to the audio channel information, and plays the audio data of the corresponding channel.

Among them, the PCM audio data stream can also be stored separately in advance in the main terminal, and sent to different terminals through different TCP ports for playback. In this case, the terminal does not need to separate the stereo data.

Step 10, sending the new PCM audio data stream to a real sound card driver for playing.

The audio playback module of the master terminal and the slave terminal establish a communication channel through a UDP connection. The audio playback module of the master terminal obtains the PCM data with ID information added from the port of the audio broadcast service. The ID number is notified to the audio playback module of the slave terminal through the UDP port. The audio playback module of the slave terminal can know when the master terminal is playing the PCM data with the ID number according to the ID number sent by the audio playback module of the master terminal. Adjust the playing time of the PCM stream with the next ID number according to the network delay, and keep synchronized with the master terminal at all times, so that the audio played by the master and slave terminals is consistent.

During the playback process, a control connection should be established between the master terminal and the slave terminal to control events such as start, pause, end, and synchronization during the playback process.

The present invention needs to do the following work in order to realize the synchronous playback of the left and right channels: when the audio broadcasting service sends data, the PCM audio data is divided into several equal parts in the process of broadcasting PCM data, and the PCM code stream is adopted at a rate of 44.1KHz, 16bit Taking sampling as an example, 88200 bytes of PCM data will be generated every second. We can divide the data into equal parts by 88200 bytes, and then add ID (abbreviation for identification) information before each equal part, as shown in Figure 7.

Fig. 6 has shown the main terminal connection management interface diagram that the embodiment of the present invention provides, as shown in Fig. 6,: provide UI (User Interface user interface) system, can allow the user to set mobile phone to work in master-slave mode, sound channel is set, establishes and disconnection operations.

In summary, the present invention has the following technical effects:

The invention utilizes the powerful wireless interconnection capability of the terminal to establish a real multi-channel independent playing multimedia audio system at zero cost under the current popularization of the terminal. This multi-channel audio system can be set up at any time and disconnected at any time, either indoors or outdoors, which greatly facilitates people to experience stereo multimedia sound effects.

Although the present invention has been described in detail above, the present invention is not limited thereto, and various modifications can be made by those skilled in the art based on the principle of the present invention. Therefore, any modifications made according to the principles of the present invention should be understood as falling within the protection scope of the present invention.

Claims (10)

1. A multi-terminal multi-channel independent playing method is characterized in that, comprising the following steps: Establish a connection between the master terminal and one or more slave terminals; The master terminal obtains the audio data stream to be played, and sends the audio data stream to the master terminal audio playback module and the one or more slave terminal audio playback modules respectively through the master terminal playback port; The audio playing module of the master terminal and the one or more audio playing modules of the slave terminals respectively play the received audio data streams, so as to realize the multi-terminal multi-channel independent playing of the same audio data stream. 2. The method according to claim 1, wherein the specific steps of establishing a connection between the master terminal and one or more slave terminals comprise: The one or more slave terminal connection manager clients send a connection request to the master terminal connection manager server through the WIFI network; The master terminal connection manager server establishes a connection between the master terminal and one or more slave terminals according to the received connection request. 3. The method according to claim 1, wherein the step of obtaining the audio data stream to be played by the master terminal comprises: The main terminal obtains the audio data stream to be played through the audio player; The master terminal divides the obtained audio data stream into multiple audio data stream units of equal size, and adds ID information before the multiple audio data stream units of equal size; The main terminal saves the audio data stream unit with the ID information in the virtual sound card driver, and sends it to the audio broadcast service. 4. The method according to claim 3, wherein the step of sending the audio data stream to the master terminal audio playback module and the one or more slave terminal audio playback modules respectively through the master terminal playback port comprises : The main terminal audio playback module directly sends the audio data stream through the main terminal playback port; The one or more slave terminal audio playback modules obtain the master terminal playback port through the WIFI network to send the audio data stream. 5. The method according to claim 4, wherein the master terminal audio playback module and the one or more slave terminal audio playback modules realize the same audio data stream by playing the received audio data streams respectively. The steps for multi-terminal multi-channel independent playback include: The main terminal audio playback module obtains the currently played audio data stream unit with ID information from the main terminal playback port; The one or more slave terminal audio playback modules receive and play the audio data stream unit with ID information currently played by the master terminal through the master terminal playback port, so as to realize multi-terminal multi-channel independent playback of the same audio data stream . 6. A multi-terminal multi-channel independent playback device, characterized in that it comprises: Establish a connection module, used to establish a connection between the master terminal and one or more slave terminals; The audio data stream sending module is used for the master terminal to obtain the audio data stream to be played, and send the audio data stream to the master terminal audio player module and the one or more slave terminal audio player modules respectively through the master terminal playback port; The playback module is used for the master terminal audio playback module and the one or more slave terminal audio playback modules to respectively play the received audio data streams to realize the multi-terminal multi-channel independent playback of the same audio data stream. 7. The device according to claim 6, wherein the connection establishment module comprises: A sending unit, configured to send a connection request to the master terminal connection manager server through the one or more slave terminal connection manager clients through the WIFI network; The connection establishment unit is used for the master terminal connection manager server to establish a connection between the master terminal and one or more slave terminals according to the received connection request. 8. The device according to claim 6, wherein the sending audio data stream module comprises: An acquisition unit, configured for the master terminal to acquire the audio data stream to be played through the audio player; The processing unit is used for the master terminal to divide the obtained audio data stream into multiple audio data stream units of equal size, and add ID information before the multiple audio data stream units of equal size; The saving unit is used for the main terminal to save the audio data stream unit with the ID information in the virtual sound card driver, and send it to the audio broadcasting service. 9. The device according to claim 8, wherein the sending audio data stream module further comprises: The sending unit is used for the master terminal audio playback module to send the audio data stream directly through the master terminal playback port, and the one or more slave terminal audio playback modules obtain the master terminal playback port through the WIFI network to send the Audio data stream. 10. The device according to claim 8, wherein the playing module comprises: Obtain the playback data stream and the playback unit, for the master terminal audio playback module to obtain the currently played audio data stream unit with ID information from the master terminal playback port, and the one or more slave terminal audio playback modules The audio data stream unit with ID information currently played by the main terminal is received and played through the main terminal playback port, so as to realize independent multi-terminal multi-channel playback of the same audio data stream.