CN112492338B - Online song house implementation method, electronic equipment and computer readable storage medium - Google Patents
Online song house implementation method, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN112492338B CN112492338B CN202011357981.7A CN202011357981A CN112492338B CN 112492338 B CN112492338 B CN 112492338B CN 202011357981 A CN202011357981 A CN 202011357981A CN 112492338 B CN112492338 B CN 112492338B
- Authority
- CN
- China
- Prior art keywords
- audio
- client
- account
- target
- accompaniment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/68—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/683—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/68—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/686—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
- H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Library & Information Science (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
Abstract
The application discloses an online song house implementation method, electronic equipment and a computer-readable storage medium, wherein the method comprises the following steps: in the singing time period of the first account, the first client plays the locally stored first audio content, and sends the first target audio and the progress information thereof to the second client, and the second client plays the first target audio; in the singing time period of the second account, the second client determines the current playing progress according to the received progress information, starts playing the locally stored second audio content based on the current playing progress, and sends second target audio and the progress information thereof to the first client; and in the singing time period of the second account, if the first client receives the second target audio sent by the second client, playing the second target audio. The online singing room implementation method provided by the application realizes real-time antiphonal singing of a plurality of accounts.
Description
Technical Field
The present application relates to the field of computer technology, and more particularly, to an online song house implementation method, an electronic device, and a computer readable storage medium.
Background
In the online singing room design of the related technology, chorus of two users is realized in an asynchronous mode, namely, a user A records a singing part of the user A at a client A, then sends the synthesized work to a client B, and the user B complements the singing part of the user B at the client B to generate a final chorus work.
As can be seen, in the process of implementing the present application, the inventors found that at least the following problems exist in the related art: real-time antiphonal singing of multiple accounts cannot be achieved.
Disclosure of Invention
The application aims to provide an online song house implementation method, electronic equipment and a computer readable storage medium, which realize real-time antiphonal singing of a plurality of accounts.
To achieve the above object, a first aspect of the present application provides a method for implementing an online song room, where a first account corresponding to a first client and a second account corresponding to a second client are matched to a virtual room, the method includes:
in the singing time period of the first account, the first client plays the first audio content stored locally, and sends first target audio and progress information thereof to the second client, and the second client plays the first target audio; the first audio content is audio content corresponding to the first account in accompaniment audio, and the first target audio is synthesized audio of the first audio content locally stored by the first client and the collected first dry audio;
in the singing time period of the second account, the second client determines the current playing progress according to the received progress information, starts playing the locally stored second audio content based on the current playing progress, and sends second target audio and the progress information thereof to the first client; the second audio content is audio content corresponding to the second account in accompaniment audio, and the second target audio is synthesized audio of second audio content locally stored by the second client and collected second dry audio;
and in the singing time period of the second account, if the first client receives second target audio sent by the second client, playing the second target audio.
To achieve the above object, a second aspect of the present application provides an electronic device, including:
a memory for storing a computer program;
and the processor is used for realizing the steps executed by the first client or the second client in the online song-room realization method when executing the computer program.
To achieve the above object, a fourth aspect of the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements steps performed by a first client or a second client in the above-described online song-room implementation method.
According to the above scheme, the on-line song room implementation method provided by the application, wherein a first account corresponding to a first client and a second account corresponding to a second client are matched to a virtual room, and the method comprises the following steps: in the singing time period of the first account, the first client plays the first audio content stored locally, and sends first target audio and progress information thereof to the second client, and the second client plays the first target audio; the first audio content is audio content corresponding to the first account in accompaniment audio, and the first target audio is synthesized audio of the first audio content locally stored by the first client and the collected first dry audio; in the singing time period of the second account, the second client determines the current playing progress according to the received progress information, starts playing the locally stored second audio content based on the current playing progress, and sends second target audio and the progress information thereof to the first client; the second audio content is audio content corresponding to the second account in accompaniment audio, and the second target audio is synthesized audio of second audio content locally stored by the second client and collected second dry audio; and in the singing time period of the second account, if the first client receives second target audio sent by the second client, playing the second target audio.
In the application, under the condition that the first account and the second account are matched to the same virtual room, the first account and the second account can realize real-time sectional chorus, namely a antiphonal mode, in the virtual room, wherein the first account corresponds to the first audio content, and the second account corresponds to the second audio content. When the first account sings, the accompaniment audio played by the first client is locally stored first audio content, and the audio played by the second client is synthesized audio of the first audio content stored by the first client and the collected first dry audio, namely first target audio. At the second client side, alignment of the accompaniment audio with the dry audio is ensured. When the second account sings, the second client determines the current playing progress according to the received progress information, and starts to play the locally stored second audio content based on the current playing progress, wherein the audio played by the first client is synthesized audio of the second audio content stored by the second client and the acquired second dry audio, namely the second target audio. At the first client side, alignment of the accompaniment audio and the dry audio is ensured. Therefore, the online song room implementation method provided by the application realizes the alignment of the accompaniment audio and the dry audio played by the first client and the second client respectively when the first account and the second account perform real-time antiphonal singing. The application also discloses an electronic device and a computer readable storage medium, which can realize the technical effects.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application as claimed.
Drawings
In order to more clearly illustrate the embodiments of the application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification, illustrate the disclosure and together with the description serve to explain, but do not limit the disclosure. In the drawings:
fig. 1 is a schematic diagram of an online song house implementation system according to an embodiment of the present application;
FIG. 2 is a flow chart of an implementation method of an online song house provided by an embodiment of the application;
fig. 3 is a schematic diagram of audio transmission and playback according to an embodiment of the present application;
fig. 4 is a block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
In order to facilitate understanding of the online song house implementation method provided by the application, a system used by the online song house implementation method is described below. Referring to fig. 1, an architecture diagram of an online song-room implementation system according to an embodiment of the present application is shown, as shown in fig. 1, including a server 10 and a plurality of clients 20, where each client 20 is connected to the server 10 through a network.
Wherein the server 10 is used to create a virtual room and match multiple accounts to the same virtual room. The virtual rooms are mutually isolated, and can be used for simulating rooms in a real environment, and the online song room function is realized by the isolation function of the rooms in the real environment. In the case where multiple accounts are matched to the same virtual room, the server 10 establishes an audio link between the client 20 corresponding to each account and the virtual room, i.e., the accounts matched to the same virtual room may be in audio communication through the virtual room.
The client 20 may include a fixed terminal such as a PC (chinese full name: personal computer; english full name: personal Computer) and a mobile terminal such as a mobile phone. Each client 20 is provided with an audio collection device such as a microphone for collecting dry audio and call audio corresponding to a target song, and an audio output device such as a speaker for outputting mixed audio of the dry audio and accompaniment audio and call audio. The audio link between the client 20 corresponding to the account in the on-air display state and the virtual room is opened, the client 20 transmits the collected dry sound audio to the virtual room by using the audio link, the audio link between the client 20 corresponding to the account in the off-air display state and the virtual room is closed, and the opening and closing of the audio link between each client 20 and the virtual room does not affect the song playing process.
The embodiment of the application discloses an online singing room implementation method, which realizes real-time antiphonal singing of a plurality of accounts.
Referring to fig. 2, a flowchart of an implementation method of an online song house provided by an embodiment of the present application, as shown in fig. 2, includes:
s101: in the singing time period of the first account, the first client plays the first audio content stored locally, and sends first target audio and progress information thereof to the second client, and the second client plays the first target audio; the first audio content is audio content corresponding to the first account in accompaniment audio, and the first target audio is synthesized audio of the first audio content locally stored by the first client and the collected first dry audio;
in this embodiment, the first account corresponding to the first client and the second account corresponding to the second client are matched to the same virtual room, an audio link is established between the virtual room and the first client corresponding to the first account and the second client corresponding to the second account, the audio link realizes audio transmission between the first client or the second client and the virtual room, and audio communication between the first account and the second account is realized through the virtual room, so that audio communication in a real environment is simulated.
In the embodiment, the antiphonal singing scene of the first account and the second account is that in the antiphonal singing mode, the first account and the second account are in a loading state, the first account and the second account respectively sing different parts of the target song, the first account corresponds to the first audio content, and the second account corresponds to the second audio content. Namely, the present embodiment further includes: and if the first account and the second account both present the loading state, the first client determines first audio content corresponding to the first account, and the second client determines second audio content corresponding to the second account. Displaying lyrics corresponding to the first audio content in a first preset mode and displaying lyrics corresponding to the second audio content in a second preset mode in display interfaces of the first client and the second client. For example, lyrics corresponding to different accounts may be displayed in different colors, and prompt may be performed when the singing time of a certain account is about to be reached.
In a specific implementation, in a singing time period of a first account, accompaniment audio played by a first client is locally stored first audio content, meanwhile, first dry audio is collected, the locally stored first audio content and the first dry audio are synthesized into first target audio, the first target audio and progress information thereof are sent to a second client, and audio played by the second client is the first target audio. At the second client side, alignment of the accompaniment audio with the dry audio is ensured.
It should be noted that the first account may be in the ear-return mode or the play-out mode. When in the ear-return mode, the first client plays the first target audio through the ear-return, namely, the user can hear the first dry audio singed by himself through the ear-return. When in the play mode, the first client plays the accompaniment audio, and after the audio acquisition device acquires the audio, echo cancellation processing is required to be performed on the acquired audio so as to obtain a first dry audio. If the first client is in the play mode, the embodiment includes: the first client performs echo processing on the collected audio to obtain a first dry audio; and the second client performs echo processing on the acquired audio to obtain second dry sound audio.
S102: in the singing time period of the second account, the second client determines the current playing progress according to the received progress information, starts playing the locally stored second audio content based on the current playing progress, and sends second target audio and the progress information thereof to the first client; the second audio content is audio content corresponding to the second account in accompaniment audio, and the second target audio is synthesized audio of second audio content locally stored by the second client and collected second dry audio;
in a specific implementation, during the singing period of the second account, the accompaniment audio played by the second client is the locally stored second audio content. It may be appreciated that the second client may determine a current playing progress according to the previously received progress information of the first target audio, and start playing the locally stored second audio content from the current playing progress. Meanwhile, the second client collects second dry sound audio, synthesizes the locally stored second audio content and the collected second dry sound audio into second target audio, and sends the second target audio and progress information thereof to the first client through the server.
S103: and in the singing time period of the second account, if the first client receives second target audio sent by the second client, playing the second target audio.
It can be appreciated that, due to the loop delay between the first client and the second client, when the first client finishes playing the first audio content, the second target audio sent by the second client is not yet received, and at this time, the first client may continue playing the locally stored second audio content, that is, the embodiment further includes: and in the singing time period of the second account, if the first client does not receive the second target audio sent by the second client, playing the locally stored second audio content or blank audio. Of course, when the second target audio sent by the second client is not received, the first client may play the blank audio, which is not limited herein. Further, when receiving the second target audio sent by the second client, the audio played by the first client is switched to the second target audio. At the first client side, alignment of the accompaniment audio and the dry audio is ensured.
For example, the total length of the target song is 1800s, the first audio content is 0-30s, 60s-90s, 120s-150s, the second audio content is 30-60s, 90s-120s, 150s-180s, and the loop delay between the first client and the second client is 0.6s. The black part is to play the locally stored audio content, the white part is to transmit the audio to the counterpart, and the hatched part is to play the audio transmitted by the counterpart, as shown in fig. 3. And in 30s-30.6s, 90.6s-91.2s and 151.2s-151.8s, the first client continues to play the locally stored second audio content or blank audio. And the second client continues to play the locally stored first audio content or blank audio within 60.3s-60.9s and 120.9s-121.5 s.
It should be noted that, in this embodiment, the case of switching the first account to the second account for singing is described, and the case of switching the second account to the first account for singing is similar to the above, and will not be described here again.
As a preferred embodiment, the present step includes: before receiving the second target audio in the singing time period of the second account, the first client performs a fade-out process on the played first audio content; and if the first client receives the second target audio sent by the second client, performing progressive processing on the second target audio. In a specific implementation, if the first client plays the blank audio in the process of waiting for the second client to transmit the second target audio, the first target audio may be faded out when the first target audio is about to be played, and the received second target audio may be faded in when the first client begins to play, so that the blank audio played by the first client in the process of waiting for the second client to transmit the second target audio may not protrude too much, and on the first client side, the transition between the first target audio and the second target audio is more natural and smooth.
In the embodiment of the application, under the condition that the first account and the second account are matched to the same virtual room, the first account and the second account can realize real-time sectional chorus, namely a antiphonal mode, in the virtual room, wherein the first account corresponds to first audio content, and the second account corresponds to second audio content. When the first account sings, the accompaniment audio played by the first client is locally stored first audio content, and the audio played by the second client is synthesized audio of the first audio content stored by the first client and the collected first dry audio, namely first target audio. At the second client side, alignment of the accompaniment audio with the dry audio is ensured. When the second account sings, the second client determines the current playing progress according to the received progress information, and starts to play the locally stored second audio content based on the current playing progress, wherein the audio played by the first client is synthesized audio of the second audio content stored by the second client and the acquired second dry audio, namely the second target audio. At the first client side, alignment of the accompaniment audio and the dry audio is ensured. Therefore, according to the online song house implementation method provided by the embodiment of the application, when the first account and the second account perform real-time antiphonal singing, the alignment of accompaniment audio played by the first client and the second client and dry audio is realized.
On the basis of the above embodiment, as a preferred implementation manner, the method further includes: sending the target audio to a third client corresponding to a third account in the virtual room, so that the third client plays the target audio; the target audio comprises the first target audio sent by the first client and the second target audio sent by the second client.
In a specific implementation, the first client sends the first target audio to the second client through the server, and the second client sends the second target audio to the first client through the server, that is, the server may obtain the first target audio synthesized by the first client and the second target audio synthesized by the second client. After receiving the target audio, the server sends the target audio to a third client corresponding to the third account, and the third client plays the received synthesized audio in a normal play mode, so that chorus audio is pushed to the third account.
On the basis of the above embodiment, as a preferred implementation manner, the method further includes: the first client and the second client download accompaniment audio of the target song from a server and store the accompaniment audio as the first audio content and the second audio content respectively; and if the first account and the second account are in the downloading state, the first client and the second client respectively play locally stored accompaniment audio.
In a specific implementation, after a target song is requested by any account in a virtual room, clients corresponding to all accounts in the virtual room download accompaniment audios of the target song from a server, after the downloading is completed, the server determines playing time and sends the playing time to all clients, and all clients start playing locally stored accompaniment audios at the playing time.
On the basis of the above embodiment, as a preferred implementation manner, the method further includes: under the condition that the first account and the second account both show a wheat-down state, if the first account is switched to a wheat-up state, the first client sends first synthesized audio and progress information thereof to the second client; the first synthesized audio is synthesized audio of accompaniment audio locally stored by the first client and collected first dry audio; and the second client stops playing the locally stored accompaniment audio and starts playing the first synthesized audio.
In a specific implementation, during the playing process of the accompaniment audio of the target song, if the first account is switched to the top-hat state, the first account is in the solo mode. In the solo mode, the first client continues to play locally stored accompaniment audio and starts to collect first dry audio. The first client mixes the locally stored accompaniment audio and the first dry audio into first synthesized audio, the first synthesized audio and the progress information thereof are sent to the second client through the server, and the second client stops playing the locally stored accompaniment audio and starts playing the received first synthesized audio. That is, the accompaniment audio and the dry audio played by the second client are both from the first client, that is, the first synthesized audio played by the second client is synthesized by the first client, and on the second client side, the alignment of the accompaniment audio and the dry audio is ensured.
Preferably, the second client stops playing locally stored accompaniment audio and starts playing the first synthesized audio, including: and the second client performs fading-in processing on the locally stored accompaniment audio and performs fading-in processing on the first synthesized audio. In a specific implementation, in order to make the audio play more natural, the audio to be stopped may be subjected to fade-in processing, and the audio to be started may be subjected to fade-in processing.
It should be noted that, when the first account presents the top-up status and the second account presents the bottom-down status, the first account may be in the ear-back mode or the play mode. When in the ear-return mode, the first client plays the first synthesized audio through the ear-return, namely, the user can hear the first dry audio singed by himself through the ear-return. When in the play mode, the first client plays the accompaniment audio, and after the audio acquisition device acquires the audio, echo cancellation processing is required to be performed on the acquired audio so as to obtain a first dry audio.
On the basis of the above embodiment, as a preferred implementation manner, the method further includes: and under the condition that the first account presents the loading state and the second account presents the unloading state, if the first account is switched to the unloading state, the second client determines the current playing progress according to the received progress information, and starts to play locally stored accompaniment audio based on the current playing progress.
In a specific implementation, under the condition that the first account presents a loading state and the second account presents a downloading state, the first synthesized audio sent to the second client by the first client all carries progress information, after the first account is subjected to the loading state, the first account and the second account are both in the downloading state, the first client continues to play locally stored accompaniment audio, the second client can determine the current playing progress according to the received progress information, and continues to play the locally stored accompaniment audio from the current playing progress.
On the basis of the above embodiment, as a preferred implementation manner, the method further includes: when the first account presents a loading state and the second account presents a unloading state, if the second account is switched to the loading state after the first account is switched to the unloading state, the second client sends second synthesized audio and progress information thereof to the first client; the second synthesized audio is synthesized audio of accompaniment audio locally stored by the second client and collected second dry audio; the first client stops playing locally stored accompaniment audio and starts playing the second synthesized audio.
In the implementation, the first account is used for playing the song after the second account is used for playing the song, so that the function of singing the same target song by different accounts is realized. After the second account is on the wheat, the second client collects second dry sound audio, locally stored accompaniment audio and second dry sound audio are mixed into second synthesized audio, the second synthesized audio and progress information thereof are sent to the first client through the server, and the first client stops playing the locally stored accompaniment audio and starts playing the received second synthesized audio. The solo pattern of the second account is similar to the solo pattern of the first account described above and will not be described again here.
On the basis of the above embodiment, as a preferred implementation manner, the method further includes: under the condition that the first account and the second account are in the top-hat state, if the second account is switched to the bottom-hat state in the singing time period of the second account, the first client determines the current playing progress according to the received progress information, starts playing locally stored accompaniment audio based on the current playing progress, sends first synthesized audio carrying the accompaniment progress to the second client through the server, and the second client stops playing the locally stored accompaniment audio and starts playing the first synthesized audio.
In a specific implementation, in a case where the first account and the second account both present a status of the playing, i.e. the first account and the second account are in the antiphonal mode. And in the singing time of the first account, the first client plays locally stored accompaniment audio, and the second client plays the first synthesized audio sent by the first client. If the second account is down at this time, the first account resumes the solo mode, and the audio played by the first client and the second client does not need to be switched. And in the singing time of the second account, the first client plays the second synthesized audio sent by the second client, and the second client plays the locally stored accompaniment audio. If the second account is powered down at this time, the first account resumes the solo mode, the first client determines the current playing progress according to the progress information of the received second synthesized audio, starts playing the locally stored accompaniment audio based on the current playing progress, starts collecting the first dry audio, mixes the locally stored accompaniment audio and the first dry audio into the first synthesized audio, sends the first synthesized audio and the progress information thereof to the second client through the server, and the second client stops playing the locally stored accompaniment audio and starts playing the received first synthesized audio.
The present application also provides a server, referring to fig. 4, and a structure diagram of an electronic device 40 provided in an embodiment of the present application, as shown in fig. 4, may include a processor 41 and a memory 42.
Processor 41 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc., among others. The processor 41 may be implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array ). The processor 41 may also comprise a main processor, which is a processor for processing data in an awake state, also called CPU (Central Processing Unit ); a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 41 may integrate a GPU (Graphics Processing Unit, image processor) for rendering and drawing of content required to be displayed by the display screen. In some embodiments, the processor 41 may also include an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.
Memory 42 may include one or more computer-readable storage media, which may be non-transitory. Memory 42 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 42 is at least used for storing a computer program 421, where the computer program, when loaded and executed by the processor 41, can implement relevant steps in the online song-room implementation method performed by the first client or the second client disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 42 may further include an operating system 422 and data 423, where the storage may be transient storage or permanent storage. Operating system 422 may include, among other things, windows, unix, linux, etc.
In some embodiments, the electronic device 40 may further include a display 43, an input-output interface 44, a communication interface 45, a sensor 46, a power supply 47, and a communication bus 48.
Of course, the structure of the server shown in fig. 4 is not limited to the server in the embodiment of the present application, and the server may include more or less components than those shown in fig. 4, or may combine some components in practical applications.
In another exemplary embodiment, a computer readable storage medium is also provided, comprising program instructions which, when executed by a processor, implement the steps of the online song-realization method performed by the server of any of the embodiments described above.
In the description, each embodiment is described in a progressive manner, and each embodiment is mainly described by the differences from other embodiments, so that the same similar parts among the embodiments are mutually referred. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section. It should be noted that it will be apparent to those skilled in the art that various modifications and adaptations of the application can be made without departing from the principles of the application and these modifications and adaptations are intended to be within the scope of the application as defined in the following claims.
It should also be noted that in this specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Claims (14)
1. The online song room implementation method is characterized in that a first account corresponding to a first client and a second account corresponding to a second client are matched to a virtual room, and the online song room implementation method is characterized by comprising the following steps:
in the singing time period of the first account, the first client plays the first audio content stored locally, and sends first target audio and progress information thereof to the second client, and the second client plays the first target audio; the first audio content is audio content corresponding to the first account in accompaniment audio, and the first target audio is synthesized audio of the first audio content locally stored by the first client and the collected first dry audio;
in the singing time period of the second account, the second client determines the current playing progress according to the received progress information, starts playing the locally stored second audio content based on the current playing progress, and sends second target audio and the progress information thereof to the first client; the second audio content is audio content corresponding to the second account in accompaniment audio, and the second target audio is synthesized audio of second audio content locally stored by the second client and collected second dry audio;
and in the singing time period of the second account, if the first client receives second target audio sent by the second client, playing the second target audio.
2. The online song house implementation method of claim 1, further comprising:
and in the singing time period of the second account, if the first client does not receive the second target audio sent by the second client, playing the locally stored second audio content or blank audio.
3. The online song house implementation method of claim 1, further comprising:
sending the target audio to a third client corresponding to a third account in the virtual room, so that the third client plays the target audio; the target audio comprises the first target audio sent by the first client and the second target audio sent by the second client.
4. The online song-on-house implementation method of claim 1, wherein if the first client is in a play-out mode, the method further comprises:
the first client performs echo processing on the collected audio to obtain a first dry audio;
and the second client performs echo processing on the acquired audio to obtain second dry sound audio.
5. The online song-on-house implementation method according to claim 1, wherein, in a singing period of the second account, if the first client receives the second target audio sent by the second client, playing the second target audio includes:
before receiving the second target audio in the singing time period of the second account, the first client performs a fade-out process on the played first audio content;
and the first client receives second target audio sent by the second client, and then performs progressive processing on the second target audio.
6. The online song house implementation method of claim 1, further comprising:
the first client and the second client download accompaniment audio of the target song from a server and store the accompaniment audio as the first audio content and the second audio content respectively;
and if the first account and the second account are in the downloading state, the first client and the second client respectively play locally stored accompaniment audio.
7. The online song house implementation method of claim 1, further comprising:
under the condition that the first account and the second account both show a wheat-down state, if the first account is switched to a wheat-up state, the first client sends first synthesized audio and progress information thereof to the second client; the first synthesized audio is synthesized audio of accompaniment audio locally stored by the first client and collected first dry audio;
and the second client stops playing the locally stored accompaniment audio and starts playing the first synthesized audio.
8. The online song-on-room implementation method of claim 7 wherein the second client stopping playing locally stored accompaniment audio and starting playing the first synthesized audio comprises:
and the second client performs fading-in processing on the locally stored accompaniment audio and performs fading-in processing on the first synthesized audio.
9. The online song house implementation method of claim 1, further comprising:
and under the condition that the first account presents the loading state and the second account presents the unloading state, if the first account is switched to the unloading state, the second client determines the current playing progress according to the received progress information, and starts to play locally stored accompaniment audio based on the current playing progress.
10. The online song house implementation method of claim 1, further comprising:
when the first account presents a loading state and the second account presents a unloading state, if the second account is switched to the loading state after the first account is switched to the unloading state, the second client sends second synthesized audio and progress information thereof to the first client; the second synthesized audio is synthesized audio of accompaniment audio locally stored by the second client and collected second dry audio;
the first client stops playing locally stored accompaniment audio and starts playing the second synthesized audio.
11. The online song house implementation method of claim 1, further comprising:
and if the first account and the second account are in the loading state, the first client determines first audio content corresponding to the first account in the accompaniment audio, and the second client determines second audio content corresponding to the second account in the accompaniment audio.
12. The online song house implementation method of claim 1, further comprising:
under the condition that the first account and the second account are in the on-hook state, if the second account is switched to the off-hook state in the singing time period of the second account, the first client determines the current playing progress according to the received progress information, starts to play locally stored accompaniment audio based on the current playing progress, sends first synthesized audio carrying the accompaniment progress to the second client through the server, and stops playing the locally stored accompaniment audio and starts to play the first synthesized audio.
13. An electronic device, comprising:
a memory for storing a computer program;
a processor for implementing the steps performed by the first client or the second client in the online song-room implementation method according to any one of claims 1 to 12 when executing the computer program.
14. A computer readable storage medium, characterized in that it has stored thereon a computer program which, when executed by a processor, implements the steps performed by the first client or the second client in the online song-room implementation method according to any one of claims 1 to 12.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011357981.7A CN112492338B (en) | 2020-11-27 | 2020-11-27 | Online song house implementation method, electronic equipment and computer readable storage medium |
| PCT/CN2021/122572 WO2022111062A1 (en) | 2020-11-27 | 2021-10-08 | Online karaoke room implementation method, electronic device, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011357981.7A CN112492338B (en) | 2020-11-27 | 2020-11-27 | Online song house implementation method, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112492338A CN112492338A (en) | 2021-03-12 |
| CN112492338B true CN112492338B (en) | 2023-10-13 |
Family
ID=74936286
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011357981.7A Active CN112492338B (en) | 2020-11-27 | 2020-11-27 | Online song house implementation method, electronic equipment and computer readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112492338B (en) |
| WO (1) | WO2022111062A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112492338B (en) * | 2020-11-27 | 2023-10-13 | 腾讯音乐娱乐科技（深圳）有限公司 | Online song house implementation method, electronic equipment and computer readable storage medium |
| CN117640987A (en) * | 2023-11-27 | 2024-03-01 | 腾讯音乐娱乐科技（深圳）有限公司 | Offline online real-time chorus method, device and medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006215460A (en) * | 2005-02-07 | 2006-08-17 | Faith Inc | Karaoke voice transmission / reception system and method |
| CN102340482A (en) * | 2010-07-21 | 2012-02-01 | 崔信奎 | Karaoke room service system based on network and user terminal using same |
| CN107396137A (en) * | 2017-07-14 | 2017-11-24 | 腾讯音乐娱乐（深圳）有限公司 | The method, apparatus and system of online interaction |
| CN108134875A (en) * | 2017-12-20 | 2018-06-08 | 腾讯音乐娱乐科技（深圳）有限公司 | Control method, device, storage medium and the equipment that audio plays |
| CN109327731A (en) * | 2018-11-20 | 2019-02-12 | 福建海媚数码科技有限公司 | A kind of real-time synthetic method of DIY video and system based on Karaoke |
| CN109767777A (en) * | 2019-01-31 | 2019-05-17 | 迅雷计算机（深圳）有限公司 | A kind of mixing method of live broadcast software |
| CN109859730A (en) * | 2019-03-25 | 2019-06-07 | 北京达佳互联信息技术有限公司 | A kind of audio-frequency processing method and device |
| WO2020034227A1 (en) * | 2018-08-17 | 2020-02-20 | 华为技术有限公司 | Multimedia content synchronization method and electronic device |
| CN111402844A (en) * | 2020-03-26 | 2020-07-10 | 广州酷狗计算机科技有限公司 | Song chorusing method, device and system |
| CN111524494A (en) * | 2020-04-27 | 2020-08-11 | 腾讯音乐娱乐科技（深圳）有限公司 | Remote real-time chorus method and device and storage medium |
| CN111741370A (en) * | 2020-08-12 | 2020-10-02 | 腾讯科技（深圳）有限公司 | Multimedia interaction method, related device, equipment and storage medium |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6967275B2 (en) * | 2002-06-25 | 2005-11-22 | Irobot Corporation | Song-matching system and method |
| JP6733221B2 (en) * | 2016-03-04 | 2020-07-29 | ヤマハ株式会社 | Recording system, recording method and program |
| US20180096507A1 (en) * | 2016-10-04 | 2018-04-05 | Facebook, Inc. | Controls and Interfaces for User Interactions in Virtual Spaces |
| CN110267081B (en) * | 2019-04-02 | 2021-01-22 | 北京达佳互联信息技术有限公司 | Live stream processing method, device and system, electronic equipment and storage medium |
| CN111261133A (en) * | 2020-01-15 | 2020-06-09 | 腾讯科技（深圳）有限公司 | Singing processing method and device, electronic equipment and storage medium |
| CN112148248A (en) * | 2020-09-28 | 2020-12-29 | 腾讯音乐娱乐科技（深圳）有限公司 | Online song room implementation method, electronic device and computer readable storage medium |
| CN112489611B (en) * | 2020-11-27 | 2024-09-03 | 腾讯音乐娱乐科技（深圳）有限公司 | Online song house implementation method, electronic equipment and computer readable storage medium |
| CN112492338B (en) * | 2020-11-27 | 2023-10-13 | 腾讯音乐娱乐科技（深圳）有限公司 | Online song house implementation method, electronic equipment and computer readable storage medium |
-
2020
- 2020-11-27 CN CN202011357981.7A patent/CN112492338B/en active Active
-
2021
- 2021-10-08 WO PCT/CN2021/122572 patent/WO2022111062A1/en active Application Filing
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006215460A (en) * | 2005-02-07 | 2006-08-17 | Faith Inc | Karaoke voice transmission / reception system and method |
| CN102340482A (en) * | 2010-07-21 | 2012-02-01 | 崔信奎 | Karaoke room service system based on network and user terminal using same |
| CN107396137A (en) * | 2017-07-14 | 2017-11-24 | 腾讯音乐娱乐（深圳）有限公司 | The method, apparatus and system of online interaction |
| CN108134875A (en) * | 2017-12-20 | 2018-06-08 | 腾讯音乐娱乐科技（深圳）有限公司 | Control method, device, storage medium and the equipment that audio plays |
| WO2020034227A1 (en) * | 2018-08-17 | 2020-02-20 | 华为技术有限公司 | Multimedia content synchronization method and electronic device |
| CN109327731A (en) * | 2018-11-20 | 2019-02-12 | 福建海媚数码科技有限公司 | A kind of real-time synthetic method of DIY video and system based on Karaoke |
| CN109767777A (en) * | 2019-01-31 | 2019-05-17 | 迅雷计算机（深圳）有限公司 | A kind of mixing method of live broadcast software |
| CN109859730A (en) * | 2019-03-25 | 2019-06-07 | 北京达佳互联信息技术有限公司 | A kind of audio-frequency processing method and device |
| CN111402844A (en) * | 2020-03-26 | 2020-07-10 | 广州酷狗计算机科技有限公司 | Song chorusing method, device and system |
| CN111524494A (en) * | 2020-04-27 | 2020-08-11 | 腾讯音乐娱乐科技（深圳）有限公司 | Remote real-time chorus method and device and storage medium |
| CN111741370A (en) * | 2020-08-12 | 2020-10-02 | 腾讯科技（深圳）有限公司 | Multimedia interaction method, related device, equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| Fast Mode Decision Using All-Zero Block Detection for Fidelity and Spatial Scalable Video Coding;Seung-Won Jung;IEEE Transactions on Circuits and Systems for Video Technology;全文 * |
| 广电融媒体平台网络互动直播业务流程和系统架构设计;蔡宏伍;广播与电视技术;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112492338A (en) | 2021-03-12 |
| WO2022111062A1 (en) | 2022-06-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112489611B (en) | Online song house implementation method, electronic equipment and computer readable storage medium | |
| US7379961B2 (en) | Spatialized audio in a three-dimensional computer-based scene | |
| US6987514B1 (en) | Voice avatars for wireless multiuser entertainment services | |
| CN110234032B (en) | Voice skill creating method and system | |
| CN112492338B (en) | Online song house implementation method, electronic equipment and computer readable storage medium | |
| CN112087655A (en) | Method and device for presenting virtual gift and electronic equipment | |
| KR20190005103A (en) | Electronic device-awakening method and apparatus, device and computer-readable storage medium | |
| CN111583415B (en) | Information processing methods, devices and electronic equipment | |
| CN106293659A (en) | A kind of audio frequency real-time processing method, device and intelligent terminal | |
| CN111986689A (en) | Audio playing method, audio playing device and electronic equipment | |
| CN106792013A (en) | A kind of method, the TV interactive for television broadcast sounds | |
| CN112148248A (en) | Online song room implementation method, electronic device and computer readable storage medium | |
| CN114882895A (en) | Audio processing method, device, computer equipment and computer readable storage medium | |
| CN114115659B (en) | Audio editing method and device | |
| WO2025112547A1 (en) | Real-time online and offline chorus method, device, and medium | |
| CN118433437A (en) | Live broadcasting room voice live broadcasting method and device, live broadcasting system, electronic equipment and medium | |
| JP6051075B2 (en) | A communication karaoke system that can continue duet singing in the event of a communication failure | |
| CN116546233A (en) | Live interaction method, apparatus, device, medium and program product | |
| CN103780612B (en) | Data processing method and electronic equipment | |
| CN115657862A (en) | Method, device, storage medium and equipment for automatic switching of virtual KTV scene pictures | |
| CN115720275A (en) | Audio and video synchronization method, system, device and medium for AI digital human in live broadcast | |
| CN103200309A (en) | Entertainment audio file for text-only application | |
| CN116074688A (en) | Audio playing method, device and computer readable storage medium | |
| CN112685000A (en) | Audio processing method and device, computer equipment and storage medium | |
| KR20050040185A (en) | Transmission method for message using dynamic images |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |