Disclosure of Invention
The embodiment of the disclosure at least provides a multiparty call processing method, a multiparty call processing device, electronic equipment and a storage medium.
In a first aspect, an embodiment of the present disclosure provides a method for processing a multiparty call, which is applied to an application server, including:
Detecting a call access request of a first call participant, and identifying a call forwarding number of a multiparty call room carried in the call access request;
Controlling the first call participant to access to the multiparty call room based on the call sign;
receiving a multimedia data stream of each first call participant; the multimedia data stream is an audio and/or video stream acquired by the user equipment after each first call participant is accessed to the multiparty call room;
And mixing the multimedia data streams of all the first call participants in the same multiparty call room to obtain a first data stream, and sending the first data stream to all the first call participants in the multiparty call room through an edge node call forwarding platform.
In an alternative embodiment, before receiving the call access request of the first call participant, the method further comprises:
Receiving a call creation request of a call initiator forwarded by the call sign forwarding platform, and creating a multiparty call room;
sending a generation request to the call sign turning platform; the generation request is a request for requesting the call forwarding platform to generate a call forwarding number of the multiparty call room;
and acquiring a communication switching relation between the call sign of the multiparty call room fed back by the call sign turning platform and the multiparty call room.
In an alternative embodiment, the method further comprises: after the call forwarding relation between the call forwarding number of the multiparty call room fed back by the call forwarding platform and the multiparty call room is obtained, receiving call numbers of a plurality of first call participants input by a call initiator on a call interface of the multiparty call room; sending a first dialing request to the calling number of each first call participant; the first dialing request carries a call forwarding number of the multiparty call room;
the detecting a call access request of a first call participant includes: and if the answering operation of the first call participant to the first dialing request is detected, determining that the call access request of the first call participant is detected.
In an alternative embodiment, the detecting a call access request of the first call participant includes:
And if the call request of the call forwarding number is detected, determining that the call access request of the first call participant is detected.
In an alternative embodiment, the method further comprises: before controlling the first call participant to access the multiparty call room based on the call forwarding number, responding to the dialing operation of the second call participant on the first call participant, and initiating a second dialing request to the call number of the first call participant; the second call participant is a participant which is accessed to the multiparty call room before the first call participant, and the second dialing request carries a call forwarding number of the multiparty call room;
The detecting a call access request of a first call participant includes: and if the answering operation of the first call participant to the second dialing request is detected, determining that the call access request of the first call participant is detected.
In an alternative embodiment, the application server is a device disposed outside the IMS network;
the receiving the multimedia data stream of each first call participant includes: receiving multimedia data streams of all the first call participants sent by a call sign transferring platform; after the first call participant accesses the multiparty call room, uploading a multimedia data stream to the call sign transferring platform;
The sending the target data to each first call participant in the multiparty call room comprises the following steps: and sending the target data to each first call participant in the multiparty call room through the call sign transferring platform.
In an alternative embodiment, the method further comprises:
After detecting that the multi-party call room is closed, determining a plurality of charging items of the multi-party call room;
And settling each charging item to obtain a settlement result of each calculation item.
In a second aspect, an embodiment of the present disclosure provides a multiparty call processing method, applied to an edge node, including:
responding to a call access operation of a first call participant, and sending a call access request of the first call participant to an application server; the call request is sent to a multi-party call room by a user;
receiving a first data stream sent by the application server; the first data stream is obtained by mixing multimedia data streams of all first call participants, and the multimedia data streams are audio and/or video streams acquired by user equipment after all first call participants are connected to the multiparty call room;
and sending the first data stream to each first call participant in the multiparty call room.
In an alternative embodiment, prior to the call access operation in response to the first call participant, the method further comprises:
Generating a call forwarding number in response to a generation request sent by the application server; the generation request is a request for requesting the call forwarding platform to generate a call forwarding number of the multiparty call room;
And establishing a communication switching relation between the multiparty call room and the call forwarding sign.
In an alternative embodiment, the establishing a communication switching relationship between the multiparty call room and the call sign includes:
establishing a target mapping relation between the call forwarding number and the multiparty call room; the target mapping relation is used for indicating that any calling number can be accessed into the multiparty call room through the call forwarding number;
And determining the target mapping relation as the communication switching relation.
In an alternative embodiment, before said receiving the first data stream sent by the application server, the method further comprises:
And receiving the multimedia data streams of the first call participants, and sending the multimedia data streams to the application server so that the application server mixes the multimedia data streams of the first call participants in the same multiparty call room to obtain first data streams.
In an alternative embodiment, before sending the first data stream to each first call participant in the multiparty call room, the method further comprises:
acquiring service configuration preset by a call initiator of the multiparty call room;
And processing the first data stream based on the service configuration to obtain a second data stream, and sending the second data stream to each first call participant in the multiparty call room.
In an alternative embodiment, the service configuration includes at least one of: the configuration of beauty, the configuration of virtual head portrait, the configuration of background, the configuration of translation, the configuration of summary generation and the configuration of audio conversion.
In an alternative embodiment, the processing the first data stream based on the service configuration to obtain a second data stream includes:
determining a platform call interface of a third party processing platform;
calling a processing program or a processing algorithm of the multimedia data stream of the third party processing platform through the platform calling interface;
and carrying out fusion processing on the first data stream and the service configuration through a processing program or a processing algorithm of the multimedia data stream to obtain the second data stream.
In a third aspect, an embodiment of the present disclosure further provides a multiparty call processing apparatus, including:
The detection module is used for detecting a call access request of a first call participant and identifying a call forwarding number of a multiparty call room carried in the call access request;
the access module is used for controlling the first call participant to access to the multiparty call room based on the call forwarding number;
A first receiving module, configured to receive a multimedia data stream of each first call participant; the multimedia data stream is an audio and/or video stream acquired by the user equipment after each first call participant is accessed to the multiparty call room;
And the mixing module is used for mixing the multimedia data streams of all the first call participants in the same multiparty call room to obtain a first data stream, and sending the first data stream to all the first call participants in the multiparty call room through the call sign transferring platform in the edge node.
In a fourth aspect, an embodiment of the present disclosure further provides a multiparty call processing apparatus, including:
The response module is used for responding to the call access operation of the first call participant and sending a call access request of the first call participant to the application server; the call request is sent to a multi-party call room by a user;
The second receiving module is used for receiving the first data stream sent by the application server; the first data stream is obtained by mixing multimedia data streams of all first call participants, and the multimedia data streams are audio and/or video streams of user acquisition equipment after all first call participants are connected to the multiparty call room;
and the sending module is used for sending the first data stream to each first call participant in the multiparty call room.
In a fifth aspect, embodiments of the present disclosure further provide an electronic device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory in communication via the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the steps of the first aspect, or any of the possible implementations of the first aspect.
In a sixth aspect, the presently disclosed embodiments also provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the first aspect, or any of the possible implementations of the first aspect.
In the embodiment of the disclosure, firstly, a call request of a first call participant is detected, and a call number of a multiparty call room carried in the call request is identified; secondly, controlling the first call participant to access to a multiparty call room based on the call sign; secondly, receiving the multimedia data stream of each first call participant; the multimedia data stream is an audio and/or video stream acquired by the user equipment after each first call participant accesses the multi-party call room; and finally, mixing the multimedia data streams of all the first call participants in the same multiparty call room to obtain a first data stream, and sending the first data stream to all the first call participants in the multiparty call room through an edge node call forwarding platform.
In the above embodiment, by detecting the call access request of the first call participant and determining the call forwarding number, the first call participant can be quickly and accurately accessed into the multi-party call room; the use of a turn-call sign to control access by the first call participant enhances flexibility and efficiency of call control. And the mixed first data stream is sent through the call sign transferring platform in the edge node, so that the delay of data transmission can be reduced, and the conversation quality can be improved. Therefore, the method provided by the embodiment of the disclosure improves the efficiency of call access, reduces the waiting time, improves the user experience, and ensures the call quality and the stability of the system.
The foregoing objects, features and advantages of the disclosure will be more readily apparent from the following detailed description of the preferred embodiments taken in conjunction with the accompanying drawings.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are only some embodiments of the present disclosure, but not all embodiments. The components of the embodiments of the present disclosure, which are generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure provided in the accompanying drawings is not intended to limit the scope of the disclosure, as claimed, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be made by those skilled in the art based on the embodiments of this disclosure without making any inventive effort, are intended to be within the scope of this disclosure.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.
The term "and/or" is used herein to describe only one relationship, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist together, and B exists alone. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, may mean including any one or more elements selected from the group consisting of A, B and C.
Research has found that with the development of globalization and mobile communication technology, there is an increasing demand for enabling efficient and stable multiparty calls.
Currently, the multi-party call technology on the market often relies on telephone networks or primary network protocols, which have many limitations in terms of functionality and performance. For example, early multiparty call systems often cannot support high definition audio and video, and the user experience is poor; at the same time, these systems also lack flexibility and cannot be dynamically adjusted according to the number and quality requirements of call participants. Therefore, in multiparty calls, the multimedia data streams from different participants need to be processed correctly to ensure that each participant has a good call experience. On the market, based on OTT multi-person video call service, a Web standard protocol (WebRTC API, SRTP, ICE) is used to establish a call connection, requiring a user to register a personal account number and join a video call through a browser, or a corresponding client/applet application; the scheme is based on VoLTE video call provided by an operator, call connection is established by using SIP and SDP protocols, terminal side transformation is not needed to support the reception of multiple paths of audio and video streams, and a user dials a call number through a dial plate to join in the multiparty video call.
Based on the above-mentioned study, the present disclosure provides a multiparty call processing method, first, by detecting a call access request of a first call participant, identifying a call sign of a multiparty call room carried in the call access request; secondly, controlling the first call participant to access to a multiparty call room based on the call sign; secondly, receiving the multimedia data stream of each first call participant; the multimedia data stream is an audio and/or video stream acquired by the user equipment after each first call participant accesses the multi-party call room; and finally, mixing the multimedia data streams of all the first call participants in the same multiparty call room to obtain a first data stream, and sending the first data stream to all the first call participants in the multiparty call room through an edge node call forwarding platform.
In the above embodiment, by detecting the call access request of the first call participant, determining the call forwarding number, and controlling the access of the first call participant by using the call forwarding number, the first call participant can be quickly and accurately accessed into the multi-party call room, and the flexibility and efficiency of call control are enhanced. The mixed first data stream is sent through the call sign transferring platform in the edge node, so that the delay of data transmission can be reduced, and the conversation quality can be improved. Therefore, the method provided by the embodiment of the disclosure improves the efficiency of call access, reduces the waiting time, improves the user experience, and ensures the call quality and the stability of the system.
For the sake of understanding the present embodiment, first, a detailed description will be given of a multiparty call processing method disclosed in an embodiment of the present disclosure, where an execution main body of the multiparty call processing method provided in the embodiment of the present disclosure is generally an electronic device with a certain computing capability. In some possible implementations, the multiparty call processing method may be implemented by a processor calling computer readable instructions stored in a memory.
Referring to fig. 1, a flowchart of a multiparty call processing method according to an embodiment of the present disclosure is shown, where the method includes steps S201 to S204, applied to an application server, where:
s201, detecting a call access request of a first call participant, and identifying a call forwarding number of a multiparty call room carried in the call access request.
In the embodiment of the present application, first, the application server may detect a call access request of a first call participant, where a method for detecting a call access request will be described in the following embodiments. After detecting the call access request, the call access request can be identified to determine the call forwarding number of the multiparty call room carried in the call access request.
Here, the call access request is forwarded to the application server by the call sign forwarding platform of the edge node, where the call access request generally includes the call sign of the multiparty call room to which the first call participant wants to join. At this time, the application server can identify the call access request, so as to obtain the call sign of the multiparty call room carried in the call access request.
Here, the multi-party call room is created by the call initiator, and the first call participant is one or more participants who want to access the multi-party call room except for the call initiator.
S202, controlling the first call participant to access to the multi-party call room based on the call sign.
In the embodiment of the disclosure, after a call initiator initiates creation of a multi-party call room, a call sign forwarding platform can generate a corresponding call sign for the multi-party call room, and establish a communication switching relationship between the call sign and the room sign of the multi-party call room; the call forwarding platform may then send the communication-diversion relationship to the application server.
After determining the call forwarding number based on the detected call access request, the application server may determine a room number of a multiparty call room accessed to the call forwarding number according to the communication forwarding relationship. The application server may then access the first call participant to the multi-party call room.
S203, receiving the multimedia data stream of each first call participant; the multimedia data stream is an audio and/or video stream collected by the user equipment after each first call participant accesses the multi-party call room.
In an embodiment of the present disclosure, the multiparty call room may include a plurality of first call participants, for example, may include 2 to 9 first call participants, and here, the number of the first call participants is not particularly limited so as to be able to be implemented.
Here, the multiparty call room may be a video call room or an audio call room. Under the condition that the multiparty call room is a video call room, the user equipment corresponding to each first call participant can collect the audio stream and the video stream of each first call participant, so as to obtain the multimedia data stream of the first call participant. Under the condition that the multiparty call room is an audio call room, the user equipment corresponding to each first call participant can collect the audio stream of each first call participant, so as to obtain the multimedia data stream of the first call participant.
In the embodiment of the application, in the case that the multiparty call room is a video call room, the first call participant may choose to close the camera before entering the video call room, and at this time, the user equipment may not collect the video stream of the first call participant. In addition, the first call participant may choose to close the camera after entering the video call room, and the application server notifies the user device to stop collecting the video stream of the first call participant after detecting the camera closing instruction.
S204, mixing the multimedia data streams of all the first call participants in the same multiparty call room to obtain a first data stream, and sending the first data stream to all the first call participants in the multiparty call room through the call sign transferring platform in the edge node.
In an embodiment of the disclosure, the multimedia data streams of the first call participants may be mixed by a multipoint control unit (MultiPoint Control Unit, MCU) architecture model created by a media service unit in the application server, and the mixed first data streams are obtained.
Here, the MCU may be configured to mix the multimedia data streams of the first call participants according to the acquisition time of each multimedia data stream, and mix the multimedia data streams to obtain the first data stream.
Here, the specific method for the control unit architecture model to mix the multimedia data streams of each first call participant is as follows:
First, the multimedia data streams of the respective first call participants may be input into the control unit architecture model. Secondly, the multimedia data stream of each first call participant can be decoded through the control unit architecture model to obtain a first intermediate data stream of each first call participant. And secondly, rescaling the first intermediate data stream through the control unit architecture model to obtain a second intermediate data stream of each first call participant. Finally, the second intermediate data streams of the first call participants can be mixed through the control unit architecture model to obtain first data streams.
In the embodiment of the disclosure, firstly, a call request of a first call participant is detected, and a call number of a multiparty call room carried in the call request is identified; secondly, controlling the first call participant to access to a multiparty call room based on the call sign; secondly, receiving the multimedia data stream of each first call participant; the multimedia data stream is an audio and/or video stream acquired by the user equipment after each first call participant accesses the multi-party call room; and finally, mixing the multimedia data streams of all the first call participants in the same multiparty call room to obtain a first data stream, and sending the first data stream to all the first call participants in the multiparty call room through an edge node call forwarding platform.
In the above embodiment, by detecting the call access request of the first call participant, determining the call forwarding number, and controlling the access of the first call participant by using the call forwarding number, the first call participant can be quickly and accurately accessed into the multi-party call room, and the flexibility and efficiency of call control are enhanced. The mixed first data stream is sent through the call sign transferring platform in the edge node, so that the delay of data transmission can be reduced, and the conversation quality can be improved. Therefore, the method provided by the embodiment of the disclosure improves the efficiency of call access, reduces the waiting time, improves the user experience, and ensures the call quality and the stability of the system.
In an alternative embodiment, before receiving the call access request of the first call participant, the method further comprises the steps of:
Firstly, receiving a call creation request of a call initiator forwarded by a call sign forwarding platform, and creating a multiparty call room;
Then, sending a generation request to a call sign transferring platform; the generation request is a request for requesting the call forwarding platform to generate a call forwarding of the multiparty call room;
And finally, acquiring a communication switching relation between the call forwarding number of the multiparty call room fed back by the call forwarding platform and the multiparty call room.
In the embodiment of the disclosure, a call initiator may send a call creation request to a service operation management platform through a call sign forwarding platform. After receiving a call creation request of a call initiator, the service operation management platform creates a multiparty call room for the call initiator and sends a generation request to a call sign transferring platform; wherein the generation request carries the room number of the created multiparty call room.
After receiving the generation request, the call forwarding platform can generate a call forwarding number of the multi-party call room through a call forwarding number distribution system in the call forwarding platform, and bind the room number of the multi-party call room with the call forwarding number. After binding is completed, the communication transfer relationship between the call forwarding number of the multiparty call room and the multiparty call room can be obtained.
Here, after the communication diversion relation between the call sign of the multiparty call room and the multiparty call room is obtained, the communication diversion relation may be transmitted to the application server.
In an embodiment of the present disclosure, a call initiator may send a call creation request to a service operation management platform. The call creation request can be generated by filling in a template provided by the service operation management platform, and can be submitted by dialing a unified service number of the service operation management platform through the mobile terminal equipment.
In the above embodiment, before receiving the call access request, the multiparty call room is created and the call sign is acquired, so that smooth creation and access management of the call are ensured, and the organization and scheduling capability of the system is improved.
Several ways of detecting a call access request by a first call participant will be described in detail below.
Mode one:
in this manner one, the call initiator may invite the first call participant to access by using a group call invite method, in which case, detecting the call access request of the first call participant specifically includes the following procedures:
After a call forwarding relation between a call forwarding number of a multiparty call room fed back by a call forwarding platform and the multiparty call room is acquired, receiving call numbers of a plurality of first call participants input by a call initiator on a call interface of the multiparty call room; simultaneously sending a first dialing request to the calling number of each first call participant; the first dialing request carries a call forwarding number of the multiparty call room.
Here, after entering the multiparty call room, the call initiator may input a plurality of call numbers of the first call participants in a call interface (also referred to as a group call interface) provided by the service operation management platform, and click a "one-click call" button. The application server transmits a first dialing request to the calling number of each first call participant at the same time after detecting the trigger operation of the one-key call button.
The calling number of the first call participant may be an international mobile equipment identity (International Mobile Equipment Identity, IMEI) or an international mobile subscriber identity (International Mobile Subscriber Identification Number, IMSI) of the first call participant.
If the first call participant answers the first dialing request, determining that the call access request of the first call participant is detected.
In an embodiment of the present disclosure, when a first call participant receives a first dialing request and performs a listening operation, it is determined that a call access request of the first call participant is detected, and the first call participant is accessed into a multi-party call room.
In the above embodiment, the system can conveniently receive the call numbers of the plurality of first call participants input by the call initiator after acquiring the call forwarding number, and send a call request to them. This centralized call control makes it more efficient to add new first call participants.
Mode two:
In the second mode, the first call participant can access the multiparty call room in an active dialing mode.
In this case, detecting a call access request of the first call participant specifically includes the steps of:
And if the call request of the call forwarding number is detected, determining that the call access request of the first call participant is detected.
In an embodiment of the present disclosure, after creating the multiparty call room, the call participant may send the call number of the first call participant to the application server through the call sign forwarding platform. And then, the application server can send the call forwarding number of the multiparty call room to the first call participant through the call forwarding platform.
If a call request of the first call participant to the turn call sign is detected, it is determined that a call access request of the first call participant is detected.
In the above embodiment, the system identifies the call access request actively initiated by the first call participant by detecting the answering operation, so that the judging flow is simplified, and the processing speed and the response time are improved.
Mode three:
in the third mode, the call initiator may invite the first call participant to access in a mode of inviting in a call, in which case, detecting the call access request of the first call participant specifically includes the following procedures:
Before controlling a first call participant to access a multi-party call room based on a call forwarding number, responding to a dialing operation of a second call participant on the first call participant, and initiating a second dialing request to a call number of the first call participant; the second call participant is a participant which is accessed to the multiparty call room before the first call participant, and the second dialing request carries a call number of the multiparty call room.
If the first call participant answers the second dialing request, determining that the call access request of the first call participant is detected.
In an embodiment of the present disclosure, the second call participant is a participant that accesses the multi-party call room before the first call participant. Here, the second call participant invites the first call participant to join the multiparty call room through the handset number. For example, the second call participant may input the call number of the first call participant in the call interface of the multiparty call room, and after detecting a trigger operation of a "call" button in the call interface of the multiparty call room, determine that a dialing operation of the first call participant by the second call participant is detected. At this point, a second dialing request may be initiated to the calling number of the first call participant.
And when detecting the answering operation of the first call participant to the second dialing request, determining that the call access request of the first call participant is detected.
In the above embodiment, all the parties in the multiparty call can invite new parties to join through the mobile phone number of the other party in the multiparty call process, so that the multiparty call access mechanism can continuously process the joining of a plurality of second call participants, and the expansibility of the call is enhanced.
In an alternative embodiment, in the case that the application server is a device disposed outside an IMS (IP multimedia system, IP Multimedia Subsystem) network, the above-mentioned receiving the multimedia data stream of each first call participant includes the following steps:
Receiving multimedia data streams of all first call participants sent by a call sign transferring platform; after a first call participant accesses a multiparty call room, uploading a multimedia data stream to a call sign forwarding platform;
The above-mentioned sending of the target data to each first call participant in the multiparty call room comprises the following steps:
and sending target data to each first call participant in the multiparty call room through the call sign transferring platform.
In an embodiment of the present disclosure, first, a multimedia data stream of each first call participant is sent to a call sign forwarding platform. And secondly, after receiving the multimedia data streams of the first call participants, the call forwarding platform sends the multimedia data streams of the first call participants to the application server.
Here, first, after receiving the multimedia data streams of the respective first call participants, the application server may mix the multimedia data streams of the respective first call participants through a media service unit in the application server to obtain a mixed stream of media data streams (i.e., target data). And then, after obtaining the media data stream after the mixed stream, the media data stream can be sent to a call sign transferring platform. And finally, the mixed media data stream can be sent to each first call participant in the multiparty call room through the call sign transferring platform.
In an embodiment of the present disclosure, the application server is a device disposed in an IMS network. Firstly, after each first call participant accesses the multiparty call room, the generated multimedia data stream is directly sent to the application server. Then, the multimedia data streams of the first call participants may be mixed by a media service unit in the application server, to obtain a mixed stream of media data streams (i.e., target data). The mixed media data stream may then be sent to a translation number platform. And finally, the mixed media data stream can be sent to each first call participant in the multiparty call room through the call sign transferring platform.
In the above embodiment, by configuring the application server outside the IMS network and describing the mixing process of the multimedia data streams of each first call participant, flexibility of deployment of the system and efficient management of multimedia data are demonstrated.
In an alternative embodiment, the method further comprises the steps of:
Firstly, after detecting that a multiparty call room is closed, determining a plurality of charging items of the multiparty call room;
And secondly, settling each charging item to obtain a settlement result of each calculation item.
In an embodiment of the present disclosure, a plurality of billing items for a multi-party call room is determined after a multi-party call room shutdown is detected. After detecting that each first call participant and each second call participant in the multiparty call room are on-hook or the call initiator manually closes the multiparty call room at the service operation management platform, the multiparty call room is automatically closed. At this time, the room number of the multiparty call room is controlled to be unbound with the corresponding call number, and the unbound call number and room number are recovered.
Here, a plurality of billing items of the multiparty call room are determined. The settlement of each calculation item can be obtained according to the communication time of each first participant and each second participant (namely, the time of joining in the multiparty communication room) according to the charging items.
Wherein the charging item is a value added service (i.e., service configuration) selected by the call initiator.
In the above embodiment, after the multiparty call room is closed, the charging items can be determined and settled, so that the multiparty call service can perform accurate charge calculation and support the charging management system of the service provider.
Referring to fig. 2, a flowchart of a multiparty call processing method according to an embodiment of the present disclosure is shown, where the method includes steps S301 to S303, applied to an edge node, where:
S301, responding to a call access operation of a first call participant, and sending a call access request of the first call participant to an application server; and the call request is carried by the call access request and comprises a call forwarding number of the multiparty call room.
In the embodiment of the present application, the call sign platform in the edge node may detect a call access operation of the first call participant, where a method for detecting the call access operation will be described in the following embodiments. After detecting the call access operation, a call access request of the first call participant may be sent to the application server.
Here, the call access request generally includes a call sign of the multiparty call room that the first call participant wants to join. At this time, the application server may analyze the call access request, and obtain the call sign of the multiparty call room to be accessed from the analysis.
Here, the multi-party call room is created by the call initiator, and the first call participant is one or more participants who want to access the multi-party call room except for the call initiator.
S302, receiving a first data stream sent by an application server; the first data stream is obtained by mixing multimedia data streams of all first call participants, and the multimedia data streams are audio and/or video streams acquired by user equipment after all first call participants are connected into a multi-party call room.
In an embodiment of the present disclosure, the multiparty call room may include a plurality of first call participants, for example, may include 2 to 9 first call participants, and here, the number of the first call participants is not particularly limited so as to be able to be implemented.
In the embodiment of the disclosure, after a call initiator initiates creation of a multi-party call room, a call sign forwarding platform can generate a corresponding call sign for the multi-party call room, and establish a communication switching relationship between the call sign and the room sign of the multi-party call room; the call forwarding platform may then send the communication-diversion relationship to the application server.
After determining the call forwarding number based on the detected call access request, the application server may determine a room number of a multiparty call room accessed to the call forwarding number according to the communication forwarding relationship. The application server may then access the first call participant to the multi-party call room.
Here, the multiparty call room may be a video call room or an audio call room. Under the condition that the multiparty call room is a video call room, the user equipment corresponding to each first call participant can collect the audio stream and the video stream of each first call participant, so as to obtain the multimedia data stream of the first call participant. Under the condition that the multiparty call room is an audio call room, the user equipment corresponding to each first call participant can collect the audio stream of each first call participant, so as to obtain the multimedia data stream of the first call participant.
In the embodiment of the application, in the case that the multiparty call room is a video call room, the first call participant may choose to close the camera before entering the video call room, and at this time, the user equipment may not collect the video stream of the first call participant. In addition, the first call participant may choose to close the camera after entering the video call room, and the application server notifies the user device to stop collecting the video stream of the first call participant after detecting the camera closing instruction.
In an embodiment of the disclosure, the multimedia data streams of the first call participants may be mixed by a multipoint control unit (MultiPoint Control Unit, MCU) architecture model created by a media service unit in the application server, and the mixed first data streams are obtained.
Here, the MCU may be configured to mix the multimedia data streams of the first call participants according to the acquisition time of each multimedia data stream, and mix the multimedia data streams to obtain the first data stream.
Here, the specific method for the control unit architecture model to mix the multimedia data streams of each first call participant is as follows:
first, the multimedia data streams of the respective first call participants may be input into the control unit architecture model. Secondly, the multimedia data stream of each first call participant can be decoded through the control unit architecture model to obtain a first intermediate data stream of each first call participant. And secondly, rescaling the first intermediate data stream through the control unit architecture model to obtain a second intermediate data stream of each first call participant. Finally, the second intermediate data streams of the first call participants can be mixed through the control unit architecture model to obtain first data streams, and the first data streams are sent to a call sign forwarding platform in the edge node.
S303, sending a first data stream to each first call participant in the multiparty call room.
In an embodiment of the disclosure, the first data stream may be sent to each first call participant and call initiator in the multiparty call room by a call sign forwarding platform at an edge node. The media service unit may send the first data stream to the call sign forwarding platform in the application server edge node after obtaining the first data stream output by the control unit architecture model. After receiving the first data stream, the call forwarding platform sends the first data stream to each first call participant and call initiator in the multiparty call room.
In the above embodiment, by detecting the call access request of the first call participant, determining the call forwarding number, and controlling the access of the first call participant by using the call forwarding number, the first call participant can be quickly and accurately accessed into the multi-party call room, and the flexibility and efficiency of call control are enhanced. The mixed first data stream is sent through the call sign transferring platform in the edge node, so that the delay of data transmission can be reduced, and the conversation quality can be improved. Therefore, the method provided by the embodiment of the disclosure improves the efficiency of call access, reduces the waiting time, improves the user experience, and ensures the call quality and the stability of the system.
In an alternative embodiment, prior to the call access operation in response to the first call participant, the method further comprises the steps of:
Firstly, generating a call forwarding number in response to a generation request sent by an application server; the generation request is a request for requesting the call forwarding platform to generate a call forwarding of the multiparty call room;
and secondly, establishing a communication transfer relation between the multiparty call room and the call forwarding sign.
In the embodiment of the disclosure, a call initiator may send a call creation request to a service operation management platform through a call sign forwarding platform. After receiving a call creation request of a call initiator, the service operation management platform creates a multiparty call room for the call initiator and sends a generation request to a call sign transferring platform; wherein the generation request carries the room number of the created multiparty call room.
After receiving the generation request, the call forwarding platform can generate a call forwarding number of the multi-party call room through a call forwarding number distribution system in the call forwarding platform, and bind the room number of the multi-party call room with the call forwarding number. After binding is completed, the communication transfer relationship between the call forwarding number of the multiparty call room and the multiparty call room can be obtained.
Here, after the communication diversion relation between the call sign of the multiparty call room and the multiparty call room is obtained, the communication diversion relation may be transmitted to the application server.
In the above embodiment, the edge node generates the call sign and establishes the communication relationship in response to the request of the application server, so that the efficiency of access and management of the multiparty call is higher.
In an alternative embodiment, the method establishes a communication transfer relationship between the multiparty call room and the call sign, and specifically comprises the following steps:
Firstly, establishing a target mapping relation between a call sign and a multiparty call room; the target mapping relation is used for indicating that any calling number can be accessed into the multiparty call room through the call forwarding number;
next, the target mapping relationship is determined as a communication transit relationship.
In an embodiment of the present disclosure, a target mapping relationship between a call sign and a multiparty call room is established. The target mapping relationship between the call sign and the multiparty call room can be established through a call sign forwarding platform in the edge node.
Here, the target mapping relationship between the call forwarding number and the multiparty call room can be established through the virtual intermediate number AXN mapping technology, so that a unique call forwarding number is allocated to the multiparty call room according to the target mapping relationship. Any call participant can join the multiparty call room by dialing a call sign using the mobile terminal device.
Referring to fig. 3, a schematic diagram of a method for processing a multiparty call in a direct access mode is shown, wherein:
first, a virtual intermediate number (i.e., a turn call sign) may be generated by the turn call sign platform and sent to each first call participant through a turn call sign distribution system in the turn call sign platform. Second, a multiparty call room may be created by an application server. And secondly, establishing a target mapping relation between the multiparty call room and the call sign through an AXN mapping technology by using the call sign transferring platform. Secondly, each first call participant can access the multiparty call room by dialing a call sign on the dial plate. Secondly, the multimedia data streams generated by the first call participants in the multiparty call room can be directly uploaded to the application server. Secondly, the multimedia data streams of the first call participants can be mixed through an application server to obtain first data streams. Second, the first data stream may be sent to a media forwarding service system in the call sign platform by an application server. Finally, the first data stream may be sent to each first call participant via the media forwarding service system.
Referring to fig. 4, a schematic diagram of a multiparty call processing method of an access mode accessed through a call sign platform is shown, wherein:
First, a virtual intermediate number (i.e., a turn call sign) may be generated by the turn call sign platform and sent to each first call participant through a turn call sign distribution system in the turn call sign platform. Second, a multiparty call room may be created by an application server. And secondly, establishing a target mapping relation between the multiparty call room and the call sign through an AXN mapping technology by using the call sign transferring platform. Secondly, each first call participant can access the multiparty call room by dialing a call sign on the dial plate. Secondly, the multimedia data stream generated by each first call participant in the multiparty call room can be directly uploaded to a media forwarding service system in the call sign transferring platform. Secondly, the multimedia data stream may be uploaded to an application server through a media forwarding service system. Secondly, the multimedia data streams of the first call participants can be mixed through an application server to obtain first data streams. Second, the first data stream may be sent to a media forwarding service system in the call sign platform by an application server. Finally, the first data stream may be sent to each first call participant via the media forwarding service system.
The multimedia data stream comprises a UEA audio-visual stream and a UEB audio-visual stream.
In an alternative embodiment, before receiving the first data stream sent by the application server, the method further comprises the steps of:
and receiving the multimedia data streams of all the first call participants, and sending the multimedia data streams to the application server so that the application server mixes the multimedia data streams of all the first call participants in the same multiparty call room to obtain the first data streams.
In an embodiment of the present disclosure, multimedia data streams of first call participants in the same multi-party call room are mixed. The multimedia data streams of the first call participants may be mixed by a multipoint control unit (MultiPoint Control Unit, MCU) architecture model created by a media service unit in the application server, and the mixed data streams are obtained.
Here, the specific method for the control unit architecture model to mix the multimedia data streams of each first call participant is as follows:
First, the multimedia data streams of the respective first call participants may be input into the control unit architecture model. Secondly, the multimedia data stream of each first call participant can be decoded through the control unit architecture model to obtain a first intermediate data stream of each first call participant. And secondly, rescaling the first intermediate data stream through the control unit architecture model to obtain a second intermediate data stream of each first call participant. Finally, the second intermediate data streams of the first call participants can be mixed through the control unit architecture model to obtain first data streams.
In an alternative embodiment, before sending the first data stream to each first call participant in the multiparty call room, the method further comprises the steps of:
acquiring service configuration preset by a call initiator in a multiparty call room;
And processing the first data stream based on the service configuration to obtain a second data stream, and sending the second data stream to each first call participant in the multiparty call room.
In the embodiment of the disclosure, the call initiator may preset a service configuration through the service operation management platform.
Here, the service configuration includes at least one of: the configuration of beauty, the configuration of virtual head portrait, the configuration of background, the configuration of translation, the configuration of summary generation and the configuration of audio conversion.
In an embodiment of the disclosure, the first data stream is processed based on a service configuration to obtain a second data stream, and the second data stream is sent to each first call participant in the multiparty call room. Firstly, after receiving the first data stream, the edge node can process the first data stream through the media capability platform to obtain a second data stream. And secondly, after the second data stream is obtained, sending the second data stream to each first call participant in the multiparty call room.
Here, the media capability platform processes the first data stream. The media capability platform can call the API of the third party capability to realize the service configuration corresponding to the service configuration, such as multiparty call room background replacement, character video stream beauty of each first call participant and each second participant, virtual head portrait setting of each first call participant and each second participant, real-time voice transcription, chinese-English translation and the like.
In the embodiment, by acquiring the service configuration and processing the data stream, personalized services such as beauty, virtual head portrait and the like are provided, and the user experience is enhanced.
In an alternative embodiment, the processing of the first data stream based on the service configuration to obtain the second data stream specifically includes the following steps:
determining a platform call interface of a third party processing platform;
calling a processing program or a processing algorithm of the multimedia data stream of the third party processing platform through a platform calling interface;
And fusing the first data stream and the service configuration through a processing program or a processing algorithm of the multimedia data stream to obtain a second data stream.
In an embodiment of the present disclosure, a platform call interface of a third party processing platform is determined. The platform call interface (i.e., API) of the third party processing platform through which the processing program or processing algorithm of the multimedia data stream of the third party processing platform can be called may be determined through the service corresponding to the service configuration.
Here, the first data stream and the service configuration are subjected to fusion processing by a processing program or a processing algorithm of the multimedia data stream, to obtain a second data stream. The first data popular media composition process may be performed by a processing program of the multimedia data stream based on the service configuration; the media composition process includes AI analysis and special effects composition. And taking the data subjected to the media synthesis processing as a second data stream.
In the above embodiment, the processing program of the multimedia data stream of the third party processing platform is adopted to process the first data stream. Thus, capability upgrades and iterative updates are facilitated: the third party capability is updated and iterated on the media capability platform, so that other core network devices of the media surface are not affected. And, third party capability introduces in a flexible, convenient: the introduction of third party capabilities is not limited by media plane functionality and resources. And, the nearby access of the processing program is facilitated: the media capability platform may be deployed at an edge node near the first call participant to reduce processing latency.
Referring to fig. 5, a schematic system architecture of a multiparty call processing method according to an embodiment of the present disclosure is shown, wherein:
comprising the following steps: application server, business operation management platform, large area and edge node.
Wherein, the application server comprises: the system comprises a business AS unit, a control plane unit and a media service unit.
The service AS unit is used for determining the room number of the multiparty call room corresponding to which the first call participant is connected according to the call sign, connecting the first call participant to the multiparty call room corresponding to the room number of the multiparty call room, and receiving the call creation request of the call initiator forwarded by the call sign forwarding platform to create the multiparty call room.
The control surface unit is used for realizing the functions of resource allocation, continuous calling, parameter party number control and the like of the multiparty call room.
The media service unit is used for mixing the multimedia data streams of all the first call participants through the architecture model of the multipoint control unit.
The service operation management platform is used for opening and setting the multiparty call service according to the call creation request of the call initiator, storing the first data stream, inquiring and ending the multiparty call service.
The application server provides service registration service for the service operation platform.
Wherein the large area includes 5G voice (VoNR), capability network elements, and long term evolution voice bearer (VoLTE) as+.
Wherein the 5G voice and capability network element and the application server are in communication connection. The long-term evolution voice bearing AS+ and the 5G voice and capability network element are in communication connection, and a representational state transfer protocol (Restful) is adopted between the long-term evolution voice bearing AS+ and the 5G voice and capability network element for data transmission.
Wherein the edge node comprises: a call sign turning platform and a media capability platform.
Wherein, turn call sign platform includes: a call forwarding distribution system and a media forwarding service system.
The call forwarding number distribution system is used for generating call forwarding numbers of each multiparty call room and binding the multiparty call rooms with the call forwarding numbers corresponding to the multiparty call rooms. The media forwarding service system is used for uploading the multimedia data stream to the application server, sending the first data stream to each first call participant, providing continuous control of a multiparty call room, receiving and transmitting signaling in the call process, copying the media data stream, synthesizing and rendering video, and receiving/reporting DTMF signals.
The media capability platform is used for calling the API of the third party capability through the media capability platform to realize the service corresponding to the service configuration.
In the above embodiment, by detecting the call access request of the first call participant, determining the call forwarding number, and controlling the access of the first call participant by using the call forwarding number, the first call participant can be quickly and accurately accessed into the multi-party call room, and the flexibility and efficiency of call control are enhanced. The mixed first data stream is sent through the call sign transferring platform in the edge node, so that the delay of data transmission can be reduced, and the conversation quality can be improved. Therefore, the method provided by the embodiment of the disclosure improves the efficiency of call access, reduces the waiting time, improves the user experience, and ensures the call quality and the stability of the system.
It will be appreciated by those skilled in the art that in the above-described method of the specific embodiments, the written order of steps is not meant to imply a strict order of execution but rather should be construed according to the function and possibly inherent logic of the steps.
Based on the same inventive concept, the embodiments of the present disclosure further provide a multiparty call processing device corresponding to the multiparty call processing method, and since the principle of solving the problem by the device in the embodiments of the present disclosure is similar to that of the multiparty call processing method in the embodiments of the present disclosure, the implementation of the device may refer to the implementation of the method, and the repetition is omitted.
Referring to fig. 6, a schematic diagram of a multiparty call processing apparatus according to an embodiment of the present disclosure is provided, where the apparatus includes: the device comprises a detection module 11, an access module 12, a first receiving module 13 and a mixing module 14; wherein,
The detection module is used for detecting a call access request of a first call participant and identifying a call forwarding number of a multiparty call room carried in the call access request;
the access module is used for controlling the first call participant to access to the multiparty call room based on the call forwarding number;
A first receiving module, configured to receive a multimedia data stream of each first call participant; the multimedia data stream is an audio and/or video stream acquired by the user equipment after each first call participant is accessed to the multiparty call room;
And the mixing module is used for mixing the multimedia data streams of all the first call participants in the same multiparty call room to obtain a first data stream, and sending the first data stream to all the first call participants in the multiparty call room through the call sign transferring platform in the edge node.
In the above embodiment, by detecting the call access request of the first call participant, determining the call forwarding number, and controlling the access of the first call participant by using the call forwarding number, the first call participant can be quickly and accurately accessed into the multi-party call room, and the flexibility and efficiency of call control are enhanced. The mixed first data stream is sent through the call sign transferring platform in the edge node, so that the delay of data transmission can be reduced, and the conversation quality can be improved. Therefore, the method provided by the embodiment of the disclosure improves the efficiency of call access, reduces the waiting time, improves the user experience, and ensures the call quality and the stability of the system.
Referring to fig. 7, a schematic diagram of a multiparty call processing apparatus according to an embodiment of the present disclosure is provided, where the apparatus includes: a response module 21, a second receiving module 22, a transmitting module 23; wherein,
The response module is used for responding to the call access operation of the first call participant and sending a call access request of the first call participant to the application server; the call request is sent to a multi-party call room by a user;
the second receiving module is used for receiving the first data stream sent by the application server; the first data streams are obtained by mixing multimedia data streams of all first call participants, and the multimedia data streams are audio and/or video streams acquired by user equipment after all first call participants are connected into a multi-party call room;
And the sending module is used for sending the first data stream to each first call participant in the multiparty call room. According to the embodiment of the disclosure, the first call participant can be quickly and accurately accessed into the multi-party call room by detecting the call access request of the first call participant and determining the call forwarding number. The use of a turn-call sign to control access by the first call participant enhances flexibility and efficiency of call control. And the mixed first data stream is sent through the call sign transferring platform in the edge node, so that the delay of data transmission can be reduced, and the conversation quality can be improved. Therefore, the method provided by the embodiment of the disclosure improves the efficiency of call access, reduces the waiting time, improves the user experience, and ensures the call quality and the stability of the system.
The process flow of each module in the apparatus and the interaction flow between the modules may be described with reference to the related descriptions in the above method embodiments, which are not described in detail herein.
Corresponding to the multiparty call processing method in fig. 1, the embodiment of the disclosure further provides an electronic device 700, as shown in fig. 8, which is a schematic structural diagram of the electronic device 700 provided in the embodiment of the disclosure, including:
A processor 71, a memory 72, and a bus 73; memory 72 is used to store execution instructions, including memory 721 and external memory 722; the memory 721 is also called an internal memory, and is used for temporarily storing operation data in the processor 71 and data exchanged with an external memory 722 such as a hard disk, the processor 71 exchanges data with the external memory 722 through the memory 721, and when the electronic device 700 is operated, the processor 71 and the memory 72 communicate through the bus 73, so that the processor 71 executes the following instructions:
Detecting a call access request of a first call participant, and identifying a call forwarding number of a multiparty call room carried in the call access request;
controlling the first call participant to access to the multiparty call room based on the call sign;
Receiving a multimedia data stream of each first call participant; the multimedia data stream is an audio and/or video stream acquired by the user equipment after each first call participant accesses the multi-party call room;
And mixing the multimedia data streams of all the first call participants in the same multiparty call room to obtain a first data stream, and sending the first data stream to all the first call participants in the multiparty call room through the edge node call forwarding platform.
Or cause the processor 71 to execute the following instructions:
responding to a call access operation of a first call participant, and sending a call access request of the first call participant to an application server; the call request is sent to a multi-party call room by a user;
receiving a first data stream sent by the application server; the first data stream is obtained by mixing multimedia data streams of all first call participants, and the multimedia data streams are audio and/or video streams acquired by user equipment after all first call participants are connected to the multiparty call room;
and sending the first data stream to each first call participant in the multiparty call room.
The disclosed embodiments also provide a computer readable storage medium having a computer program stored thereon, which when executed by a processor performs the steps of the multiparty call processing method described in the above method embodiments. Wherein the storage medium may be a volatile or nonvolatile computer readable storage medium.
The embodiments of the present disclosure further provide a computer program product, where the computer program product carries a program code, where instructions included in the program code may be used to perform steps of the multiparty call processing method described in the foregoing method embodiments, and specifically reference may be made to the foregoing method embodiments, which are not described herein.
Wherein the above-mentioned computer program product may be realized in particular by means of hardware, software or a combination thereof. In an alternative embodiment, the computer program product is embodied as a computer storage medium, and in another alternative embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), or the like.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described system and apparatus may refer to corresponding procedures in the foregoing method embodiments, which are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. The above-described apparatus embodiments are merely illustrative, for example, the division of the units is merely a logical function division, and there may be other manners of division in actual implementation, and for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some communication interface, device or unit indirect coupling or communication connection, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present disclosure may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in essence or a part contributing to the prior art or a part of the technical solution, or in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present disclosure. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Finally, it should be noted that: the foregoing examples are merely specific embodiments of the present disclosure, and are not intended to limit the scope of the disclosure, but the present disclosure is not limited thereto, and those skilled in the art will appreciate that while the foregoing examples are described in detail, it is not limited to the disclosure: any person skilled in the art, within the technical scope of the disclosure of the present disclosure, may modify or easily conceive changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features thereof; such modifications, changes or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the disclosure, and are intended to be included within the scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.