CN117812047A - Real-time audio and video access method, device, equipment and storage medium - Google Patents
Real-time audio and video access method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN117812047A CN117812047A CN202311832767.6A CN202311832767A CN117812047A CN 117812047 A CN117812047 A CN 117812047A CN 202311832767 A CN202311832767 A CN 202311832767A CN 117812047 A CN117812047 A CN 117812047A
- Authority
- CN
- China
- Prior art keywords
- signaling
- video
- gateway
- audio
- freeswitch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 230000011664 signaling Effects 0.000 claims abstract description 154
- 238000004891 communication Methods 0.000 claims abstract description 39
- 238000012545 processing Methods 0.000 claims description 7
- 238000012544 monitoring process Methods 0.000 claims description 6
- 230000004044 response Effects 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000007474 system interaction Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
- H04L65/1104—Session initiation protocol [SIP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
- H04L65/1108—Web based protocols, e.g. webRTC
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1029—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers using data related to the state of servers by a load balancer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1031—Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/50—Centralised arrangements for answering calls; Centralised arrangements for recording messages for absent or busy subscribers ; Centralised arrangements for recording messages
- H04M3/51—Centralised call answering arrangements requiring operator intervention, e.g. call or contact centers for telemarketing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/50—Centralised arrangements for answering calls; Centralised arrangements for recording messages for absent or busy subscribers ; Centralised arrangements for recording messages
- H04M3/51—Centralised call answering arrangements requiring operator intervention, e.g. call or contact centers for telemarketing
- H04M3/523—Centralised call answering arrangements requiring operator intervention, e.g. call or contact centers for telemarketing with call distribution or queueing
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- Multimedia (AREA)
- General Business, Economics & Management (AREA)
- Marketing (AREA)
- Telephonic Communication Services (AREA)
Abstract
The application discloses a real-time audio and video access method, a device, equipment and a storage medium, wherein the real-time audio and video access method comprises the following steps: acquiring a signaling which is sent by a client and contains an access request; based on a preset signaling channel, sending the signaling to a target gateway, and based on the target gateway, sending an SIP call to a switch for the switch to access the audio and video to a media channel; and establishing media streams of the client and the call center based on a preset media channel so as to realize audio and video communication of the client and the call center. According to the method and the device, the signaling channel and the media channel are decoupled, when the user client sends the signaling containing the access request, the signaling is forwarded and the audio-video call is established through the signaling channel in the decoupling state, and the media channel establishes the audio-video communication between the client and the call center, so that the audio-video communication between the user client and the call center is realized, and the requirement of the user terminal for accessing the audio-video call center is met.
Description
Technical Field
The present disclosure relates to the field of communications technologies, and in particular, to a method, an apparatus, a device, and a storage medium for accessing real-time audio and video.
Background
The bank call center is used as a way for the bank to communicate with the clients and is a core part in a bank client service system. Currently, with the development of communication technology, banking call centers are also being promoted to upgrade communication services to provide richer customer services.
In the related art, a bank call center supports call access of a conventional telephone or an IP telephone, and after an agent is allocated through a queuing machine, a voice service is provided to a customer by a manual agent. Specifically, the conventional telephone accesses the gateway through the public switched telephone network, or the IP telephone accesses the gateway through the internet, and then the access gateway calls the IP telephone exchange of the banking enterprise through the SIP protocol to realize the audio access call center. However, the method can only realize the access of the audio, and can not meet the requirement of accessing the audio and video of the user terminal to the call center.
Disclosure of Invention
The main purpose of the application is to provide a real-time audio and video access method, device, equipment and storage medium, which aim to solve the technical problem that the requirement of accessing the audio and video of a user terminal into a call center cannot be met in the prior art.
In order to achieve the above objective, the present application provides a real-time audio/video access method, which includes:
acquiring a signaling which is sent by a client and contains an access request, wherein the access request comprises an audio access request and/or a video access request;
based on a preset signaling channel, sending the signaling to a target gateway, and based on the target gateway, sending an SIP call to a switch for the switch to access the audio and video to a media channel;
and establishing media streams of the client and the call center based on a preset media channel so as to realize audio and video communication of the client and the call center, wherein the signaling channel and the media channel are in a decoupling state.
Optionally, the target gateway includes a target Freeswitch gateway, and the step of sending the signaling to the target gateway based on a preset signaling channel and sending the SIP call to the switch based on the target gateway includes:
based on a preset signaling channel, sending the signaling to the target Freeswitch gateway;
and sending the SIP call to the switch based on a preset ESL protocol and the target Freeswitch gateway.
Optionally, the step of sending the signaling to the target Freeswitch gateway based on a preset signaling channel includes:
converting the signaling into an HTTP request based on a preset signaling channel;
converting the HTTP request into a Freeswitch command;
and sending the Freeswitch command to a target Freeswitch gateway.
Optionally, the step of sending, based on the target gateway, a SIP call to a switch for the switch to access an audio/video to a media channel includes:
based on the target gateway, sending a SIP call to a switch;
distributing the audio and video corresponding to the access request to a target communication agent based on the switch and a preset agent distribution strategy;
and accessing the audio and video into a media channel corresponding to the target communication seat.
Optionally, the step of sending the signaling to the target Freeswitch gateway based on a preset signaling channel includes:
responding to a signaling containing an access request sent by a client, and starting a client load balancing service;
determining a target Freeswitch gateway based on the client load balancing service;
and sending the signaling to the target Freeswitch gateway based on a preset signaling channel.
Optionally, the step of determining a target Freeswitch gateway based on the client load balancing service includes:
determining a service instance list based on the client load balancing service, wherein the service instance list comprises a preset number of Freeswitch gateways;
and calling a preset flow scheduling strategy, and selecting a target Freeswitch gateway from the service instance list.
Optionally, before the step of starting the client load balancing service in response to the signaling including the access request sent by the client, the method includes:
monitoring heartbeat event messages of all Freeswitch gateways in a service instance list every time a preset time interval passes;
and if the Freeswitch gateway which does not send the heartbeat event message exists in the service instance list within the time interval, removing the Freeswitch gateway which does not send the heartbeat event message from the service instance list until the Freeswitch gateway which does not send the heartbeat event message resends the heartbeat event message within a preset time range, and recovering ESL protocol connection of the Freeswitch gateway in the service instance list.
The application also provides a real-time audio and video access device, the real-time audio and video access device includes:
the system comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring a signaling which is sent by a client and contains an access request, and the access request comprises an audio access request and/or a video access request;
the signaling forwarding module is used for sending the signaling to a target gateway based on a preset signaling channel, and sending an SIP call to the switch based on the target gateway so that the switch can access the audio and video into a media channel;
the establishing module is used for establishing the media stream of the client and the call center based on a preset media channel so as to realize audio and video communication between the client and the call center, wherein the signaling channel and the media channel are in a decoupling state.
The application also provides a real-time audio and video access device, the real-time audio and video access device includes: a memory, a processor and a program stored on the memory for implementing the real-time audio video access method,
the memory is used for storing a program for realizing a real-time audio and video access method;
the processor is used for executing a program for realizing the real-time audio and video access method so as to realize the steps of the real-time audio and video access method.
The application also provides a storage medium, on which a program for implementing the real-time audio/video access method is stored, where the program for implementing the real-time audio/video access method is executed by a processor to implement the steps of the real-time audio/video access method.
According to the method and the device, the signaling channel and the media channel are decoupled, when the user client sends the signaling containing the access request, the signaling is forwarded and the audio-video call is established through the signaling channel in the decoupling state, and the media channel establishes the audio-video communication between the client and the call center, so that the audio-video communication between the user client and the call center is realized, and the requirement of the user terminal for accessing the audio-video call center is met.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application. In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a schematic flow chart of a first embodiment of a real-time audio/video access method of the present application;
fig. 2 is a schematic diagram of system interaction of the real-time audio/video access method of the present application;
fig. 3 is a flow chart of a second embodiment of the real-time audio/video access method of the present application;
fig. 4 is a schematic block diagram of a real-time audio/video access device according to the present application;
fig. 5 is a schematic device structure diagram of a hardware running environment according to an embodiment of the present application.
The realization, functional characteristics and advantages of the present application will be further described with reference to the embodiments, referring to the attached drawings.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
Referring to fig. 1, fig. 1 is a flow chart of a first embodiment of a real-time audio/video access method according to the present application.
In a first embodiment, the real-time audio/video access method includes the following steps:
step S100, obtaining a signaling which is sent by a client and contains an access request, wherein the access request comprises an audio access request and/or a video access request;
it should be noted that, the execution main body of the real-time audio/video access method is a real-time audio/video access device, preferably, the real-time audio/video access device is a software client, and may also be other terminals with data transmission and data processing functions, which is not limited in particular.
Further, in a specific implementation, the real-time audio/video access device includes the following modules: a message gateway, a client balancer, a registry, a switching platform, etc.
It can be understood that when a user has an audio/video call request with a call center, an access call center request is sent on a client or an application APP corresponding to the call center, and the device converts the access request into a corresponding communication signaling, where the access request includes an audio access request and/or a video access request, that is, the user may select to access an audio call or an access (audio/video call, which is not limited specifically herein.
For example, the bank a is provided with a call center B, and the user X of the bank a issues a request for a video call through the application program C of the mobile terminal to which the bank a belongs, and after receiving the request, the device converts the request into a signaling for the corresponding video call.
Step 200, based on a preset signaling channel, sending the signaling to a target gateway, and based on the target gateway, sending an SIP call to a switch for the switch to access the audio and video to a media channel;
it should be noted that, the signaling channel is responsible for the establishment and negotiation of real-time audio and video call, including call, answering, hanging up and other signaling interactions, and the device sends the signaling to the target gateway based on the preset signaling channel, and sends the SIP call to the switch based on the target gateway, so that the switch accesses the audio and video to the media channel. The signaling channel and the media channel are in a decoupling state, namely the signaling channel and the media channel are in an independent channel state, and the media channel is responsible for interaction of media streams of the client and the call center so as to realize audio and video communication between the user client and the call center, thereby meeting the requirement of accessing the audio and video of the user terminal into the call center.
In a specific implementation, the device sends the signaling to a target gateway based on a preset signaling channel, and sends a SIP call to a switch based on the target gateway, which includes:
the device sends the signaling to the target Freeswitch gateway based on a preset signaling channel; and sending the SIP call to the switch based on a preset ESL protocol and the target Freeswitch gateway.
In a specific implementation, the application proposes to use a communication protocol of ESL and a Freeswitch technology, which supports the access of a real-time audio/video application of a proprietary signaling protocol to a traditional call center, and can support multiplexing of call center related capabilities, such as ACD, IVR, CTI, and the like, after the real-time audio/video incoming line. The ESL is also referred to as the full scale Event Socket Library, through which the Freeswitch gateway can interact.
Further, in the application, the Freeswitch media gateway supports interfacing with other media gateways and supports the access of a traditional telephone through a relay gateway so as to realize the fusion of the traditional telephone and real-time audio and video based on WebRTC.
It should be noted that, in the related art, the voice call access needs to use a voice board card in the signaling channel, and the voice board card has the disadvantage of low concurrency of the call link, so the application proposes that the signaling channel discards the voice board card, and the Freeswitch docking switch compensates the hardware limitation of the voice board card of the traditional call link, and improves the concurrency and expansibility of the call link.
In a specific implementation, the step of sending the signaling to the target Freeswitch gateway by the device based on a preset signaling channel includes:
the device converts the signaling into an HTTP request based on a preset signaling channel; converting the HTTP request into a Freeswitch command; and sending the Freeswitch command to a target Freeswitch gateway.
It should be noted that the signaling channels established by the device include a signaling gateway, a signaling conversion service and a Freeswitch gateway. The user client sends signaling by means of the IM channel, and the signaling gateway receives the signaling message sent by the IM and forwards the signaling message to the signaling conversion service. The signaling conversion service converts the IM signaling messages into Freeswitch commands and selects the available Freeswitch services to execute.
In a specific implementation, the device sends a SIP call to a switch based on the target gateway, so that the switch accesses an audio/video to a media channel, and the method includes:
the device sends the SIP call to the switch based on the target gateway; distributing the audio and video corresponding to the access request to a target communication agent based on the switch and a preset agent distribution strategy; and accessing the audio and video into a media channel corresponding to the target communication seat.
In a specific implementation, the device sends an SIP call to the switch after receiving a Freeswitch command based on a target Freeswitch, and the switch completes seat allocation and access.
Step S300, based on a preset media channel, media streams of the client and the call center are established to realize audio and video communication of the client and the call center, wherein the signaling channel and the media channel are in a decoupling state.
The device establishes the media flow between the client and the call center based on the preset media channel so as to realize audio and video communication between the client and the call center, wherein the client and the seat end are respectively integrated with an audio and video SDK, a user accesses manufacturer media service through the Internet, a user in an enterprise accesses through a cloud proxy, the communication quality is ensured by the audio and video manufacturer, and the system stability is improved.
Referring to fig. 2, the present application proposes that the real-time audio-video call is composed of two parts, namely a signaling channel and a media channel. The signaling channel is responsible for the establishment and negotiation of real-time audio and video call, including signaling interaction such as calling, answering, hanging up, etc.; the media channel is responsible for the interaction of the two media streams. The signaling channel of the device comprises a signaling gateway, a signaling conversion service and a Freeswitch gateway. The mobile client sends signaling by means of the IM channel, and the signaling gateway receives the signaling message sent by the IM and forwards the signaling message to the signaling conversion service. The signaling conversion service converts the IM signaling messages into Freeswitch commands and selects the available Freeswitch services to execute. After the Freeswitch receives the command, the SIP call is sent to the switch, and the switch completes the seat allocation and access.
According to the method and the device, the signaling channel and the media channel are decoupled, when the user client sends the signaling containing the access request, the signaling is forwarded and the audio-video call is established through the signaling channel in the decoupling state, and the media channel establishes the audio-video communication between the client and the call center, so that the audio-video communication between the user client and the call center is realized, and the requirement of the user terminal for accessing the audio-video call center is met.
Based on the above first embodiment, the present application further provides another embodiment, and referring to fig. 3, the real-time audio/video access method includes:
the device sends the signaling to the target Freeswitch gateway based on a preset signaling channel, and the method comprises the following steps:
step A100, responding to a signaling containing an access request sent by a client, and starting a client load balancing service;
it should be noted that the present application also provides a server load balancing mechanism for real-time audio and video access, specifically, when a signaling containing an access request is sent by a client, the client load balancing service is automatically triggered.
In a specific implementation, before the step of starting the client load balancing service in response to the signaling including the access request sent by the client in step a100, the method includes:
monitoring heartbeat event messages of all Freeswitch gateways in a service instance list every time when the device passes a preset time interval; and if the Freeswitch gateway which does not send the heartbeat event message exists in the service instance list within the time interval, removing the Freeswitch gateway which does not send the heartbeat event message from the service instance list until the Freeswitch gateway which does not send the heartbeat event message resends the heartbeat event message within a preset time range, and recovering ESL protocol connection of the Freeswitch gateway in the service instance list.
It should be noted that, in order to prevent the client load balancer from selecting to the failed Freeswitch node, it is necessary to detect whether the Freeswitch nodes in the load list are all available, and whether the state is normal, that is, whether the load is active.
In a specific embodiment, the Freeswitch generates a HEARTBEAT event every 20s, which can be used to detect whether the Freeswitch operates normally, and the client load balancer monitors the HEARTBEAT event of each Freeswitch node to determine whether the Freeswitch node is normal. When a Freeswitch node does not send a heatbeat event for more than 20 seconds, the client load balancer removes the node from the normal service instance list, remains in all service instance lists, and starts a timer, if there is a heatbeat event that re-receives the Freeswitch node within a default timeout period, the node will be added back to the normal service instance list, otherwise it is removed from all service instance lists, and the ESL connection to it is closed. Through the activity detection mechanism, nodes which can not provide service temporarily in the cluster can be intelligently filtered, so that the influence on the system is avoided.
Step A200, determining a target Freeswitch gateway based on the client load balancing service;
in a specific implementation, the step of determining the target Freeswitch gateway by the device based on the client load balancing service includes:
the device determines a service instance list based on the client load balancing service, wherein the service instance list comprises a preset number of Freeswitch gateways; and calling a preset flow scheduling strategy, and selecting a target Freeswitch gateway from the service instance list.
And step A300, based on a preset signaling channel, sending the signaling to the target Freeswitch gateway.
In a specific implementation, referring to fig. 2, a client load balancer is integrated in a signaling service in a module form, and when the signaling service is started, the signaling service acquires registration information of all Freeswitch nodes in a current cluster from a Zookeeper registration center, and monitors the Zookeeper nodes at the same time. The client load balancer maintains two lists, namely, all service instance lists and normal service instance lists, when a new Freeswitch is added to the cluster, the necessary information of the Freeswitch node is registered on the Zookeeper, and after the client load balancer monitors the change of the Zookeeper node, the node is added to all the service instance lists, and meanwhile, connection with the Freeswitch is attempted through an ESL protocol. When the connection state becomes CONNECTED, a long connection is successfully established with the node, and the node is added into a normal service instance list. When the information service needs to send a signaling request by using load balancing, the client load balancer calls a self-defined flow scheduling strategy, and selects the most suitable Freeswitch instance from a normal service instance list to provide the service.
The application further provides a real-time audio/video access device, referring to fig. 4, the real-time audio/video access device includes:
the system comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring a signaling which is sent by a client and contains an access request, and the access request comprises an audio access request and/or a video access request;
the signaling forwarding module is used for sending the signaling to a target gateway based on a preset signaling channel, and sending an SIP call to the switch based on the target gateway so that the switch can access the audio and video into a media channel;
the establishing module is used for establishing the media stream of the client and the call center based on a preset media channel so as to realize audio and video communication between the client and the call center, wherein the signaling channel and the media channel are in a decoupling state.
Optionally, the signaling forwarding module includes:
the first signaling sending module is used for sending the signaling to the target Freeswitch gateway based on a preset signaling channel;
and the call sending module is used for sending the SIP call to the switch based on the preset ESL protocol and the target Freeswitch gateway.
Optionally, the signaling sending module includes:
the signaling conversion module is used for converting the signaling into an HTTP request based on a preset signaling channel;
the request conversion module is used for converting the HTTP request into a Freeswitch command;
and the command sending module is used for sending the Freeswitch command to a target Freeswitch gateway.
Optionally, the call sending module includes:
the exchanger calling module is used for sending SIP calls to the exchanger based on the target gateway;
the distribution module is used for distributing the audio and video corresponding to the access request to a target communication agent based on the switch and a preset agent distribution strategy;
and the access module is used for accessing the audio and video to the media channel corresponding to the target communication seat.
Optionally, the signaling sending module includes:
the service starting module is used for responding to the signaling which is sent by the client and contains the access request and starting the load balancing service of the client;
the gateway determining module is used for determining a target Freeswitch gateway based on the client load balancing service;
and the second signaling sending module is used for sending the signaling to the target Freeswitch gateway based on a preset signaling channel.
Optionally, the gateway determining module includes:
the list determining module is used for determining a service instance list based on the client load balancing service, wherein the service instance list comprises a preset number of Freeswitch gateways;
and the selecting module is used for calling a preset flow scheduling strategy and selecting a target Freeswitch gateway from the service instance list.
Optionally, the real-time audio and video access device further includes:
the monitoring module is used for monitoring heartbeat event messages of all Freeswitch gateways in the service instance list every time a preset time interval passes;
and the filtering module is used for removing the Freeswitch gateway which does not send the heartbeat event message from the service instance list if the Freeswitch gateway which does not send the heartbeat event message exists in the service instance list within the time interval until the Freeswitch gateway which does not send the heartbeat event message resends the heartbeat event message within a preset time range, and restoring ESL protocol connection of the Freeswitch gateway in the service instance list.
The specific implementation manner of the real-time audio and video access device is basically the same as that of each embodiment of the real-time audio and video access method, and is not repeated here.
Referring to fig. 5, fig. 5 is a schematic diagram of a terminal structure of a hardware running environment according to an embodiment of the present application.
As shown in fig. 5, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Optionally, the real-time audio/video access device may further include a rectangular user interface, a network interface, a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and so on. The rectangular user interface may include a Display screen (Display), an input sub-module such as a Keyboard (Keyboard), and the optional rectangular user interface may also include a standard wired interface, a wireless interface. The network interface may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface).
It will be appreciated by those skilled in the art that the real-time audio video access device structure shown in fig. 4 is not limiting and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 5, an operating system, a network communication module, and a real-time audio/video access program may be included in the memory 1005 as one type of storage medium. The operating system is a program for managing and controlling hardware and software resources of the real-time audio and video access device, and supports the running of the real-time audio and video access program and other software and/or programs. The network communication module is used for realizing communication among components in the memory 1005 and communication with other hardware and software in the real-time audio/video access system.
In the real-time audio/video access device shown in fig. 5, the processor 1001 is configured to execute a real-time audio/video access program stored in the memory 1005, to implement the steps of the real-time audio/video access method described in any one of the above.
The specific implementation manner of the real-time audio and video access device is basically the same as that of each embodiment of the real-time audio and video access method, and is not repeated here.
The application also provides a storage medium, on which a program for implementing the real-time audio/video access method is stored, where the program for implementing the real-time audio/video access method is executed by a processor to implement the real-time audio/video access method as follows:
acquiring a signaling which is sent by a client and contains an access request, wherein the access request comprises an audio access request and/or a video access request;
based on a preset signaling channel, sending the signaling to a target gateway, and based on the target gateway, sending an SIP call to a switch for the switch to access the audio and video to a media channel;
and establishing media streams of the client and the call center based on a preset media channel so as to realize audio and video communication of the client and the call center, wherein the signaling channel and the media channel are in a decoupling state.
Optionally, the target gateway includes a target Freeswitch gateway, and the step of sending the signaling to the target gateway based on a preset signaling channel and sending the SIP call to the switch based on the target gateway includes:
based on a preset signaling channel, sending the signaling to the target Freeswitch gateway;
and sending the SIP call to the switch based on a preset ESL protocol and the target Freeswitch gateway.
Optionally, the step of sending the signaling to the target Freeswitch gateway based on a preset signaling channel includes:
converting the signaling into an HTTP request based on a preset signaling channel;
converting the HTTP request into a Freeswitch command;
and sending the Freeswitch command to a target Freeswitch gateway.
Optionally, the step of sending, based on the target gateway, a SIP call to a switch for the switch to access an audio/video to a media channel includes:
based on the target gateway, sending a SIP call to a switch;
distributing the audio and video corresponding to the access request to a target communication agent based on the switch and a preset agent distribution strategy;
and accessing the audio and video into a media channel corresponding to the target communication seat.
Optionally, the step of sending the signaling to the target Freeswitch gateway based on a preset signaling channel includes:
responding to a signaling containing an access request sent by a client, and starting a client load balancing service;
determining a target Freeswitch gateway based on the client load balancing service;
and sending the signaling to the target Freeswitch gateway based on a preset signaling channel.
Optionally, the step of determining a target Freeswitch gateway based on the client load balancing service includes:
determining a service instance list based on the client load balancing service, wherein the service instance list comprises a preset number of Freeswitch gateways;
and calling a preset flow scheduling strategy, and selecting a target Freeswitch gateway from the service instance list.
Optionally, before the step of starting the client load balancing service in response to the signaling including the access request sent by the client, the method includes:
monitoring heartbeat event messages of all Freeswitch gateways in a service instance list every time a preset time interval passes;
and if the Freeswitch gateway which does not send the heartbeat event message exists in the service instance list within the time interval, removing the Freeswitch gateway which does not send the heartbeat event message from the service instance list until the Freeswitch gateway which does not send the heartbeat event message resends the heartbeat event message within a preset time range, and recovering ESL protocol connection of the Freeswitch gateway in the service instance list.
The specific implementation manner of the storage medium is basically the same as that of each embodiment of the real-time audio/video access method, and is not repeated here.
The present application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of the real-time audio video access method described above.
The specific implementation manner of the computer program product of the present application is substantially the same as the above embodiments of the real-time audio/video access method, and will not be described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above, including several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method described in the embodiments of the present application.
The foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the claims, and all equivalent structures or equivalent processes using the descriptions and drawings of the present application, or direct or indirect application in other related technical fields are included in the scope of the claims of the present application.
Claims (10)
1. The real-time audio and video access method is characterized by comprising the following steps of:
acquiring a signaling which is sent by a client and contains an access request, wherein the access request comprises an audio access request and/or a video access request;
based on a preset signaling channel, sending the signaling to a target gateway, and based on the target gateway, sending an SIP call to a switch for the switch to access the audio and video to a media channel;
and establishing media streams of the client and the call center based on a preset media channel so as to realize audio and video communication of the client and the call center, wherein the signaling channel and the media channel are in a decoupling state.
2. The method for accessing real-time audio and video according to claim 1, wherein the target gateway comprises a target Freeswitch gateway, the step of transmitting the signaling to the target gateway based on a preset signaling channel and transmitting the SIP call to the switch based on the target gateway comprises:
based on a preset signaling channel, sending the signaling to the target Freeswitch gateway;
and sending the SIP call to the switch based on a preset ESL protocol and the target Freeswitch gateway.
3. The method for accessing real-time audio and video according to claim 2, wherein the step of transmitting the signaling to the target Freeswitch gateway based on a preset signaling channel comprises:
converting the signaling into an HTTP request based on a preset signaling channel;
converting the HTTP request into a Freeswitch command;
and sending the Freeswitch command to a target Freeswitch gateway.
4. The real-time audio and video access method according to claim 1, wherein the step of sending a SIP call to a switch for the switch to access audio and video to a media channel based on the target gateway comprises:
based on the target gateway, sending a SIP call to a switch;
distributing the audio and video corresponding to the access request to a target communication agent based on the switch and a preset agent distribution strategy;
and accessing the audio and video into a media channel corresponding to the target communication seat.
5. The method for accessing real-time audio and video according to claim 2, wherein the step of transmitting the signaling to the target Freeswitch gateway based on a preset signaling channel comprises:
responding to a signaling containing an access request sent by a client, and starting a client load balancing service;
determining a target Freeswitch gateway based on the client load balancing service;
and sending the signaling to the target Freeswitch gateway based on a preset signaling channel.
6. The method of real-time audio and video access according to claim 5, wherein said step of determining a target Freeswitch gateway based on said client load balancing service comprises:
determining a service instance list based on the client load balancing service, wherein the service instance list comprises a preset number of Freeswitch gateways;
and calling a preset flow scheduling strategy, and selecting a target Freeswitch gateway from the service instance list.
7. The real-time audio-video access method according to claim 5, wherein before the step of starting the client load balancing service in response to the signaling including the access request sent by the client, the method comprises:
monitoring heartbeat event messages of all Freeswitch gateways in a service instance list every time a preset time interval passes;
and if the Freeswitch gateway which does not send the heartbeat event message exists in the service instance list within the time interval, removing the Freeswitch gateway which does not send the heartbeat event message from the service instance list until the Freeswitch gateway which does not send the heartbeat event message resends the heartbeat event message within a preset time range, and recovering ESL protocol connection of the Freeswitch gateway in the service instance list.
8. A real-time audio and video access device, characterized in that the real-time audio and video access device comprises:
the system comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring a signaling which is sent by a client and contains an access request, and the access request comprises an audio access request and/or a video access request;
the signaling forwarding module is used for sending the signaling to a target gateway based on a preset signaling channel, and sending an SIP call to the switch based on the target gateway so that the switch can access the audio and video into a media channel;
the establishing module is used for establishing the media stream of the client and the call center based on a preset media channel so as to realize audio and video communication between the client and the call center, wherein the signaling channel and the media channel are in a decoupling state.
9. A real-time audio-video access device, the real-time audio-video access device comprising: a memory, a processor and a program stored on the memory for implementing the real-time audio video access method,
the memory is used for storing a program for realizing a real-time audio and video access method;
the processor is configured to execute a program for implementing the real-time audio/video access method to implement the steps of the real-time audio/video access method according to any one of claims 1 to 7.
10. A storage medium, wherein a program for implementing a real-time audio-video access method is stored on the storage medium, and the program for implementing the real-time audio-video access method is executed by a processor to implement the steps of the real-time audio-video access method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311832767.6A CN117812047A (en) | 2023-12-27 | 2023-12-27 | Real-time audio and video access method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311832767.6A CN117812047A (en) | 2023-12-27 | 2023-12-27 | Real-time audio and video access method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117812047A true CN117812047A (en) | 2024-04-02 |
Family
ID=90431123
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311832767.6A Pending CN117812047A (en) | 2023-12-27 | 2023-12-27 | Real-time audio and video access method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117812047A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118337623A (en) * | 2024-06-12 | 2024-07-12 | 成都优卡数信信息科技有限公司 | Voice service function updating method, system and SIP server |
| CN119603275A (en) * | 2024-11-04 | 2025-03-11 | 招商银行股份有限公司 | Human-machine collaborative outbound calling method, system, electronic device and storage medium |
| CN119629176A (en) * | 2024-10-30 | 2025-03-14 | 招商银行股份有限公司 | FreeSWITCH cluster load balancing method, load balancer and system |
-
2023
- 2023-12-27 CN CN202311832767.6A patent/CN117812047A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118337623A (en) * | 2024-06-12 | 2024-07-12 | 成都优卡数信信息科技有限公司 | Voice service function updating method, system and SIP server |
| CN119629176A (en) * | 2024-10-30 | 2025-03-14 | 招商银行股份有限公司 | FreeSWITCH cluster load balancing method, load balancer and system |
| CN119629176B (en) * | 2024-10-30 | 2025-10-28 | 招商银行股份有限公司 | FreeSWITCH cluster load balancing method, load balancer and system |
| CN119603275A (en) * | 2024-11-04 | 2025-03-11 | 招商银行股份有限公司 | Human-machine collaborative outbound calling method, system, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN117812047A (en) | Real-time audio and video access method, device, equipment and storage medium | |
| EP4243391B1 (en) | Method for omni-channel notification and selection | |
| US7796520B2 (en) | System and methods for announcing and locating services in a distributed peer-to-peer network | |
| US8041656B2 (en) | Method and apparatus for leveraging end user terminals in self-learning networks | |
| US8345556B2 (en) | Congestion control system, service edge node, guidance server, congestion control method, program therefor, and recording medium recorded therewith | |
| US7965706B2 (en) | Communication control apparatus | |
| RU2493665C1 (en) | Method and system for subscription service implementation in ims network | |
| US8731181B2 (en) | Computer telephony integration device and resource management method and incoming call control method | |
| KR100908535B1 (en) | How to realize a service convergence structure | |
| JP2004529552A (en) | Optimization of voice over IP priority and bandwidth requirements | |
| JP4944415B2 (en) | COMMUNICATION SYSTEM, PRESENCE SERVER, AND COMMUNICATION METHOD USED FOR THEM | |
| WO2012062052A1 (en) | Method and system for queue processing based on call center | |
| US20070041564A1 (en) | System and method for the establishment of a connection between a contact requester and a communication center | |
| EP3941029B1 (en) | Voice communication system and redundancy method for call control server | |
| US9172581B2 (en) | Communication system, datacenter apparatus, and control method used in datacenter apparatus | |
| JP4574581B2 (en) | Communication support system, communication support method, communication support program, and communication terminal | |
| CN103947161B (en) | For configuring the method and apparatus that the service of mobile subscriber is arranged | |
| KR20050068108A (en) | Conversion system and method for multimedia data in multimedia messaging services | |
| JP4485885B2 (en) | Emergency call transmission system and emergency call transmission method | |
| WO2006034563A1 (en) | System and methods for announcing and locating services in a distributed peer-to-peer network | |
| JP6870443B2 (en) | IP phone network system, parent gateway, and child gateway | |
| JP4901161B2 (en) | Session control system and computer program | |
| US8526423B2 (en) | Method and device for managing personal communications of at least one user | |
| US9014675B1 (en) | Mobile network presence service | |
| JP2008104232A (en) | Communication control device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |