CN111131747B - Method and device for determining data channel state, electronic equipment and storage medium - Google Patents

Abstract

The present application discloses a method, device, electronic device and storage medium for determining the state of a data channel. The method is applied to a data channel detection system that is communicatively connected to a main control device, and the main control device is also communicatively connected to multiple terminals. ; The method includes: when it is detected that the speaking terminal is switched in the currently taken over video conference, sending a first channel information acquisition signaling to the main control device to acquire the first local channel corresponding to the switched speaking terminal information, and the second local channel information corresponding to the target terminal; send the second channel information acquisition signaling to the main control device to acquire the server channel information and conference member information corresponding to the target terminal; the second local channel information Compare with server channel information and conference member information respectively; determine the state of the data channel used for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result.

Description

Method, apparatus, electronic device and storage medium for determining data channel status

technical field

The present application relates to the technical field of data channel detection, and in particular, to a method, apparatus, electronic device and storage medium for determining the state of a data channel.

Background technique

During the video networking conference, after the terminal speaking in the video networking conference is switched, some terminals cannot obtain the audio and video data collected by the switched terminal, but it is currently impossible to know whether all the participants are correct. After receiving the video and audio services of the speaker, the service recovery cannot be performed in time, so that the normal operation of the entire video networking conference cannot be guaranteed.

SUMMARY OF THE INVENTION

In view of the above problems, the embodiments of the present application are proposed to provide a method, apparatus, electronic device, and storage medium for determining a data channel state that overcome the above problems or at least partially solve the above problems.

In a first aspect, an embodiment of the present application provides a method for determining the state of a data channel, and the method is applied to a data channel detection system that is communicatively connected to a main control device, and the main control device is also communicatively connected to a plurality of terminals; The methods described include:

When it is detected that the speaking terminal is switched in the currently taken over video conference, the first channel information acquisition signaling is sent to the main control device, and the main control device is configured to respond to the first channel information acquisition signaling, from the acquiring the first local channel information corresponding to the switched speaking terminal from the switched speaking terminal, and acquiring the second local channel information corresponding to the target terminal from the target terminal participating in the video conference;

Receive the first local channel information and the second local channel information returned by the main control device, and send the second channel information acquisition signaling to the main control device; the main control device is used to respond to the the second channel information acquisition signaling, to acquire server channel information and conference member information corresponding to the target terminal from the main control device;

Comparing the second local channel information with the server channel information and the conference member information, respectively, to obtain a comparison result;

According to the first local channel information and the comparison result, the state of the data channel used for data transmission between the target terminal and the switched speaking terminal is determined.

In the second aspect, the embodiments of the present application provide another method for determining the state of a data channel, so as to implement the method on the main control device side. The control device is also connected to a plurality of terminals in communication, and the method includes:

Receive the first channel information acquisition signaling sent by the data channel detection system, where the first channel information acquisition signaling is sent by the data channel detection system when it detects that the speaking terminal is switched in the currently taken over video conference;

In response to the first channel information acquisition signaling, acquire the first local channel information corresponding to the switched speaking terminal from the switched speaking terminal, and acquire the first local channel information from the target terminal participating in the video conference second local channel information corresponding to the target terminal;

sending the first local channel information and the second local channel information to the data channel detection system, and receiving the second channel information acquisition signaling sent by the data channel detection system;

In response to the second channel information acquisition signaling, acquire server channel information and conference member information corresponding to the target terminal from the main control device;

Sending the server channel information and the conference member information to the data channel detection system, where the data channel detection system is configured to associate the second local channel information with the server channel information and the conference member information respectively Perform a comparison to obtain a comparison result, and determine the state of the data channel used for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result .

In a third aspect, an embodiment of the present application provides an apparatus for determining the state of a data channel, so as to realize the method for determining the state of a data channel described in the first aspect above, and the apparatus is applied to the detection of a data channel that is communicatively connected to a master control device system, the main control device is also connected to a plurality of terminals in communication; the device includes:

The first channel information acquisition signaling sending module is used to send the first channel information acquisition signaling to the main control device when it is detected that the speaking terminal is switched in the currently taken over video conference, and the main control device is used to respond Based on the first channel information acquisition signaling, the first local channel information corresponding to the switched speaking terminal is acquired from the switched speaking terminal, and the first local channel information corresponding to the switched speaking terminal is acquired from the target terminal participating in the video conference. the second local channel information corresponding to the target terminal;

a local channel information acquisition module, configured to receive the first local channel information and the second local channel information returned by the main control device;

The second channel information acquisition signaling sending module is configured to send the second channel information acquisition signaling to the main control device; the main control device is used to respond to the second channel information acquisition signaling, from the main control device Obtain server channel information and conference member information corresponding to the target terminal on the control device;

an information comparison module, configured to compare the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result;

A state determination module, configured to determine the state of a data channel used for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result.

In a fourth aspect, an embodiment of the present application provides another apparatus for determining the state of a data channel to implement the method for determining the state of a data channel described in the second aspect above. The main control device is also connected to a plurality of terminals in communication, and the device includes:

The first channel information acquisition signaling receiving module is used to receive the first channel information acquisition signaling sent by the data channel detection system, and the first channel information acquisition signaling is currently taken over by the data channel detection system. Sent when it is detected that the speaking terminal is switched during the conference;

The local channel information acquisition module is configured to acquire the first local channel information corresponding to the switched speaking terminal from the switched speaking terminal in response to the first channel information acquisition signaling, and obtain the first local channel information from the participating obtaining the second local channel information corresponding to the target terminal on the target terminal of the video conference;

a local channel information sending module, configured to send the first local channel information and the second local channel information to the data channel detection system, and receive the second channel information acquisition signaling sent by the data channel detection system;

The second channel information acquisition signaling response module is configured to acquire the server channel information and conference member information corresponding to the target terminal from the main control device in response to the second channel information acquisition signaling;

A conference information sending module, configured to send the server channel information and the conference member information to the data channel detection system, and the data channel detection system is configured to send the second local channel information to the server channel respectively Information and the conference member information are compared to obtain a comparison result, and according to the first local channel information and the comparison result, determine the communication between the target terminal and the switched speaking terminal. Status of the data channel for data transfer.

In a fifth aspect, embodiments of the present application provide an electronic device, including: one or more processors; and one or more machine-readable media on which instructions are stored, when the one or more processors When executed, the apparatus is caused to execute the method for determining a data channel status described in the first aspect or the second aspect.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program stored in the storage medium enables a processor to execute the method for determining a data channel state described in the first aspect or the second aspect.

The embodiments of the present application include the following advantages:

In this embodiment of the present application, when the speaking terminal is switched, the first local channel information corresponding to the speaking terminal, and the second local channel information, server channel information and conference member information corresponding to the target terminal participating in the video conference can be obtained, and The second local channel information is compared with the server channel information and the conference member information respectively, and a comparison result is obtained, so that the communication between the target terminal and the switched speaking terminal can be determined according to the comparison result and the first local channel information. Status of the data channel. In this way, it is possible to determine whether each target terminal participating in the video conference can view the audio and video data of the switched speaking terminal through the status of the data channel, so that the staff can target the abnormal status of the data channel. The data channel is repaired in order to maintain the normal progress of the video network conference.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments of the present application. Obviously, the drawings in the following description are only some embodiments of the present application. , for those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative labor.

Fig. 1 is the networking schematic diagram of a kind of video networking of the present application;

2 is a schematic diagram of the hardware structure of a node server of the present application;

3 is a schematic diagram of the hardware structure of an access switch of the present application;

Fig. 4 is the hardware structure schematic diagram of a kind of Ethernet protocol conversion gateway of the present application;

5 is a communication environment diagram of a method for determining a data channel state of the present application;

6 is a flow chart of steps of a method for determining a data channel state of the present application;

7 is a schematic diagram of converting meeting member information in a method for determining a data channel state of the present application;

8 is a schematic diagram of the overall flow of the method for determining a data channel state of the present application;

9 is a flow chart of steps of another method for determining a data channel state of the present application;

10 is a schematic diagram of a framework of an apparatus for determining a data channel state according to the present application;

FIG. 11 is a schematic diagram of the framework of another apparatus for determining the status of a data channel according to the present application.

Detailed ways

In order to make the above objects, features and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and specific embodiments.

Video networking is an important milestone in network development. It is a real-time network that can realize real-time transmission of high-definition video, and push many Internet applications to high-definition video, high-definition face-to-face.

Video networking adopts real-time high-definition video switching technology, which can provide required services on a network platform, such as high-definition video conferencing, video surveillance, intelligent monitoring and analysis, emergency command, digital broadcast TV, delayed TV, online teaching, live broadcast , VOD on demand, TV mail, personal recording (PVR), intranet (self-organized) channels, intelligent video broadcast control, information release and other dozens of video, voice, picture, text, communication, data and other services are all integrated into one The system platform can realize high-definition video playback through TV or computer.

In order to make those skilled in the art better understand the embodiments of the present application, video networking is introduced as follows:

Some of the technologies used in the Internet of Things are as follows:

Network Technology

The network technology innovation of the video network improves the traditional Ethernet (Ethernet) to face the potential huge first video traffic on the network. Different from simple network packet switching (Packet Switching) or network circuit switching (Circuit Switching), the Internet of View technology adopts Packet Switching to meet the requirements of Streaming. The Internet of Things technology has the flexibility, simplicity and low price of packet switching, and at the same time has the quality and security assurance of circuit switching, and realizes the entire network of switched virtual circuits and seamless connection of data formats.

Switching Technology

The Internet of Things adopts the asynchronous and packet switching advantages of Ethernet, and eliminates the defects of Ethernet under the premise of full compatibility. User data does not need any format conversion in the whole network. Video networking is a more advanced form of Ethernet. It is a real-time switching platform that can realize the real-time transmission of large-scale high-definition video across the entire network that cannot be achieved by the Internet, and push many network video applications to high-definition and unified.

Server Technology

The server technology on the video networking and unified video platform is different from the server in the traditional sense. Its streaming media transmission is based on connection-oriented, and its data processing capability has nothing to do with traffic and communication time. A single network layer can contain information. command and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than data processing, and the efficiency is greatly improved by more than 100 times compared to traditional servers.

Storage Technology

The ultra-high-speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content of large capacity and large flow, and maps the program information in the server signaling to the specific hard disk space, and the media content no longer passes through the server. , it is directly delivered to the user terminal in an instant, and the general waiting time of the user is less than 0.2 seconds. The optimized sector distribution greatly reduces the mechanical movement of the hard disk head seeking, and the resource consumption only accounts for 20% of the same level of IP Internet, but it generates 3 times more concurrent traffic than traditional hard disk arrays, and the overall efficiency is increased by more than 10 times.

Network Security Technology

The structural design of the Internet of Things completely eliminates the network security problems that plague the Internet through separate licensing for each service and complete isolation of equipment and user data. Generally, anti-virus programs and firewalls are not required, and hackers and viruses are prevented from attacking. , to provide users with a structured worry-free safety network.

Service Innovation Technology

The unified video platform integrates services and transmission. Whether it is a single user, a private network user, or the aggregate of a network, it is just an automatic connection. User terminals, set-top boxes or PCs are directly connected to the unified video platform to obtain a variety of multimedia video services in various forms. The unified video platform adopts the "recipe-style" table matching mode to replace the traditional complex application programming. It can realize complex applications with very little code, and realize "unlimited" new business innovation.

The networking of the Internet of Things is as follows:

The Internet of Things is a centralized control network structure. The network can be a tree network, a star network, a ring network, etc., but on this basis, a centralized control node is required in the network to control the entire network.

As shown in Figure 1, the Internet of Things is divided into two parts: the access network and the metropolitan area network.

The equipment in the access network part can be mainly divided into three categories: node server, access switch, and terminal (including various set-top boxes, coding boards, memory, etc.). The node server is connected to the access switch, and the access switch can be connected to multiple terminals and can be connected to Ethernet.

The node server is a node in the access network that functions as a centralized control, and can control access switches and terminals. The node server can be directly connected to the access switch, or it can be directly connected to the terminal.

Similarly, the equipment in the metropolitan area network can also be divided into three categories: metropolitan area server, node switch, and node server. The metropolitan area server is connected with the node switch, and the node switch can be connected with multiple node servers.

The node server is the node server of the access network part, that is, the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node with centralized control function in the metropolitan area network, which can control the node switch and the node server. The metropolitan area server can be directly connected to the node switch or directly connected to the node server.

It can be seen that the entire VisionLink network is a network structure controlled by layers and centralized, and the network controlled by the node server and the metro server can be tree, star, ring and other structures.

Figuratively, the access network part can form a unified video platform (the part in the dashed circle), and multiple unified video platforms can form a video network; each unified video platform can be interconnected through the metro and wide-area video networks.

Classification of Internet-connected devices

1.1 The devices in the Internet of Video of the embodiments of the present application can be mainly divided into three categories: servers, switches (including Ethernet protocol conversion gateways), and terminals (including various set-top boxes, coding boards, memories, etc.). As a whole, the Internet of Views can be divided into a metropolitan area network (or a national network, a global network, etc.) and an access network.

1.2 The equipment in the access network part can be mainly divided into three categories: node server, access switch (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, coding boards, memory, etc.).

The specific hardware structure of each access network device is as follows:

Node server:

As shown in FIG. 2 , it mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

Among them, the incoming packets from the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 for the incoming packets, thereby obtaining the packet guidance information; and according to The steering information of the packet stores the packet into the queue of the corresponding packet buffer 206; if the queue of the packet buffer 206 is close to full, it is discarded; the switching engine module 202 polls all the packet buffer queues, and forwards if the following conditions are met: 1) The port sending buffer is not full; 2) The queue packet counter is greater than zero. The disk array module 204 mainly realizes the control of the hard disk, including operations such as initialization, reading and writing of the hard disk; (including the downlink protocol packet address table, the uplink protocol packet address table, and the data packet address table) configuration, and the configuration of the disk array module 204.

Access switch:

As shown in FIG. 3 , it mainly includes a network interface module (downlink network interface module 301, uplink network interface module 302), a switching engine module 303 and a CPU module 304;

Wherein, the incoming packet (uplink data) from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the destination address (DA), source address (SA), data packet type and packet length of the packet meet the requirements, if If it matches, assign the corresponding stream identifier (stream-id) and enter the switching engine module 303, otherwise discard it; the incoming packet (downlink data) from the upstream network interface module 302 enters the switching engine module 303; the incoming data packet from the CPU module 304 Enter the switching engine module 303; the switching engine module 303 performs the operation of looking up the address table 306 for the incoming packet, thereby obtaining the orientation information of the packet; if the packet entering the switching engine module 303 is from the downlink network interface to the uplink network interface, then combine The stream identifier (stream-id) stores the packet into the queue of the corresponding packet buffer 307; if the queue of the packet buffer 307 is close to full, it is discarded; if the packet entering the switching engine module 303 is not the downstream network interface, it is upstream If the data packet goes to the network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the direction information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues, which can include two situations:

If the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) The port sending buffer is not full; 2) The queue packet counter is greater than zero; 3) The token generated by the rate control module is obtained ;

If the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the sending buffer of the port is not full; 2) the packet counter of the queue is greater than zero.

The rate control module 308 is configured by the CPU module 304, and generates tokens for the packet buffer queues going from all downlink network interfaces to uplink network interfaces at programmable intervals, so as to control the rate of uplink forwarding.

The CPU module 304 is mainly responsible for the protocol processing with the node server, the configuration of the address table 306 , and the configuration of the rate control module 308 .

Ethernet protocol conversion gateway:

As shown in Figure 4, it mainly includes a network interface module (downlink network interface module 401, uplink network interface module 402), switching engine module 403, CPU module 404, packet detection module 405, rate control module 408, address table 406, packet The buffer 407 and the MAC adding module 409 and the MAC deleting module 410.

Among them, the data packets coming from the downlink network interface module 401 enter the packet detection module 405; the packet detection module 405 detects the Ethernet MAC DA, Ethernet MAC SA, Ethernet length or frame type, video network destination address DA, video network Whether the source address SA, network data packet type and packet length meet the requirements, if so, assign a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts the MAC DA, MAC SA, length or frametype ( 2byte), and enter the corresponding receive buffer, otherwise discard;

The downlink network interface module 401 detects the transmission buffer of the port, and if there is a packet, learns the Ethernet MAC DA of the corresponding terminal according to the network destination address DA of the packet, and adds the Ethernet MAC DA of the terminal, the MACSA of the Ethernet protocol conversion gateway, Ethernet length or frame type, and send.

The functions of other modules in the Ethernet protocol conversion gateway are similar to that of the access switch.

terminal:

Mainly include network interface module, service processing module and CPU module; for example, set-top box mainly includes network interface module, video and audio codec engine module, CPU module; encoding board mainly includes network interface module, video and audio encoding engine module, CPU module; memory It mainly includes network interface module, CPU module and disk array module.

1.3 The equipment in the metropolitan area network can be mainly divided into two categories: node server, node switch, and metropolitan area server. Among them, the node switch mainly includes a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly includes a network interface module, a switching engine module and a CPU module.

2. Definition of Internet Data Packets

2.1 Definition of Access Network Data Packets

The data packet of the access network mainly includes the following parts: destination address (DA), source address (SA), reserved bytes, payload (PDU), and CRC.

As shown in the table below, the data packets of the access network mainly include the following parts:

DA SA Reserved Payload CRC

in:

The destination address (DA) consists of 8 bytes (byte), the first byte indicates the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are up to 256 possibilities, The second to sixth bytes are the metropolitan area network address, and the seventh and eighth bytes are the access network address;

The source address (SA) is also composed of 8 bytes (byte), and the definition is the same as the destination address (DA);

Reserved bytes consist of 2 bytes;

The payload part has different lengths according to different types of datagrams. If it is a variety of protocol packets, it is 64 bytes. If it is a single multicast data packet, it is 32+1024=1056 bytes. Of course, it is not limited to Above 2 kinds;

The CRC consists of 4 bytes, and its calculation method follows the standard Ethernet CRC algorithm.

2.2 MAN Data Packet Definition

The topology of the metropolitan area network is a graph. There may be two or even more than two connections between two devices, that is, there may be more than two connections between node switches and node servers, between node switches and node switches, and between node switches and node servers. kind of connection. However, the metropolitan area network address of the metropolitan area network device is unique. In order to accurately describe the connection relationship between the metropolitan area network devices, a parameter: label is introduced in this embodiment of the present application to uniquely describe a metropolitan area network device.

The definition of the label in this manual is similar to the definition of the MPLS (Multi-Protocol Label Switch, Multi-Protocol Label Switch) label. Assuming that there are two connections between device A and device B, the data packets from device A to device B have 2 labels, packets from device B to device A also have 2 labels. Labels are divided into incoming labels and outgoing labels. Assuming that the label (incoming label) of the data packet entering device A is 0x0000, the label (outgoing label) of the data packet when it leaves device A may become 0x0001. The network access process of the metropolitan area network is a network access process under centralized control, which means that the address allocation and label allocation of the metropolitan area network are dominated by the metropolitan area server, and the node switches and node servers are all passively executed. Different from MPLS label assignment, MPLS label assignment is the result of mutual negotiation between switches and servers.

As shown in the table below, the data packets of the metropolitan area network mainly include the following parts:

DA SA Reserved Label Payload CRC

Namely, destination address (DA), source address (SA), reserved bytes (Reserved), label, payload (PDU), and CRC. Among them, the format of the label can refer to the following definition: the label is 32 bits, of which the upper 16 bits are reserved, and only the lower 16 bits are used, and its position is between the reserved bytes of the data packet and the payload.

Based on the above characteristics of the video network, when an audio and video conference is performed in the video network, the operator in the video network will manage the audio and video conference. For example, during the conference, the speaker will be switched, the conference chair terminal will be set, and the conference will be opened and closed. Due to the need to manage audio and video conferences, during the conference, the main control device and sub-control device in the video network will also change the audio and video data with the change of the speaker or the change of the chairman terminal. make changes.

Therefore, in the process of the audio and video conference, after the speaker is switched, the terminal participating in the conference cannot correctly receive the audio and video data sent by the switched speaking terminal. Based on this, the applicant proposes the technical idea of the embodiment of the present application: after switching the speaker, the local channel information on the participating terminal, the local channel information of the speaking terminal, the conference member information on the main control device and the main control device are obtained respectively. Channel information on the device, and compare the above information to determine whether the participating terminal can correctly receive the audio and video data of the speaking terminal.

Specifically, a method for determining the state of a data channel of the present application will be described in detail through the following embodiments.

Referring to FIG. 5 , a communication environment diagram to which a method for determining a data channel status according to an embodiment of the present application is shown is shown. As shown in FIG. 5 , it includes a data channel detection system 501 and a 64-bit autonomous service system 502 . The bit autonomous service system 502 may include a main control device, a plurality of sub-control devices (respectively, sub-control device 1 to sub-control device n), and a plurality of terminals (respectively, terminal a to terminal n 3), wherein the data channel detection system 501 is connected in communication with the main control device, and the main control device is in communication connection with a plurality of sub-control devices respectively, that is, one sub-control device can be connected with a plurality of terminals. In this way, the main control device can communicate with multiple terminals via the sub-control devices.

Specifically, the main control device is the core device of the entire 64-bit autonomous service system 502, and may have an Internet port and a viewport port. The Internet port can receive business instructions (such as starting a conference, stopping a conference, etc.), and the main control device parses Internet packets after parsing. After obtaining the business instructions, send the relevant business instructions to the video network through the video network port. The sub-control device sends and receives business data in the video network. A border router is also connected between the main control device and the sub-control device, and the border router can be used as a bridge between the main control device and the sub-control device. The terminal can be a computer, a camera monitoring device, a video network terminal device, etc., which is not limited here.

Among them, the data channel detection system can run on the computer, and can communicate with the main control server for video networking services. In practice, the user can log in to the data channel detection system to take over the video conference and detect the data channel.

Referring to FIG. 6 , there is shown a flow chart of steps of a method for determining the status of a data channel according to an embodiment of the present application, and the method can be applied to a data channel detection system that is communicatively connected to a master control device. As shown in Figure 6, the method may specifically include the following steps:

Step S601, when it is detected that the speaking terminal is switched in the currently taken over video conference, a first channel information acquisition signaling is sent to the main control device.

Wherein, the main control device is configured to acquire the first local channel information corresponding to the switched speaking terminal from the switched speaking terminal in response to the first channel information acquisition signaling, and obtain the first local channel information from the switched speaking terminal The target terminal of the video conference acquires the second local channel information corresponding to the target terminal.

In this embodiment of the present application, the data channel detection system may perform a TCP (Transmission Control Protocol, Transmission Control Protocol) communication connection with the main control device, and specifically, a TCP socket (webpage socket) may be established between the data channel detection system and the main control device word) communication connection. In practice, the video conference on the main control device can be taken over by the data channel detection system. After the data channel detection system takes over the video conference, the data channel detection system can control the video conference and detect the status of the video conference.

Specifically, when the data channel detection system detects the operation of switching the speaking terminal, it can be determined that the speaking terminal is switched, and then the first channel information acquisition signaling can be generated, and the first channel information acquisition signaling can include the switched terminal. The speaking terminal identifier of the speaking terminal and the target terminal identifier of the target terminal participating in the video conference. Among them, the target terminal and the speaking terminal are not the same terminal. In practice, if there are more than two participating terminals in the video conference, in addition to the speaking terminal currently speaking, there may also be more than one participating terminal. , the method described in this application may be performed on more than one conference participant terminal, that is, channel detection is performed on each conference participant terminal.

After the first channel information acquisition signaling is sent to the main control device, the main control device can determine the switched speaking terminal according to the speaking terminal identifier, the target terminal according to the target terminal identifier, and the The first sub-control device connected to the terminal and the second sub-control device connected to the target terminal can respectively send the first channel information acquisition signaling to the switched speaking terminal via the first sub-control device, and then via the second sub-control device. The control device sends the first channel information acquisition signaling to the target terminal. Further, the first local channel information can be acquired from the switched speaking terminal, and the second local channel information can be acquired from the switched target terminal.

In this embodiment of the present application, the first local channel information may refer to the channel information of the audio and video data transmission channel recorded by the speaker terminal itself after being switched, and the second local channel information may refer to the audio and video data recorded by the target terminal itself. Channel information of the channel for data transmission.

Optionally, the first local channel information may include first data sink information, first data source information and a multicast address, and the second local channel information may include second data sink information, second data source information and a multicast address. Among them, the data source information represents the encoding channel information of the terminal, and each encoding channel corresponds to a multicast address. The multicast address refers to the multicast address that the master device automatically assigns to each encoding and decoding channel of the device after successfully joining the conference. Multicast addresses are unique in the video network. The data sink information indicates the decoding channel information of the terminal. The decoding channel refers to the channel that decodes the received audio and video data. Therefore, a decoding channel can also correspond to a multicast address, so that the code corresponding to the multicast address can be encoded. The audio and video data uploaded by the channel are decoded.

The following uses Table 1-1 as an example to describe the local channel information of the terminal:

70001 in Table 1-1 can be the terminal identifier of the terminal. In Table 1-1, the terminal of 70001 has 5 encoding channels and 8 decoding channels. When sending audio and video data at 70001, any two encoding channels can be used to encode audio and video respectively, and when receiving audio and video data , you can watch audio and video data through any two decoding channels in the 8 decoding channels. For example, you can use No. 0 encoding channel for video encoding, use No. 1 encoding channel for audio encoding, and use No. 1 decoding channel to watch video data. Since each encoding channel corresponds to a multicast address, No. 0 encoding channel can correspond to a group The multicast address is 10, and the coded channel No. 1 corresponds to the multicast address 11. Assuming that the terminal of 70001 is currently the speaking terminal, when watching audio and video data, the decoding channel No. 1 of the terminal 70001 corresponds to the multicast address 11 (to watch its own video), and the decoding channel No. 0 may not correspond to any multicast address (ie No need to listen to your own audio).

Table 1-1

Taking Table 1-2 as an example, the local channel information of the terminal is described. 70002 in Table 1-2 may be the terminal identifier of the terminal. In Table 1-2, the 70002 terminal has 5 encoding channels and 8 decoding channels. It can encode video through encoding channel 0, and use encoding channel 1 for audio encoding. Encoding channel 0 can correspond to multicast addresses 15. The coded channel No. 1 corresponds to the multicast address 16. The decoding channel No. 0 corresponds to the multicast address 10, and the decoding channel No. 1 corresponds to the multicast address 11. Because the multicast address 10 corresponds to the encoding channel No. 0 of the 70001 terminal, the multicast address 11 corresponds to the 70001 terminal. Corresponding to the encoding channel No. 1 of the terminal, it means that the terminal 70002 can watch the audio data of the terminal No. 70001 through the decoding channel No. 0, and watch the video data of the terminal No. 70001 through the decoding channel No. 1.

Table 1-2

Step S602: Receive the first local channel information and the second local channel information returned by the main control device, and send the second channel information acquisition signaling to the main control device.

The main control device is configured to acquire, from the main control device, server channel information and conference member information corresponding to the target terminal in response to the second channel information acquisition signaling.

After receiving the first local channel information and the second local channel information, the current local channel information of the speaking terminal after switching and the local channel information of the target terminal itself can be determined. Since the video conferencing needs to be set and managed by the conference control platform on the main control device, for example, after switching the speaking terminal, the main control device needs to set the source terminal of the audio and video currently watched by other participating terminals as the switched speech terminal. For example, when switching the speaking terminal to 70001, the main control device sets the source terminal of the audio and video data currently watched by the terminal 70002 to 70001, so that the terminal 70002 can watch the audio and video of the terminal 70001.

Therefore, only according to the first local channel information and the second local channel information, the communication state of the entire communication link from the switched speaking terminal to the target terminal cannot be determined. In the embodiment of the present application, after receiving the first local channel information and the second local channel information, the data channel detection system may generate the second channel information acquisition signaling, so as to acquire the server channel information and conference members corresponding to the target terminal information. The server channel information can represent the channel status of the audio and video data to be watched by the target terminal currently set by the main control device, and the conference member information can represent the current role status of the target terminal set by the main control device in the video conference.

During specific implementation, the second channel information acquisition signaling may include the local conference identifier, the global conference identifier and the target terminal identifier of the video conference. Wherein, the global conference identifier can uniquely identify the video conference within the All Vision Network. The local conference ID can identify the video conference in the autonomous video networking system, so that the main control device can determine the video conference of the present application from the multiple conferences controlled by itself according to the local conference ID, and then the main control device can determine the video conference. In the video conference, the server channel information and conference member information corresponding to the target terminal recorded by itself are returned to the data channel detection system.

The server channel information may be the information shown in Table 1-1 or Table 1-2.

The following uses Table 1-3 as an example to describe the conference member information:

70002 in Table 1-3 is the terminal identifier of the terminal, and the channel number refers to the decoding channel number of 70002, which corresponds to the data sink information in Table 1-1 above. The label of the source terminal for viewing audio and video data in the video conference. For example, if there are only terminals 70001 and 70002 in the video conference, the subscript 0 for the terminal 70001 and the subscript 1 for the terminal 70002 can be set in the video conference. The channel number of the watched member refers to the encoded channel number of the terminal being watched, which corresponds to the data source information in 1-1 above. Then this table 1-3 indicates that the decoding channel 0 of terminal 70002 set by the main control device needs to watch the audio encoded by the terminal with subscript 0 through channel 0, and the decoding channel 1 needs to watch the terminal with subscript 0 through channel 1. Encoding channel encoded video.

Table 1-3

It should be noted that the subscript in Table 1-3 is -1, which indicates that the channel does not watch audio and video data of any terminal.

Step S603: Compare the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result.

In this embodiment of the present application, since the second local channel information represents the current data channel information recorded by the target terminal itself, the server channel information and the conference member information represent the information that the main control device performs conference settings on the target terminal in the video conference , the communication state of the entire communication link from the switched speaking terminal to the target terminal can be determined according to the above three pieces of information.

Specifically, the three pieces of information can be compared in pairs to determine whether the source terminals of the audio and video data currently watched by the target terminal represented by the three pieces of information are all the same terminal.

Optionally, in an optional embodiment, the step S603 may specifically include the following steps:

Step S31: Obtain a first multicast source address from the second local channel information, and obtain a second multicast source address from the server channel information.

In practice, when the target terminal receives audio and video data, the audio and video data may include a source address, where the source address represents the address of the source terminal of the audio and video data. In this embodiment of the present application, the source address may be carried in the second local channel information as the first multicast source address, or may be carried in the server channel information as the second multicast source address. In this way, the data channel detection system can parse out the first multicast source address from the information. Similarly, the second multicast source address can also be obtained from the server channel information.

As shown in Table 1-1, the first multicast source address is 11, and as shown in Table 1-2, the first multicast source addresses are 10 and 11. Among them, 10 is the multicast source address of audio data, and 11 is the multicast source address of video data.

Step S32: Acquire the watched terminal identifier from the conference member information, and determine a third multicast source address corresponding to the watched terminal identifier.

In practice, the watched terminal identifier may refer to the subscript of the watched terminal in the video conference, as shown in Table 1-3, the subscript of the watched member in the conference in the table is the watched terminal identifier. Since the members of the conference represent the role of the target terminal set by the conference control system on the main control device in the conference, after obtaining the terminal identifier to be watched, the terminal corresponding to the terminal identifier to be watched can be determined, and the terminal to be watched can be identified by The channel number of the terminal determines the multicast source address currently used by the terminal, that is, the third multicast source address.

For example, as shown in Table 1-3, if the member to be watched is a terminal whose subscript is 0 in the conference, it corresponds to terminal 70001, and the encoding channel numbers of the terminal 70001 are 0 and 1, so the number 0 code can be determined The multicast source address corresponding to the channel is 10, the multicast source address corresponding to the No. 1 encoded channel is 11, and the third multicast source addresses are 10 and 11.

Optionally, in practice, the conference member information can be converted into conference channel information in the same format as the server channel information, as shown in FIG. 7 , which shows that the conference member information shown in Table 1-3 is converted into Table 1. A comparison chart of the conference channel information shown in -4. As shown in FIG. 7 , the third multicast source address can be determined according to the converted conference channel information. In practice, what is recorded in the conference member information is the information that a terminal watches audio and video data, which indicates the relationship between the target terminal and other terminals watching and being watched in the video conference. After the conference member information is converted, the conference member information can be converted into conference channel information of the audio and video data currently being watched by the target terminal, and the conference channel information can include the multicast address of the watched terminal.

Step S33: Compare the first multicast source address with the second multicast source address and the third multicast source address respectively, to obtain a comparison result.

In practice, comparing the first multicast source address with the second multicast source address and the third multicast source address respectively means: comparing the first multicast source address with the second multicast source address. Consistency comparison is performed, and the first multicast source address and the third multicast source address are compared for consistency, and then a final comparison result is obtained according to the results of the two consistency comparisons.

For example, taking the target terminal as the 70002 terminal shown in Table 1-2 as an example, the first multicast source addresses are 10 and 11, and the third multicast source address is determined from the information shown in Table 1-3. are 10 and 11; if the second multicast source address is also 10 and 11, the three multicast source addresses are the same, and it can be determined that the comparison results are consistent, representing the audio and video watched by the 70002 set on the master device. The source terminal of the data is the same as the source terminal of the audio and video data recorded by the 70002 itself. If the second multicast source address is not 10 or 11, the first multicast source address and the third multicast source address, but the second multicast source address is inconsistent with the first multicast source address, it means that the main control device The source terminal of the audio and video data watched by the 70002 set above is not the same as the source terminal of the audio and video data recorded by the 70002 itself.

Step S604, according to the first local channel information and the comparison result, determine the state of the data channel used for data transmission between the target terminal and the switched speaking terminal.

After obtaining the above comparison result, it can be determined according to the comparison result whether the source terminal of the audio and video data watched by the target terminal set on the main control device is the same terminal as the source terminal of the audio and video data recorded by the target terminal itself , according to the first local channel information, it can be determined whether the source terminal of the audio and video data watched by the target terminal is the switched speaking terminal. Furthermore, the state of the complete communication link between the target terminal and the switched speaking terminal can be comprehensively determined.

Specifically, the comparison result indicates that the source terminal of the audio and video data watched by the target terminal set on the main control device is the same terminal as the source terminal of the audio and video data recorded by the target terminal itself, and the same terminal is the same as the first terminal. When the switched speaking terminal corresponding to the local channel information is also the same terminal, it can be determined that the state of the data channel is normal; otherwise, it can be determined that the state of the data channel is abnormal.

Correspondingly, since the comparison result may be obtained by comparing the first multicast source address with the second multicast source address and the third multicast source address, the step S604 is specifically The following steps can be included:

Step S41, obtaining a local multicast source address from the first local channel information.

In practice, the local multicast source address refers to the address used by the switched speaking terminal to currently send audio and video data to other terminals in the video conference. Taking Table 1-1 as an example, if the channel currently performing audio data encoding is channel 0 and the channel performing video encoding is channel 1, the local multicast source addresses are 10 and 11, that is, terminal 70002 is currently using multicast Source addresses 10 and 11 send audio and video data.

Step S42, when the comparison result is that the first multicast source address, the second multicast source address and the third multicast source address are all the same multicast source address, and the first group When any multicast source address among the multicast source address, the second multicast source address and the third multicast source address is consistent with the local multicast source address, it is determined that the state of the data channel is normal.

In practice, when the first multicast source address, the second multicast source address, the third multicast source address and the local multicast source address are all the same multicast source address, it means that the target terminal is currently The source terminal of the watched audio and video data, the source terminal of the audio and video data currently being watched by the target terminal set by the main control device, and the switched speaking terminal are all the same terminal. Indicates that the communication link between the switched speaking terminal and the target terminal is unobstructed, and the target terminal can ensure that the audio and video data of the switched speaking terminal can be viewed normally, and the status of the data channel is determined to be normal.

Step S43, when the comparison result is that the first multicast source address, the second multicast source address and the third multicast source address are not the same multicast source address, determine the data channel The status is abnormal.

In practice, when the first multicast source address, the second multicast source address, the third multicast source address and the local multicast source address are not the same multicast source address, it means that the target terminal is currently The source terminal of the audio and video data to be watched and the source terminal of the audio and video data currently being watched by the target terminal set by the main control device are not the same terminal as the switched speaking terminal. Since it is not the same terminal, it cannot be guaranteed that the target terminal can watch the audio and video data of the switched speaking terminal, so it can be determined that the state of the data channel is abnormal.

Correspondingly, in order to prepare to locate the abnormal node when the abnormality occurs in the data channel, in an optional embodiment, in step S43, while determining that the state of the data channel is abnormal, it can also include The following steps:

Step S431 , among the first multicast source address, the second multicast source address, and the third multicast source address, determine a target multicast source address that is inconsistent with the local multicast source address.

Step S432, in the second local channel information, the server channel information and the conference member information, determine target information corresponding to the target multicast source address.

The target multicast source address is an address that is inconsistent with the local multicast source address among the first multicast source address, the second multicast source address, and the third multicast source address. Among them, if the first multicast source address is inconsistent with the local multicast source address, it means that the target terminal itself does not watch the audio and video data of the switched speaking terminal. If it is the second multicast source address or the third multicast source address If it is inconsistent with the local multicast source address, it means that the master control device has not set the switched speaking terminal as the terminal to be watched by the target terminal.

Specifically, according to the target multicast source address, in the second local channel information, server channel information and conference member information, the target information carrying the target multicast source address can be reversely determined, and the occurrence of occurrences can be located through the target information. abnormal node. The node may refer to a node that manages and sets audio and video data transmission in a video conference. For example, the main control device sets the role of the target terminal in the conference as a node, and the target terminal itself is a node.

In practice, if the target information is server channel information, it may indicate that the abnormal node is the main control device, and the specific cause of the abnormality may be an error in the setting of the server channel information of the main control device. If the target information is conference member information, it may also indicate that the abnormal node is the main control device, and the specific cause of the abnormality may be that the main control device has incorrectly set the role of the target terminal in the conference. If the target information is the second local channel information, it may indicate that an error occurs when the target terminal receives the audio and video data.

Step S433, based on the target information, generate channel abnormality information, and display the channel abnormality information.

In this embodiment of the present application, after the target information is determined, channel abnormality information including the target information may be generated, and the channel abnormality information may be displayed. In this way, the target information can be included in the abnormal channel information, so that the administrator can check and locate the abnormal node for quick repair.

During specific implementation, the abnormal information of the channel can also be reported to the conference control management personnel. Specifically, the abnormal information of the channel can be sent to the main control device, and the main control device can then send it to the conference control management personnel who are conducting the conference control, so as to facilitate the Troubleshoot and fix exceptions.

In this embodiment of the present application, when the speaking terminal is switched, the first local channel information corresponding to the speaking terminal, and the second local channel information, server channel information and conference member information corresponding to the target terminal participating in the video conference can be obtained, and the The two local channel information is compared with the server channel information and the conference member information respectively, and the comparison result is obtained, so that the data channel between the target terminal and the switched speaking terminal can be determined according to the comparison result and the first local channel information. status. In this way, it can be determined whether each target terminal participating in the video conference can normally watch the audio and video data of the switched speaking terminal through the status of the data channel, so that the staff can target the abnormal status of the data channel. The node is repaired in order to maintain the normal progress of the video network conference.

In combination with the above embodiments, in an optional example, before step S601, the step of taking over the video conference may also be included, and specifically, the following steps may be included:

Step S01 , sending a data packet for obtaining a conference list to the main control device, and the main control device is configured to obtain conference list information in response to the data packet for obtaining a conference list.

The conference list data packet is a data packet conforming to the Internet of View protocol, and the data packet may include but not limited to the following information: an operation code (operation code for obtaining the conference list), a local conference identifier, and a global conference identifier. The local conference identifier and the global conference identifier may refer to the description of the foregoing step S603.

The local conference ID and the global conference ID can represent the ID of the video conference to be taken over by the data channel detection system, then the main control device can acquire the conference list information of the video conference in response to the acquisition of the conference list data packet. It includes but is not limited to the following information: local conference ID, global conference ID, information on participating terminals, conference status information (in a conference, not in a conference, or ended), and a response result.

Step S02: Receive the conference list information returned by the main control device, and based on the conference list information, generate a conference control right acquisition signaling, where the conference control right acquisition signaling includes a conference identifier.

After receiving the conference list information, the data channel detection system can further generate the conference control right acquisition signaling according to the response result. For example, if the response result is a successful result, the conference control right acquisition signaling can be generated according to the successful result. The conference control right signaling may include a conference ID, and the conference ID may be a local conference ID or a global conference ID.

Step S03: Send the conference control right acquisition signaling to the main control device, and the main control device is used to determine the video conference corresponding to the conference identification in response to the conference control right signaling, and based on the determination The outgoing video conference generates conference control result signaling.

Step S04: Receive the conference control result signaling sent by the main control device, and take over the video conference based on the conference control result signaling.

In practice, the conference control result signaling may carry the following information: operation code (taking over the video conference), local conference ID list, global conference ID list, response result, participant attribute list, participant status list and other information. The above information can represent the information that the data channel detection system can take over the video conference.

After obtaining the conference control result signaling, the data channel detection system can successfully take over the video conference, that is, it has obtained the control authority over the video conference, and then can control the video conference, so that the data channel can be checked after switching the speaking terminal. detection.

Referring to FIG. 8 , a schematic overall flow diagram of the method for determining data channel status is shown. In FIG. 8 , the data channel detection system can take over the video conference after obtaining the conference control right result. Then, the data channel can be detected, wherein the acquisition of terminal channel information is the first channel information acquisition signaling, the terminal channel information is the first local channel information or the second local channel information, and the acquisition of terminal information on the server is Obtain the server channel information of the terminal and obtain the conference member information. Furthermore, the obtained conference member information, server terminal information on the server, and terminal channel information can be compared, so as to perform channel detection, and display the detection result on the interface.

Referring to FIG. 9, it shows a flow chart of the steps of another method for determining the status of a data channel. The communication environment of the method can be referred to as shown in FIG. 5, and the method can be applied to the communication connection with the data channel detection system. The main control device, which is also connected to a plurality of terminals in communication, as shown in Figure 9, may specifically include the following steps:

Step S901: Receive the first channel information acquisition signaling sent by the data channel detection system.

Wherein, the first channel information acquisition signaling is sent by the data channel detection system when it detects that the speaking terminal is switched in the currently taken over video conference.

In this embodiment, the main control device may receive the first channel information acquisition signaling sent by the data channel detection system through the TCP socket. The first channel information acquisition signaling may include the speaking terminal identifier of the switched speaking terminal and the target terminal identifier of the target terminal participating in the video conference.

Step S902, in response to the first channel information acquisition signaling, acquire the first local channel information corresponding to the switched speaking terminal from the switched speaking terminal, and obtain the first local channel information corresponding to the switched speaking terminal, and from the target participating in the video conference. The terminal acquires the second local channel information corresponding to the target terminal.

In this embodiment, the main control device can parse the first channel information acquisition signaling, thereby acquiring the speaking terminal identifier and the target terminal identifier, and determine the switched speaking terminal and the target terminal, and then determine the determined and switched terminal. The first sub-control device connected to the speaking terminal, and the second sub-control device connected to the target terminal. The first channel information acquisition signaling is respectively sent to the switched speaking terminal via the first sub-control device, and the first channel information acquisition signaling is sent to the target terminal via the second sub-control device.

In this way, the switched speaking terminal can return its own first local channel information to the main control device via the first sub-control device according to the first channel information acquisition signaling, and the target terminal can obtain the signaling according to the first channel information. The own second local channel information is returned to the main control device via the second sub-control device.

Step S903: Send the first local channel information and the second local channel information to the data channel detection system, and receive the second channel information acquisition signaling sent by the data channel detection system.

Step S904, in response to the second channel information acquisition signaling, acquire server channel information and conference member information corresponding to the target terminal from the main control device.

Wherein, the second channel information acquisition signaling may include the local conference identification, global conference identification and target terminal identification of the video conference, so that the main control device can parse the second channel information acquisition signaling to determine the connection with the local conference identification. The video conference corresponding to the global conference ID, and the server channel information and conference member information corresponding to the target terminal recorded by itself are returned to the data channel detection system.

Step S905: Send the server channel information and the conference member information to the data channel detection system.

Wherein, the data channel detection system is configured to compare the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result, and according to the first local channel information and The comparison result determines the state of the data channel used for data transmission between the target terminal and the switched speaking terminal.

For the specific process of the state of the data channel for data transmission in this step, reference may be made to the description of step S603 and step S604, which will not be repeated here.

In practice, before the above step S901, the following steps may be specifically included:

Step S01 ′: Receive a data packet for obtaining a conference list sent by the data channel detection system, and obtain conference list information in response to the data packet for obtaining a conference list.

The process of this step S01' may refer to the description of step S01, and the description will not be repeated here.

Step S02', sending the conference list information to the data channel detection system, and receiving the conference control right acquisition signaling sent by the data channel detection system based on the conference list information, the conference control right acquisition signaling Include the meeting logo.

For the process of step S02', reference may be made to the description of step S02, and the description will not be repeated here.

Step S03', in response to the obtaining the conference control right signaling, determine a video conference corresponding to the conference identifier, and generate conference control result signaling based on the determined video conference.

For the process of step S03', reference may be made to the description of step S03, and the description will not be repeated here.

Step S04', sending the conference control result signaling to the data channel detection system, and the data channel detection system is configured to take over the video conference based on the conference control result signaling.

The process of this step S04' may refer to the description of step S04, and the description will not be repeated here.

In this embodiment of the present application, when the speaking terminal is switched, the conference control device may acquire the first local channel information corresponding to the speaking terminal according to the first channel information acquisition signaling and the second channel information acquisition signaling sent by the data channel detection system , and the second local channel information, server channel information and conference member information corresponding to the target terminal participating in the video conference, and send the above information to the data channel detection system, so that the data channel detection system can determine the target terminal and the target terminal according to the above information. The status of the data channel between the speaking terminals after switching. In this way, it can be determined whether each target terminal participating in the video conference can normally watch the audio and video data of the switched speaking terminal through the status of the data channel, so that the staff can target the abnormal status of the data channel. The node is repaired in order to maintain the normal progress of the video network conference.

It should be noted that, for the sake of simple description, the method embodiments are expressed as a series of action combinations, but those skilled in the art should know that the embodiments of the present application are not limited by the described action sequence, because According to the embodiments of the present application, certain steps may be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.

Referring to FIG. 10 , a schematic diagram of a framework of an apparatus for determining a data channel state according to an embodiment of the present application is shown. The apparatus can be applied to a data channel detection system communicatively connected to a main control device, so that the data channel detection system The above-mentioned method for determining the state of a data channel can be implemented, and the main control device is also connected to a plurality of terminals in communication; the device can specifically include the following modules:

The first channel information acquisition signaling sending module 1001 is configured to send the first channel information acquisition signaling to the main control device when it is detected that the speaking terminal is switched in the currently taken over video conference, and the main control device is used for In response to the first channel information acquisition signaling, acquire the first local channel information corresponding to the switched speaking terminal from the switched speaking terminal, and acquire the first local channel information from the target terminal participating in the video conference second local channel information corresponding to the target terminal;

a local channel information acquisition module 1002, configured to receive the first local channel information and the second local channel information returned by the master control device;

The second channel information acquisition signaling sending module 1003 is configured to send the second channel information acquisition signaling to the main control device; the main control device is configured to respond to the second channel information acquisition signaling, from the Obtain server channel information and conference member information corresponding to the target terminal on the main control device;

an information comparison module 1004, configured to compare the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result;

The state determination module 1005 is configured to determine the state of the data channel used for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result.

Optionally, the information comparison module 1006 may specifically include the following units:

a multicast source address obtaining unit, configured to obtain the first multicast source address from the second local channel information, and obtain the second multicast source address from the server channel information;

a multicast source address determining unit, configured to obtain the terminal identifier to be viewed from the conference member information, and to determine a third multicast source address corresponding to the terminal identifier to be viewed;

The address comparison unit is configured to compare the first multicast source address with the second multicast source address and the third multicast source address respectively to obtain a comparison result.

Optionally, the state determination module 1005 may specifically include the following units:

a local multicast source address obtaining unit, configured to obtain the local multicast source address from the first local channel information;

a normal state determination unit, configured to be configured to, when the comparison result is that the first multicast source address, the second multicast source address and the third multicast source address are all the same multicast source address, and all When any one of the first multicast source address, the second multicast source address, and the third multicast source address is consistent with the local multicast source address, determine the address of the data channel. status is normal;

a state abnormality determination unit, configured to determine when the comparison result is that the first multicast source address, the second multicast source address and the third multicast source address are not the same multicast source address The status of the data channel is abnormal.

Optionally, the device may further specifically include the following modules:

A target multicast source address determination module, configured to determine, among the first multicast source address, the second multicast source address, and the third multicast source address, those that are inconsistent with the local multicast source address destination multicast source address;

a target information determination module, configured to determine target information corresponding to the target multicast source address in the second local channel information, the server channel information and the conference member information;

The channel abnormality information generating module is configured to generate channel abnormality information based on the target information, and display the channel abnormality information.

Optionally, the device may further specifically include the following modules:

a data packet sending module for obtaining the conference list, configured to send the data packet for obtaining the conference list to the main control device, and the main control device is configured to obtain the information of the conference list in response to the data packet for obtaining the conference list;

a conference list information receiving module, configured to receive the conference list information returned by the main control device;

a conference control right signaling generation module, configured to generate a conference control right acquisition signaling based on the conference list information, and the conference control right acquisition signaling includes a conference identifier;

A conference control right signaling sending module, configured to send the conference control right acquisition signaling to the main control device, and the main control device is configured to respond to the conference control right signaling to determine the corresponding conference identification video conference, and based on the determined video conference, generate conference control result signaling;

A conference takeover module, configured to receive the conference control result signaling sent by the main control device, and take over the video conference based on the conference control result signaling.

Referring to FIG. 11 , a schematic diagram of the framework of another apparatus for determining the state of a data channel is shown, and the apparatus can be applied to a main control device that is communicatively connected to the data channel detection system, so that the main control device can realize the above-mentioned determination In the method for the state of the data channel, the main control device is further connected to a plurality of terminals in communication, and the device may specifically include the following modules:

The first channel information acquisition signaling receiving module 1101 is configured to receive the first channel information acquisition signaling sent by the data channel detection system, and the first channel information acquisition signaling is currently taken over by the data channel detection system. Sent when it is detected that the speaking terminal is switched during the video conference;

The local channel information acquisition module 1102 is configured to, in response to the first channel information acquisition signaling, acquire the first local channel information corresponding to the switched speaking terminal from the switched speaking terminal, and obtain the first local channel information from the switched speaking terminal. acquiring the second local channel information corresponding to the target terminal on the target terminal of the video conference;

The local channel information sending module 1103 is used to send the first local channel information and the second local channel information to the data channel detection system, and receive the second channel information acquisition signaling sent by the data channel detection system ;

The second channel information acquisition signaling response module 1104 is configured to acquire server channel information and conference member information corresponding to the target terminal from the master control device in response to the second channel information acquisition signaling;

The conference information sending module 1105 is used to send the server channel information and the conference member information to the data channel detection system, and the data channel detection system is used to send the second local channel information to the server respectively. The channel information and the conference member information are compared, and a comparison result is obtained, and according to the first local channel information and the comparison result, it is determined that the communication between the target terminal and the switched speaking terminal is used. Status of the data channel for data transfer.

Optionally, the device may further specifically include the following modules:

an acquisition meeting list data packet response module, configured to receive the acquisition conference list data packet sent by the data channel detection system, and in response to the acquisition conference list data packet, acquire conference list information;

A conference list information sending module, configured to send the conference list information to the data channel detection system, and receive the conference control right acquisition signaling sent by the data channel detection system based on the conference list information, the acquisition conference The control right signaling includes the conference ID;

an acquisition conference control right signaling response module, configured to determine a video conference corresponding to the conference identifier in response to the acquisition conference control right signaling, and generate conference control result signaling based on the determined video conference;

A conference control result signaling sending module is configured to send the conference control result signaling to the data channel detection system, and the data channel detection system is configured to take over the video conference based on the conference control result signaling.

For the apparatus embodiment for determining data channel state, since it is basically similar to the method embodiment for determining data channel state, the description is relatively simple, and for related details, please refer to the partial description of the method embodiment for determining data channel state.

Embodiments of the present application also provide an electronic device, including: one or more processors; and one or more machine-readable media on which signaling is stored, when executed by the one or more processors , so that the apparatus executes one or more of the methods for determining a data channel status as described in the embodiments of the present application.

The embodiments of the present application further provide a computer-readable storage medium, and the computer program stored in the storage medium enables the processor to execute the method for determining the state of a data channel as described in the embodiments of the present application.

The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments may be referred to each other.

Those skilled in the art should understand that the embodiments of the embodiments of the present application may be provided as methods, apparatuses, or computer program products. Accordingly, the embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The embodiments of the present application are described with reference to the flowcharts and/or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It will be understood that each flow and/or block in the flowcharts and/or block diagrams, and combinations of flows and/or blocks in the flowcharts and/or block diagrams, can be implemented by computer program signaling. These computer program signals may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing terminal equipment to produce a machine that enables execution by the processor of the computer or other programmable data processing terminal equipment. Signaling generates means for implementing the functions specified in a flow or flows of the flowcharts and/or a block or blocks of the block diagrams.

These computer program signals may also be stored in a computer readable memory capable of directing a computer or other programmable data processing terminal equipment to operate in a specific manner, such that the signalling stored in the computer readable memory generates the production including the signaling means product, the signaling means implements the functions specified in the flow or flows of the flowchart and/or the block or blocks of the block diagram.

These computer program signaling can also be loaded on a computer or other programmable data processing terminal equipment, such that a series of operational steps are performed on the computer or other programmable terminal equipment to produce computer-implemented processing, so that the computer or other programmable terminal equipment Signaling performed on the device provides steps for implementing the functions specified in a flow or flows of the flowcharts and/or a block or blocks of the block diagrams.

Although the preferred embodiments of the embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once the basic inventive concepts are known. Therefore, the appended claims are intended to be construed to include the preferred embodiments as well as all changes and modifications that fall within the scope of the embodiments of the present application.

Finally, it should also be noted that in this document, relational terms such as first and second are used only to distinguish one entity or operation from another, and do not necessarily require or imply these entities or that there is any such actual relationship or sequence between operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or terminal device comprising a list of elements includes not only those elements, but also a non-exclusive list of elements. other elements, or also include elements inherent to such a process, method, article or terminal equipment. Without further limitation, an element defined by the phrase "comprises a..." does not preclude the presence of additional identical elements in the process, method, article or terminal device comprising said element.

A method, apparatus, electronic device and storage medium for determining the state of a data channel provided by the present application have been described in detail above. The principles and implementations of the present application are described with specific examples in this article. It is only used to help understand the method of the present application and its core idea; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation and application scope. In summary, The contents of this specification should not be construed as limiting the application.

Claims (10)

1. A method for determining the state of a data channel is characterized in that the method is applied to a data channel detection system which is in communication connection with a main control device, and the main control device is also in communication connection with a plurality of terminals; the method comprises the following steps:

when detecting that a speaking terminal is switched in a currently taken-over video conference, sending a first channel information acquisition signaling to a main control device, wherein the main control device is used for responding to the first channel information acquisition signaling, acquiring first local channel information corresponding to the switched speaking terminal from the switched speaking terminal, and acquiring second local channel information corresponding to a target terminal from the target terminal participating in the video conference;

receiving the first local channel information and the second local channel information returned by the main control equipment, and sending a second channel information acquisition signaling to the main control equipment; the main control equipment is used for responding to the second channel information acquisition signaling and acquiring server channel information and conference member information corresponding to the target terminal from the main control equipment;

comparing the second local channel information with the server channel information and the conference member information respectively to obtain comparison results;

determining the state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result;

determining a state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result, including:

acquiring a local multicast source address from the first local channel information;

when the comparison result indicates that the first multicast source address, the second multicast source address and the third multicast source address are the same multicast source address, and any one of the first multicast source address, the second multicast source address and the third multicast source address is consistent with the local multicast source address, determining that the state of the data channel is normal;

and when the comparison result indicates that the first multicast source address, the second multicast source address and the third multicast source address are not the same multicast source address, determining that the state of the data channel is abnormal.

2. The method of claim 1, comparing the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result, comprising:

acquiring a first multicast source address from the second local channel information, and acquiring a second multicast source address from the server channel information;

acquiring a watched terminal identifier from the conference member information, and determining a third multicast source address corresponding to the watched terminal identifier;

and comparing the first multicast source address with the second multicast source address and the third multicast source address respectively to obtain a comparison result.

3. The method of claim 1, while determining that the state of the data channel is abnormal, the method further comprising:

determining a target multicast source address inconsistent with the local multicast source address from the first multicast source address, the second multicast source address and the third multicast source address;

determining target information corresponding to the target multicast source address in the second local channel information, the server channel information and the conference member information;

and generating channel abnormal information based on the target information, and displaying the channel abnormal information.

4. The method according to claim 1, before sending a first channel information acquisition signaling to the master device when detecting that a talk spurt terminal is switched in a currently-hosted video conference, the method further comprising:

sending a conference list acquisition data packet to the master control device, wherein the master control device is used for responding to the conference list acquisition data packet and acquiring conference list information;

receiving the conference list information returned by the main control equipment, and generating a conference control right acquisition signaling based on the conference list information, wherein the conference control right acquisition signaling comprises a conference identifier;

sending the conference control right acquiring signaling to the main control equipment, wherein the main control equipment is used for responding to the conference control right signaling, determining a video conference corresponding to the conference identifier, and generating a conference control result signaling based on the determined video conference;

and receiving the conference control result signaling sent by the main control equipment, and taking over the video conference based on the conference control result signaling.

5. A method for determining a data channel state is applied to a main control device which is in communication connection with a data channel detection system, wherein the main control device is also in communication connection with a plurality of terminals respectively, and the method comprises the following steps:

receiving a first channel information acquisition signaling sent by the data channel detection system, wherein the first channel information acquisition signaling is sent by the data channel detection system when detecting that a speaking terminal is switched in a video conference which is currently taken over;

responding to the first channel information acquisition signaling, acquiring first local channel information corresponding to the switched speaking terminal from the switched speaking terminal, and acquiring second local channel information corresponding to a target terminal from the target terminal participating in the video conference;

sending the first local channel information and the second local channel information to the data channel detection system, and receiving a second channel information acquisition signaling sent by the data channel detection system;

responding to the second channel information acquisition signaling, and acquiring server channel information and conference member information corresponding to the target terminal from the main control equipment;

sending the server channel information and the conference member information to the data channel detection system, wherein the data channel detection system is used for comparing the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result, and determining the state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result;

determining a state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result, including:

acquiring a local multicast source address from the first local channel information;

when the comparison result indicates that the first multicast source address, the second multicast source address and the third multicast source address are the same multicast source address and any one of the first multicast source address, the second multicast source address and the third multicast source address is consistent with the local multicast source address, determining that the state of the data channel is normal;

and when the comparison result indicates that the first multicast source address, the second multicast source address and the third multicast source address are not the same multicast source address, determining that the state of the data channel is abnormal.

6. The method of claim 5, wherein before receiving the first channel information acquisition signaling sent by the data channel detection system, the method further comprises:

receiving an acquisition conference list data packet sent by the data channel detection system, and responding to the acquisition conference list data packet to acquire conference list information;

sending the conference list information to the data channel detection system, and receiving a conference control right acquisition signaling sent by the data channel detection system based on the conference list information, wherein the conference control right acquisition signaling comprises a conference identifier;

responding to the conference control right acquisition signaling, determining a video conference corresponding to the conference identification, and generating a conference control result signaling based on the determined video conference;

and sending the conference control result signaling to the data channel detection system, wherein the data channel detection system is used for taking over the video conference based on the conference control result signaling.

7. The device for determining the state of the data channel is characterized in that the device is applied to a data channel detection system which is in communication connection with a main control device, and the main control device is also in communication connection with a plurality of terminals; the device comprises:

a first channel information obtaining signaling sending module, configured to send a first channel information obtaining signaling to a main control device when a talk spurt terminal is detected to be switched in a currently-taken video conference, where the main control device is configured to, in response to the first channel information obtaining signaling, obtain, from a switched talk spurt terminal, first local channel information corresponding to the switched talk spurt terminal, and obtain, from a target terminal participating in the video conference, second local channel information corresponding to the target terminal;

a local channel information obtaining module, configured to receive the first local channel information and the second local channel information returned by the master control device;

a second channel information acquisition signaling sending module, configured to send a second channel information acquisition signaling to the master control device; the main control equipment is used for responding to the second channel information acquisition signaling and acquiring server channel information and conference member information corresponding to the target terminal from the main control equipment;

the information comparison module is used for comparing the second local channel information with the server channel information and the conference member information respectively to obtain a comparison result;

a state determining module, configured to determine, according to the first local channel information and the comparison result, a state of a data channel used for data transmission between the target terminal and the switched speech terminal;

determining a state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result, including:

acquiring a local multicast source address from the first local channel information;

when the comparison result indicates that the first multicast source address, the second multicast source address and the third multicast source address are the same multicast source address, and any one of the first multicast source address, the second multicast source address and the third multicast source address is consistent with the local multicast source address, determining that the state of the data channel is normal;

and when the comparison result indicates that the first multicast source address, the second multicast source address and the third multicast source address are not the same multicast source address, determining that the state of the data channel is abnormal.

8. An apparatus for determining a data channel state, the apparatus being applied to a main control device communicatively connected to a data channel detection system, the main control device being further communicatively connected to a plurality of terminals, respectively, the apparatus comprising:

a first channel information acquisition signaling receiving module, configured to receive a first channel information acquisition signaling sent by the data channel detection system, where the first channel information acquisition signaling is sent by the data channel detection system when it detects that a speech terminal is switched in a currently-taken video conference;

a local channel information obtaining module, configured to, in response to the first channel information obtaining signaling, obtain, from a switched origination terminal, first local channel information corresponding to the switched origination terminal, and obtain, from a target terminal participating in the video conference, second local channel information corresponding to the target terminal;

a local channel information sending module, configured to send the first local channel information and the second local channel information to the data channel detection system, and receive a second channel information acquisition signaling sent by the data channel detection system;

a second channel information acquisition signaling response module, configured to respond to the second channel information acquisition signaling and acquire server channel information and conference member information corresponding to the target terminal from the master control device;

a conference information sending module, configured to send the server channel information and the conference member information to the data channel detection system, where the data channel detection system is configured to compare the second local channel information with the server channel information and the conference member information, respectively, to obtain a comparison result, and determine, according to the first local channel information and the comparison result, a state of a data channel used for data transmission between the target terminal and the switched speaking terminal;

determining a state of a data channel for data transmission between the target terminal and the switched speaking terminal according to the first local channel information and the comparison result, including:

acquiring a local multicast source address from the first local channel information;

when the comparison result indicates that the first multicast source address, the second multicast source address and the third multicast source address are the same multicast source address, and any one of the first multicast source address, the second multicast source address and the third multicast source address is consistent with the local multicast source address, determining that the state of the data channel is normal;

and when the comparison result indicates that the first multicast source address, the second multicast source address and the third multicast source address are not the same multicast source address, determining that the state of the data channel is abnormal.

9. An electronic device, comprising: one or more processors; and one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the electronic device to perform the one or more methods of determining a data channel status of any of claims 1-4 or 5-6.

10. A computer-readable storage medium storing a computer program for causing a processor to perform the method of determining a status of a data channel of one or more of claims 1 to 4 or 5-6.

Images