CN119629296B - A matrix switching system for video conferencing - Google Patents
A matrix switching system for video conferencingInfo
- Publication number
- CN119629296B CN119629296B CN202411848105.2A CN202411848105A CN119629296B CN 119629296 B CN119629296 B CN 119629296B CN 202411848105 A CN202411848105 A CN 202411848105A CN 119629296 B CN119629296 B CN 119629296B
- Authority
- CN
- China
- Prior art keywords
- signal
- parameters
- bandwidth
- switching
- matrix
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4408—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream encryption, e.g. re-encrypting a decrypted video stream for redistribution in a home network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44245—Monitoring the upstream path of the transmission network, e.g. its availability, bandwidth
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
本发明公开了一种用于视频会议的矩阵切换系统，涉及视频会议技术领域。该一种用于视频会议的矩阵切换系统，网络性能检测模块实时监测视频会议的网络传输参数，生成带宽分配参数和信号压缩优化参数，确保信号在不同网络状态下的最佳传输。信号切换模块基于带宽分配参数和信号压缩优化参数，结合信号源的属性对信号进行优先级排序，确定信号源在矩阵中的映射位置，并执行信号切换，保证高优先级信号的稳定传输。动态加密控制模块根据切换后的信号特性动态调整加密容量和等级，以确保信息的安全性。字符叠加模块则根据信号的稳定性和质量，选择适当的叠加模板，并调整视频显示的刷新速率，确保字符信息与视频流的兼容性。
The present invention discloses a matrix switching system for video conferencing, and relates to the technical field of video conferencing. In the matrix switching system for video conferencing, a network performance detection module monitors the network transmission parameters of the video conferencing in real time, generates bandwidth allocation parameters and signal compression optimization parameters, and ensures the optimal transmission of the signal under different network conditions. The signal switching module prioritizes the signals based on the bandwidth allocation parameters and signal compression optimization parameters in combination with the properties of the signal source, determines the mapping position of the signal source in the matrix, and performs signal switching to ensure the stable transmission of high-priority signals. The dynamic encryption control module dynamically adjusts the encryption capacity and level according to the characteristics of the switched signal to ensure the security of the information. The character overlay module selects an appropriate overlay template according to the stability and quality of the signal, and adjusts the refresh rate of the video display to ensure the compatibility of the character information with the video stream.
Description
Technical Field
The invention relates to the technical field of video conferences, in particular to a matrix switching system for video conferences.
Background
With the continuous development of informatization and intelligence technologies, video conferencing has become an important means for modern enterprise collaboration, government agency decision-making and educational remote teaching. The video conference system can break through the region limitation and realize real-time and efficient communication and cooperation. However, as conference scene complexity increases, video conference systems face higher technical requirements, such as real-time switching of multiple signal sources, stability of signal transmission, and interactivity of picture display. These demands have prompted video conferencing technology to continually upgrade to meet the diverse usage scenarios and higher user experience requirements.
For example, china patent publication No. CN117354448B discloses a matrix switching system for video conferences, which comprises an information acquisition module, an information encryption module and a character superposition control module, wherein the information acquisition module is used for carrying out identification processing on matrix switching information to output switching characteristic information, the information encryption module comprises an encryption capacity control component used for determining the maximum capacity ratio of information encryption according to the variance of matrix switching time, a security risk control component used for adjusting the encryption level of the information according to the actual error rate after the maximum capacity ratio of the information encryption is determined, and the character superposition control module comprises a cache rate control component used for determining the cache rate according to the byte quantity ratio of character superposition words of the selected local database. The invention realizes the improvement of the stability of the matrix switching process and the character superposition effectiveness of video display.
The existing system only performs switching control through the feature extraction of matrix switching information, and the instantaneity and the accuracy of the multi-signal source high-frequency switching scene cannot be fully considered, so that the switching efficiency in a complex scene is low. The information security is controlled by adopting an encryption capacity and bit error rate adjustment mode, but the problem of security and performance balance in high-bandwidth signal transmission cannot be comprehensively solved. The current character superposition module only controls the cache rate based on the word byte quantity ratio of the local database, so that the efficient management of dynamic input information or multi-language character superposition can not be realized, and the flexibility and instantaneity of user experience are reduced.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a matrix switching system for video conferences, which solves the problems of the background technology.
The matrix switching system for the video conference comprises a network performance detection module, a signal switching module, a dynamic encryption control module and a character superposition module, wherein the network performance detection module is used for monitoring network transmission parameters of the video conference in real time, analyzing and generating bandwidth allocation parameters and signal compression optimization parameters, the signal switching module is used for sequencing priorities of various signal sources required by video conference matrix switching based on the bandwidth allocation parameters and the signal compression optimization parameters and combining with signal source attributes, determining a priority mapping position of the signal sources in the matrix, distributing the matrix position, executing signal switching and identifying signal characteristics after switching, the dynamic encryption control module is used for dynamically adjusting encryption capacity and grades according to the signal characteristics after switching, and the character superposition module is used for selecting a character superposition template and adjusting refresh rate according to the signal characteristics after switching of the signal switching module.
Further, the specific process of analyzing and generating the bandwidth allocation parameters and the signal compression optimization parameters is that according to the network transmission parameters of the video conference, the network state is analyzed, the availability of the current bandwidth and the demand of signal compression are evaluated, the bandwidth allocation parameters are generated, the generated bandwidth allocation parameters comprise bandwidth demand analysis parameters, current network delay parameters and bandwidth availability evaluation parameters, the signal compression optimization parameters are generated according to the bandwidth allocation conditions, the efficiency and the quality of signal transmission are optimized, and the signal compression optimization parameters comprise signal compression rate parameters, compression algorithm selection parameters and transmission error rate optimization parameters.
The method comprises the steps of determining a bandwidth allocation parameter, a signal compression optimization parameter, a signal source compression ratio parameter, a compression algorithm selection parameter, a transmission error rate optimization parameter, and a transmission error rate parameter, wherein the bandwidth allocation parameter and the signal compression optimization parameter are used for allocating bandwidth to a video conference matrix, and the signal source compression ratio parameter, the compression algorithm efficiency and the transmission error rate parameter are used for allocating bandwidth to the video conference matrix.
Further, the specific process of determining the priority mapping position of the signal sources in the matrix is as follows, allocating weights to the bandwidth allocation parameters and the signal compression optimization parameters, comprehensively evaluating the bandwidth requirements, the delay requirements, the bandwidth availability, the compression efficiency and the bit error rate of the signal sources, determining the priority ordering of each signal source in the matrix, and determining the priority ordering of each signal source in the matrix.
Further, matrix positions are allocated, the specific process of executing signal switching is that the signal sources are mapped to corresponding positions in the matrix according to priority ordering after weight allocation, the signal sources with high priority are allocated to the prioritized matrix positions, the signal switching module transmits the signal sources with high priority to the corresponding matrix positions according to the allocated matrix positions, replaces the signal sources with low priority in the matrix to perform signal switching, the signal transmission link is adjusted according to matrix configuration, the signal transmission link comprises updating video display positions, adjusting signal output sources and switching input and output ports, and the signal characteristics after switching is completed are monitored.
Further, the specific process of dynamically adjusting the encryption capacity and the encryption grade according to the signal characteristics after switching is as follows, the signal characteristics after switching of the signals are analyzed to comprise bandwidth requirements, delay, compression efficiency and error rate, the security requirements of the signals are determined, the required encryption capacity and encryption grade are calculated according to the transmission characteristics of the signals, whether the encryption strength needs to be enhanced or not is judged, and the encryption capacity and the encryption grade are dynamically adjusted according to the signal characteristics and calculation results.
Further, according to the signal characteristics after the signal switching module is switched, the specific process of selecting the character superposition template is as follows, according to the signal characteristics after the switching, the transmission quality and stability of the signal are evaluated, the character superposition template matched with the current signal condition is identified, after the signal is switched, the selected character superposition template is loaded and applied to the video stream, the character content can be fused with the video signal clearly, and meanwhile, the transmission characteristics of the current signal are compatible.
Further, the specific process of adjusting the refresh rate includes the steps of evaluating stability and bandwidth availability of a signal according to the characteristics of the signal after switching, obtaining a signal quality index, comparing the signal quality index with a preset signal quality index threshold, maintaining or increasing the refresh rate when the signal quality index is greater than or equal to the threshold, and reducing the refresh rate when the signal quality index is less than the threshold.
The invention has the following beneficial effects:
(1) The matrix switching system for the video conference can intelligently analyze and generate bandwidth allocation parameters and signal compression optimization parameters by monitoring network transmission parameters in real time. By combining the signal source attributes based on the parameters, the priority ordering and matrix position allocation are carried out on each signal source in the video conference, the priority mapping position of the signal source in the matrix is ensured, the signal transmission and processing are optimized, and the stability and transmission efficiency of the video conference are improved.
(2) According to the matrix switching system for the video conference, the encryption capacity and the encryption grade are dynamically adjusted according to the characteristics of the signals after switching, and the signal safety in the video conference is ensured. Meanwhile, a proper character superposition template is selected according to the signal characteristics, and the refresh rate is adjusted, so that the definition and instantaneity of video content and character information are ensured, and the user experience and conference effect are further improved.
Of course, it is not necessary for any one product to practice the invention to achieve all of the advantages set forth above at the same time.
Drawings
Fig. 1 is a flow chart of a matrix switching system for video conferencing in accordance with the present invention.
Detailed Description
The embodiment of the application solves the problems of video delay, clamping and information loss caused by bandwidth and signal quality fluctuation in the video signal switching process through a matrix switching system for video conferences. The system ensures the stability and definition of the video stream by monitoring network transmission parameters in real time and optimizing bandwidth allocation and signal compression, thereby improving the overall quality and fluency of the video conference.
The scheme in the embodiment of the application has the following overall thought:
and monitoring network transmission parameters of the video conference in real time, and analyzing and generating bandwidth allocation parameters and signal compression optimization parameters.
And based on the bandwidth allocation parameters and the signal compression optimization parameters, carrying out priority ordering on each signal source required by video conference matrix switching by combining the signal source attributes, determining the priority mapping position of the signal source in the matrix, allocating the matrix position, executing signal switching, and identifying the signal characteristics after switching.
And dynamically adjusting the encryption capacity and the grade according to the characteristics of the signals after switching.
And selecting a character superposition template according to the signal characteristics after the signal switching module is switched, and adjusting the refresh rate.
Referring to fig. 1, an embodiment of the invention provides a technical scheme of a matrix switching system for a video conference, which comprises a network performance detection module, a signal switching module, a dynamic encryption control module and a character superposition module, wherein the network performance detection module is used for monitoring network transmission parameters of the video conference in real time, analyzing and generating bandwidth allocation parameters and signal compression optimization parameters, the signal switching module is used for sequencing priorities of various signal sources required by the video conference matrix switching based on the bandwidth allocation parameters and the signal compression optimization parameters and combining signal source attributes, determining a priority mapping position of the signal sources in the matrix, distributing the matrix position, executing the signal switching, and identifying the signal characteristics after the switching, the dynamic encryption control module is used for dynamically adjusting encryption capacity and grades according to the signal characteristics after the switching, and the character superposition module is used for selecting a character superposition template and adjusting refresh rate according to the signal characteristics after the switching of the signal switching module.
In this embodiment, a matrix switching system is a device commonly used for video and audio signal management that is capable of flexibly matching and switching multiple input signals (e.g., images from different video sources) to multiple output devices (e.g., displays or projectors). By means of the system, a user can control which input signal is transmitted to which output device, and therefore signal preferential distribution and switching are achieved. The network performance detection module is used for monitoring the transmission condition of the network in the video conference in real time and mainly comprises key parameters such as bandwidth, delay, packet loss rate and the like. The bandwidth refers to the maximum rate of data transmitted by the network, the delay refers to the time required by the data from the sending end to the receiving end, and the packet loss rate refers to the proportion of lost data packets in the transmission process. through the parameters, the network performance detection module can evaluate the quality of the current network, and further provide data support for subsequent signal processing and optimization. Bandwidth allocation parameters refer to the partitioning rules and allocation patterns of the available bandwidth in the network. The purpose of bandwidth allocation is to reasonably allocate network resources according to actual conditions (such as bandwidth requirements, network delay and the like) of the network, ensure that each signal source in the video conference can obtain enough bandwidth, and avoid network congestion or signal loss. Signal compression optimization parameters the signal compression optimization parameters refer to the relevant parameters of the compression processing of the video signal in the transmission process. Video signal compression is intended to reduce the bandwidth required for transmission, enabling smooth transmission of signals under limited network conditions. The compression optimization parameters comprise compression ratio, algorithm selection and the like, and through reasonable parameter setting, the signal quality is ensured, and the bandwidth utilization efficiency is optimized. The signal switching module is a key component for controlling switching between an input signal and output equipment. In video conferencing, there are multiple sources (e.g., images of different cameras) and the signal switching module distributes these signals to different output devices according to the priority settings of the system. The module determines the priority of each signal source according to the network state, the signal source attribute and other factors, and executes corresponding switching operation. Signal source attributes-signal source attributes refer to characteristics and requirements of each video signal source, such as bandwidth requirements, delay tolerance, resolution, etc. In a videoconferencing system, the signal sources may come from different devices (e.g., cameras, computers, or other video input devices), the signal properties of each device may be different, and the system needs to perform reasonable signal switching and distribution according to these properties. And the dynamic encryption control module is used for dynamically adjusting the encryption grade and the encryption capacity of the video signal according to the characteristics of the video signal. In video conferencing, protecting data security is critical, especially in cases where the network environment is complex. Through the encryption control module, the system can automatically adjust the encryption strategy according to the transmission quality and the security requirement of the signal, ensure the security of the data and avoid the influence of excessive encryption on the transmission efficiency of the signal. Character overlay module-a character overlay module is a technique that overlays text information (such as status, time stamp, or logo) on a video signal. In a video conference, the superposition module can directly display specific characters, marks or warning information on a video signal, so that conference participants can quickly know conference information. Depending on the quality and characteristics of the video signal, the system may select different superimposed templates, such as a template with more fault tolerance when the signal quality is low, and a template with better signal quality. Refresh rate-refresh rate refers to the number of updates per second of a video signal, typically in hertz (Hz). The refresh rate has a direct impact on the smoothness and picture quality of the video conference. in low bandwidth or high latency network environments, the system may need to adjust the refresh rate to ensure stable transmission of signals. The process is controlled by the character overlay module according to the real-time network conditions to optimize video quality. .
The method comprises the specific processes of analyzing and generating bandwidth allocation parameters and signal compression optimization parameters, wherein the specific processes are that according to network transmission parameters of a video conference, network states are analyzed, the availability of current bandwidth and the demand of signal compression are evaluated, the bandwidth allocation parameters are generated, the bandwidth allocation parameters comprise bandwidth demand analysis parameters, current network delay parameters and bandwidth availability evaluation parameters, the signal compression optimization parameters are generated according to bandwidth allocation conditions, the efficiency and quality of signal transmission are optimized, and the signal compression optimization parameters comprise signal compression rate parameters, compression algorithm selection parameters and transmission error rate optimization parameters.
In this embodiment, in the video conference, the quality of the network transmission directly affects the smoothness and stability of the video signal. Network transmission parameters include bandwidth, delay, packet loss rate, etc., which are key indicators for determining signal quality and transmission efficiency. Therefore, the network performance detection module needs to monitor the network transmission parameters in real time first to acquire the network state information required by the video conference. Bandwidth, which is the maximum rate at which data can be transmitted in a network, is typically expressed in Mbps (megabits per second). The size of the bandwidth determines the carrying capacity of the data stream in the video conference, affecting the video and audio quality, especially in high definition video conferences. Delay refers to the time delay of data from the transmitting end to the receiving end. The smaller the delay is, the better the synchronism of the video and the audio is, and the too large delay can lead to asynchronous audio and video and influence the conference experience. Packet loss rate refers to the proportion of data packets lost in the data transmission process. A high packet loss rate may result in a degradation of video signal quality or audio interruption. Bandwidth availability refers to whether the transmission requirements of all signal sources can be met in the current network environment. Network status may change for a variety of reasons (e.g., network congestion, bandwidth occupied by other traffic, etc.), and thus real-time assessment of bandwidth availability is required. This evaluation includes bandwidth requirement analysis parameters that may be different for different sources. For example, high Definition (HD) video sources require more bandwidth, while Standard Definition (SD) video sources require less bandwidth. Based on the requirements of each signal source, it is evaluated whether the current network is sufficient to support smooth transmission of these signals. The evaluation of the current network delay parameter, delay, is an important basis for judging whether the network can support real-time video streaming. If the delay is too high, the synchronicity of video and audio may be affected. And (3) a bandwidth availability evaluation parameter, namely evaluating the size of the current available bandwidth and whether the signal transmission requirement is met or not based on the network state monitoring data. If the bandwidth is insufficient, adjustments may be required by means of compression optimization or the like. The bandwidth allocation parameter is a strategy for reasonably allocating network resources, and aims to ensure that each signal source in the video conference can obtain enough bandwidth and ensure the stability and high quality of signal transmission. The process of generating the bandwidth allocation parameters includes determining a bandwidth requirement for each signal source based on the bandwidth requirement analysis parameters. And judging whether the network is enough to support the required bandwidth according to the network delay and the bandwidth availability evaluation parameters, and reasonably adjusting the allocation strategy. The bandwidth allocation is optimized, so that the bandwidth allocation of each signal source meets the requirements and does not cause network bottlenecks. The purpose of signal compression optimization is to reduce the bandwidth required for transmission while guaranteeing video quality, thereby improving the efficiency of signal transmission. Compression is a critical step in ensuring that video conferences can proceed smoothly in the case of limited bandwidth. The process of generating the signal compression optimization parameter includes a signal compression rate parameter, wherein the signal compression rate refers to the size ratio of an original signal to a compressed signal. The higher the compression ratio, the less bandwidth is required for transmission, but the over-compression can affect signal quality. The choice of signal compression rate requires balancing bandwidth utilization with video quality. Compression algorithm selection parameters selection of the appropriate video compression algorithm (e.g., h.264, h.265, etc.) is an important step in signal compression optimization. The compression efficiency and the computational complexity of different algorithms are different, so that the selection needs to be performed according to factors such as network bandwidth, signal quality and the like. and (3) transmitting error rate optimization parameters, namely, error codes possibly appear in the video signal in the transmission process, and the quality of the video signal can be influenced by the error rate. The transmission error rate optimization parameters reduce the influence of error codes and improve the stability of signal transmission by selecting proper coding and error correction mechanisms.
The method comprises the specific processes of carrying out priority ordering on all signal sources required by video conference matrix switching based on bandwidth allocation parameters and signal compression optimization parameters and combining signal source attributes, wherein the specific processes are as follows, according to bandwidth demand analysis parameters, current network delay parameters and bandwidth availability evaluation parameters, bandwidth demands, delay and bandwidth availability in the signal source transmission process are evaluated, signal sources with low bandwidth demands, low delay and high bandwidth availability are prioritized, and according to signal compression rate parameters, compression algorithm selection parameters and transmission error rate optimization parameters, compression rate, compression algorithm efficiency and transmission error rate of all signal sources are evaluated, and signal sources with low compression rate, compression algorithm efficiency and low transmission error rate are prioritized.
In this embodiment, the bandwidth requirement analysis parameter, the current network delay parameter, and the bandwidth availability evaluation parameter refer to a bandwidth required by each signal source in the transmission process, and the minimum bandwidth value required by each signal source in the transmission process is calculated. Current network delay parameters refer to the delay condition in the network, i.e. the transmission time from the sender to the receiver, typically in milliseconds (ms). The lower the network delay, the faster the response of the signal source and the higher the priority. And the bandwidth availability evaluation parameter is used for evaluating the available condition of the bandwidth of the current network, analyzing whether the current network has bandwidth bottleneck or network congestion, and determining the priority allocation of the signal source. The signal sources with low bandwidth requirement, low delay and high bandwidth availability are prioritized, namely, by comprehensively evaluating the parameters, the signal sources with low network bandwidth requirement, low delay and high available bandwidth in the current network environment are preferentially selected, so that the smoothness and low delay of the video conference can be ensured. The signal compression rate parameter refers to the compression ratio adopted when the signal source is compressed. A high compression rate means less bandwidth is required for transmission, but may reduce the quality of the image or video. The compression algorithm selection parameter refers to the efficiency of the compression algorithm adopted. For example, some efficient compression algorithms (e.g., h.264 or HEVC) can maintain better signal quality at higher compression rates. The transmission error rate optimization parameter refers to the proportion of signal error codes in the transmission process, and the lower the error rate is, the more stable the signal quality is. The signal sources with low compression rate, high efficiency of compression algorithm and low transmission error rate are subjected to high-efficiency compression processing, and the error rate in the transmission process is lower, so that better video quality can be ensured under limited bandwidth, and therefore, the signal sources are subjected to preferential sequencing. And the comprehensive sequencing process is to comprehensively sequence the priority of each signal source by integrating a plurality of parameters such as bandwidth demand, delay, bandwidth availability, compression efficiency and the like. In the sorting process, firstly, the signal sources with low bandwidth occupation and small delay are ensured to obtain the priority mapping positions, and then the signal sources are subjected to the priority sorting of compression efficiency and transmission stability. Through the comprehensive sequencing, stable operation and good experience of the video conference system under the dynamic bandwidth and signal environment can be ensured.
The method comprises the specific process of determining the priority mapping position of the signal sources in the matrix, namely, allocating weights to bandwidth allocation parameters and signal compression optimization parameters, comprehensively evaluating the bandwidth requirements, delay requirements, bandwidth availability, compression efficiency and bit error rate of the signal sources, determining the priority ordering of the signal sources in the matrix, and determining the priority ordering of the signal sources in the matrix.
In the embodiment, the bandwidth allocation parameters and the signal compression optimization parameters are allocated with weights, namely, the bandwidth allocation parameters are weighted, namely, certain weights are allocated for the parameters such as bandwidth demand, network delay, bandwidth availability and the like according to the tension degree of network resources and the priority of bandwidth allocation. In general, in the case of limited bandwidth, sources with lower bandwidth requirements and lower delays should be given higher weights. And the signal compression optimization parameter weight is that the weight is allocated to parameters such as the signal compression rate, the compression algorithm efficiency, the transmission error rate and the like. Signal sources with high compression efficiency and low bit error rate may require less bandwidth resources and thus need to be considered in weight allocation. The purpose of the weight distribution is to ensure that the priority demands of the system are more reasonably reflected in the comprehensive evaluation by giving different importance to different performance parameters. The bandwidth requirements, i.e. the amount of bandwidth required for each signal source transmission, of the signal sources are evaluated comprehensively, as are the delay requirements, bandwidth availability, compression efficiency and bit error rate. Sources of low bandwidth demand should be prioritized to avoid network congestion. Delay requirement-delay requirement per signal source. The low-delay required signal source should be processed preferentially to ensure the real-time performance of the video call. Bandwidth availability refers to the size of the bandwidth available to the current network. If the bandwidth is sufficient, the system can support simultaneous transmission of more signal sources, and if the bandwidth is limited, the signal sources with higher priority should be arranged to the preferred matrix position. Compression efficiency refers to the amount of data that a signal has been compressed prior to transmission. A high compression rate means lower bandwidth consumption and therefore higher priority. Bit error rate, the error condition of the signal in the transmission process. Sources of low bit error rate should be preferred because they provide more stable and high quality video transmission. And in the comprehensive evaluation process, the bandwidth requirement, the delay requirement, the bandwidth availability, the compression efficiency and the bit error rate of each signal source are comprehensively considered through a weighted average method, so that the comprehensive score of each signal source is generated, and the priority of the signal source is reflected.
The method comprises the steps of distributing matrix positions, mapping signal sources to corresponding positions in a matrix according to priority sequence after weight distribution, distributing signal sources with high priority to the prioritized matrix positions, transmitting high-priority signal sources to the corresponding matrix positions according to the distributed matrix positions by a signal switching module, replacing low-priority signal sources in the matrix to perform signal switching, adjusting a signal transmission link according to matrix configuration, wherein the signal transmission link comprises updating video display positions, adjusting signal output sources and switching input and output ports, and monitoring signal characteristics after the signal switching is completed.
In this embodiment, signal sources are mapped to corresponding positions in the matrix according to the prioritized order after weight assignment, and signal sources with high priorities are assigned to prioritized matrix positions, signal source mapping, i.e., the system maps signal sources to various positions in the matrix according to the prioritized order obtained in the previous step. The high priority signal sources are assigned to optimal locations in the matrix that typically occupy higher bandwidth, low latency channels. Priority matrix location the location of the matrix is typically divided into different levels, with higher priority signal sources being assigned to priority levels (e.g. first row, first few ports or priority display areas) to ensure their transmission quality and real-time. And according to the allocated matrix position, the signal switching module transmits the high-priority signal source to the corresponding matrix position, replaces the low-priority signal source in the matrix, and performs signal switching operation, namely the signal switching module transmits the high-priority signal source to the corresponding position in the matrix according to the pre-allocated priority position in the matrix. At the same time, low priority sources may be replaced or rescheduled to secondary locations to free up bandwidth or display space. Signal source replacement, wherein the replacement process ensures that the resources of the matrix position are always allocated to the optimal signal source, thereby improving the smoothness and the picture quality of the video conference. Transmission of low priority sources may reduce bandwidth or significantly reduce display efficiency and thus need to be adjusted. According to the matrix configuration, the signal transmission link is adjusted, including updating the video display position, adjusting the signal output source and switching the input/output ports, wherein after the signal transmission link is adjusted, the system updates the signal transmission link according to the matrix configuration. This includes updating the video display position by adjusting the display position of the video signal, such as adjusting the video wall or the layout of the picture on the display, based on the priority of the source. Adjusting the signal output sources, namely, in the matrix, the output ports of the signal sources may change, so that the output paths of the signals need to be adjusted to ensure that the high-priority signals are transmitted through the optimal channels. Switching input/output ports if the configuration of the input/output ports of the video signal source and the matrix changes, the system automatically switches the port configuration to adapt to the new signal source position. This step helps to ensure stable output and timely transmission of the signal. And after the signal switching is finished, monitoring the signal characteristics after the switching, wherein the system needs to monitor the quality and stability of the signal in real time, including parameters such as bandwidth, delay and bit error rate of the signal. This is to ensure that the quality of the video conference is not affected after the signal is switched, and that a high quality video stream can be continuously provided. Signal characteristic evaluation the monitoring process may include automatically detecting whether the signal has too long a delay, lost packets, image sticking or other problems. If the abnormality occurs, the system can adjust the priority of the signal source again, and the matrix switching is performed again, so that the smooth proceeding of the conference is ensured.
The method comprises the specific processes of analyzing signal characteristics after signal switching, including bandwidth requirements, delay, compression efficiency and bit error rate, determining signal security requirements, calculating required encryption capacity and encryption grade according to signal transmission characteristics, judging whether encryption strength needs to be enhanced or not, and dynamically adjusting encryption capacity and grade according to signal characteristics and calculation results.
In this embodiment, the characteristics of the signal after signal switching, including bandwidth requirement, delay, compression efficiency and bit error rate, are analyzed to determine the security requirement of the signal, where the bandwidth requirement of the signal determines the amount of data transmission, and a signal with a higher bandwidth may need more encryption resources to ensure the integrity and security of the data, especially when the network transmission load is heavy. Delay the delay parameter reflects the time of transmission of the signal from the source to the destination. A higher delay may affect the real-time nature of the encryption process, and therefore the effect of the encryption process on the delay needs to be evaluated so as not to affect the signal quality by too much encryption process. Compression efficiency-the higher the compression efficiency, the smaller the data volume, and the lower the bandwidth requirements during transmission, which may mean that the compression algorithm of the data can retain more information without affecting the security. Thus, in a signal of high compression efficiency, it is possible to reduce the complexity of encryption. Bit error rate-bit error rate is the frequency of occurrence of errors in the signal transmission process. Signals with high bit error rates may be vulnerable to attack during transmission, and thus require increased encryption strength to ensure confidentiality and integrity of data. Security requirements for signals combining these characteristics, the system can evaluate the security requirements for signals to determine if additional encryption measures need to be applied, such as selecting a higher encryption strength or increasing encryption capacity. According to the transmission characteristics of the signals, the required encryption capacity and encryption grade are calculated, whether the encryption strength needs to be enhanced is judged, namely, the encryption capacity and grade are calculated, namely, by analyzing the bandwidth, delay, compression efficiency and bit error rate of the signals, the system can calculate the proper encryption capacity and grade. For example, if bandwidth requirements are high, the system may need to increase encryption capacity to ensure that encrypted data is efficiently transferred. If the bit error rate is high, the encryption strength may need to be increased to ensure that the signal is not attacked and ensure the security of the data. Judging the encryption strength, and according to the parameters, the system can decide whether the encryption strength needs to be enhanced or not. For example, a signal with a lower bandwidth or higher bit error rate may require the application of a strong encryption algorithm, such as AES-256 bit encryption, whereas a lower strength encryption algorithm may be used to reduce the system burden. Dynamically adjusting the encryption capacity and level according to the signal characteristics and the calculation result, namely dynamically adjusting the encryption once the calculation of the security requirement and the encryption requirement of the signal is completed, and dynamically adjusting the encryption capacity and level by the system. At this time, the encryption strength is automatically increased or decreased according to the characteristics of the signal to balance the performance and security of the system, i.e. to enhance the encryption capacity, if the signal requires more protection (e.g. high bandwidth, low delay or high bit error rate signal), the system will allocate more encryption resources. Increasing the encryption level if there is a higher security risk during transmission, the system may increase the encryption level, for example using a stronger encryption algorithm or a greater key length. And optimizing encryption processing, namely ensuring that the real-time performance and quality of signals are not influenced in the encryption and decryption processes through dynamic adjustment, and simultaneously ensuring confidentiality and integrity of the signals.
The character superposition template is loaded and applied to a video stream after the signal is switched, so that the character content can be fused with the video signal clearly, and the transmission characteristic of the current signal is compatible.
In the embodiment, according to the characteristics of the signals after switching, the transmission quality and stability of the signals are evaluated, and a character superposition template matched with the current signal condition is identified, namely, the transmission quality and stability are evaluated, namely, the quality and stability of the signals are evaluated after the switching of the signals is completed. And selecting a matched character superposition template, namely selecting a proper character superposition template by the system according to the quality evaluation result of the signal. For high quality, low delay, low bit error rate signals, a simple and less disturbing template may be selected, while for low quality signals, templates with a stronger tolerance (e.g. increasing the border of the character, enhancing the contrast, etc.) may be selected. After signal switching, the selected character overlay template is loaded and applied to the video stream to ensure that the character content is clearly fused with the video signal, the selected template is loaded, once the character overlay template is determined, the system will load the template into the video stream in preparation for combining with the video content. The character overlays typically include information such as a timestamp, identifier, title, and the like. And ensuring clear fusion, namely ensuring that character information can be clearly displayed and perfectly fused with video signals after the template is loaded. This typically involves adjusting parameters such as the size, color, transparency, and position of the characters to avoid collision of the character information with the video content or to obscure important details. Meanwhile, the method is compatible with the transmission characteristics of the current signal, namely compatibility processing, namely ensuring that the selected character superposition template is suitable for the quality of the signal and also compatible with the transmission characteristics of the signal. For example, if the network bandwidth is low, a more compact character style may be used, so that excessive character superposition is avoided to influence the video smoothness. If there is a high delay or error, redundant information or a format of the adjustment template may be applied to ensure that the character information can be stably displayed even if the signal is slightly lost. The design of the character superposition template is required to be capable of adapting to different signal conditions, and enough readability and visual effect can be maintained under any condition, so that clear and accurate information transmission is ensured.
The method comprises the specific processes of adjusting the refresh rate, namely, evaluating the stability and bandwidth availability of a signal according to the characteristics of the signal after switching, obtaining a signal quality index, comparing the signal quality index with a preset signal quality index threshold, maintaining or increasing the refresh rate when the signal quality index is greater than or equal to the threshold, and reducing the refresh rate when the signal quality index is smaller than the threshold.
In this embodiment, the stability and bandwidth availability of the signal are evaluated based on the characteristics of the signal after switching, and the signal quality index is obtained by analyzing the stability of the signal, such as delay, jitter, and bit error rate, to evaluate the quality of the signal. When the stability of the signal is higher, the signal is more stable, and the blocking or the image distortion is not easy to occur. Bandwidth is a critical factor affecting video signal quality. By measuring the bandwidth allocation of the current network, the system can determine whether the bandwidth is sufficient to meet the transmission requirements of high quality video signals.
The signal quality index is obtained by integrating these factors according to the stability and bandwidth availability of the signal, and the signal quality index is calculated to reflect the overall quality of the signal and used for further decision-making. The signal quality index formula is as follows: Equation parameters interpretation BW avail, representing the bandwidth available in the current network, BW max is the maximum bandwidth capacity of the network. The larger the section width, the stronger the transmission capability and the better the video quality. Alpha is a weight coefficient of influence of bandwidth availability on signal quality, and is usually a positive value, and controls the influence degree of bandwidth. This term affects signal quality by the relative availability of bandwidth, β being an exponential factor, the impact of bandwidth can be adjusted. Delay avg average Delay of signal from source to receiving end. The smaller the delay, the more real-time the video is. Gamma is the impact weight coefficient of delay on signal quality, usually positive, adjusting the impact of delay on video quality.The effect of delay on signal quality is nonlinear, the higher the delay the greater the effect. The logarithmic function is used to compress the effect of the delay. BER is the bit error rate during signal transmission. The lower the bit error rate, the higher the video quality. Delta is the impact weight coefficient of error rate on signal quality.This term uses an exponential function (ζ is an exponential factor) to non-linearly weight the bit error rate. The higher the bit error rate, the greater the impact. PLR (packet loss rate) is a ratio indicating the loss of a packet during transmission. The higher the packet loss rate, the worse the video quality. η is the weight coefficient of the influence of the packet loss rate on the signal quality.The packet loss rate is processed by an exponential function of the packet loss rate, and the larger the packet loss rate is, the stronger the influence is. Var i ance shows the fluctuation of the signal quality. The larger the fluctuation, the worse the stability and continuity of the video stream. θ is the influence weight coefficient of the fluctuation on the signal quality.The absolute value of the fluctuation is used to represent the stability of the signal and ζ is the extent to which the fluctuation affects the signal quality.
The signal quality index is compared with a preset signal quality index threshold, wherein the signal quality index is compared with the threshold, and the system sets the signal quality index threshold which represents the lowest quality standard of signal transmission. By comparing the current signal quality index to the threshold, the system can determine whether the signal quality meets the desired criteria. When the signal quality index is greater than or equal to the threshold, if the signal quality index meets or exceeds the preset threshold, the signal quality is good, and the refresh rate can be maintained or increased so as to keep the video fluency and definition. When the signal quality index is smaller than the threshold value, if the signal quality index is lower than the preset threshold value, the signal quality index indicates that the signal quality is poor, and a clamping or delay phenomenon possibly occurs, and at the moment, the system can reduce the refresh rate and the pressure on bandwidth and computing resources, so that stable transmission of video signals is ensured. And the refresh rate is adjusted, namely, the refresh rate is maintained or increased, namely, when the signal quality is good, the system can improve the refresh rate, ensure smooth display of video content and reduce blurring or hysteresis of images. Reducing the refresh rate-when the signal quality is poor, reducing the refresh rate helps to reduce the bandwidth requirements and reduces the network load by reducing the amount of data transmission, thereby maintaining the stability of the video signal and enabling normal playback even in the case of limited bandwidth.
In summary, the present application has at least the following effects:
A matrix switching system for video conferences accurately evaluates the quality of video signals by comprehensively considering factors such as bandwidth availability, delay, bit error rate, packet loss rate, signal fluctuation and the like, dynamically adjusts refresh rate and encryption level according to signal characteristics, and effectively improves the video quality and instantaneity in the video conferences. According to real-time network performance monitoring, bandwidth is reasonably distributed, signal compression is optimized, high efficiency of signal source transmission is guaranteed, and influence of network bandwidth and transmission delay on video conferences is reduced to the greatest extent. By dynamically adjusting the encryption capacity and the encryption grade, the video signal is ensured to meet the safety requirement in the transmission process, and particularly when the network state changes, the encryption strength can be timely adjusted, so that the privacy and safety of conference contents are protected. And (3) sequencing the priorities of the video conference matrixes based on the signal source attributes, and ensuring the priority mapping positions of the signal sources with high priority in the matrixes, so that the priority processing of important signal sources and the display effect with higher quality are ensured. By selecting a proper character superposition template and adjusting the refresh rate, the display effect can be adjusted in real time according to the signal quality, so that the text information in the video conference is stably fused with the video signal, and the definition and the stability of information transmission are improved.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of systems, apparatuses (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (2)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411848105.2A CN119629296B (en) | 2024-12-16 | 2024-12-16 | A matrix switching system for video conferencing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202411848105.2A CN119629296B (en) | 2024-12-16 | 2024-12-16 | A matrix switching system for video conferencing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN119629296A CN119629296A (en) | 2025-03-14 |
| CN119629296B true CN119629296B (en) | 2025-07-18 |
Family
ID=94898055
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202411848105.2A Active CN119629296B (en) | 2024-12-16 | 2024-12-16 | A matrix switching system for video conferencing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN119629296B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008082375A2 (en) * | 2005-09-07 | 2008-07-10 | Vidyo, Inc. | System and method for a conference server architecture for low delay and distributed conferencing applications |
| CN117354448A (en) * | 2023-12-06 | 2024-01-05 | 广东保伦电子股份有限公司 | Matrix switching system for video conference |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5802281A (en) * | 1994-09-07 | 1998-09-01 | Rsi Systems, Inc. | Peripheral audio/video communication system that interfaces with a host computer and determines format of coded audio/video signals |
| WO2000076207A1 (en) * | 1999-06-09 | 2000-12-14 | Panja, Inc. | System and method for integrating multiple video switches into a video matrix |
| US6812956B2 (en) * | 2001-12-21 | 2004-11-02 | Applied Minds, Inc. | Method and apparatus for selection of signals in a teleconference |
| JP4194045B2 (en) * | 2004-12-03 | 2008-12-10 | 株式会社メイコー | Video switch device |
| CN107529023A (en) * | 2017-08-08 | 2017-12-29 | 武汉兴图新科电子股份有限公司 | It is a kind of that there is signal mutually for the matrix device and output intent of function |
-
2024
- 2024-12-16 CN CN202411848105.2A patent/CN119629296B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008082375A2 (en) * | 2005-09-07 | 2008-07-10 | Vidyo, Inc. | System and method for a conference server architecture for low delay and distributed conferencing applications |
| CN117354448A (en) * | 2023-12-06 | 2024-01-05 | 广东保伦电子股份有限公司 | Matrix switching system for video conference |
Also Published As
| Publication number | Publication date |
|---|---|
| CN119629296A (en) | 2025-03-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Sun et al. | A two-tier system for on-demand streaming of 360 degree video over dynamic networks | |
| US10021401B2 (en) | Analytic tool for managing distributed statistically multiplexed systems and method for using same | |
| US7382729B2 (en) | Video transmission of layered coded data | |
| US9660922B2 (en) | Network assisted rate shifting for adaptive bit rate streaming | |
| US6865426B1 (en) | Adaptive data security systems and methods | |
| US8400920B2 (en) | Method for optimizing the transfer of information in a telecommunication network | |
| CN113038187B (en) | A practical network bandwidth allocation method, device and medium for fair video experience quality | |
| CN105827633A (en) | Video transmission method and device | |
| US20230262232A1 (en) | Video coding method and apparatus, computer-readable medium and electronic device | |
| US20150110168A1 (en) | Video data transmission method and apparatus | |
| US11936698B2 (en) | Systems and methods for adaptive video conferencing | |
| JPH10164533A (en) | Image communication method and apparatus | |
| CN118803303A (en) | A dual-link video transmission method, system, device and storage medium | |
| WO2023155747A1 (en) | Data coding bitrate adaptive adjustment method, apparatus and device, and storage medium | |
| CN105898384B (en) | A kind of method and apparatus of streaming media video mixing frame per second control | |
| CN119629296B (en) | A matrix switching system for video conferencing | |
| CN116980662A (en) | Streaming media playing method, streaming media playing device, electronic equipment, storage medium and program product | |
| EP4131972B1 (en) | Video stream transmission control method and apparatus, device, and medium | |
| CN116962806A (en) | A video streaming transmission method, terminal device and storage medium | |
| Yan et al. | Research on QoE-driven panoramic video bit rate selection strategy under edge computing | |
| CN120201173B (en) | Picture frame rate synchronous control method and system for multiple projection devices | |
| CN118803320B (en) | A method, device and electronic device for transmitting cloud video stream | |
| US12192565B2 (en) | Transparency overlay method for virtual set top box, virtual set top box, and storage medium | |
| CN120499336A (en) | Control method and device for multipoint video conference | |
| JP3064315B2 (en) | Transmission line bandwidth management for packet switching networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |