[go: up one dir, main page]

CN115412702B - Conference terminal and video wall integrated equipment and system - Google Patents

Conference terminal and video wall integrated equipment and system

Info

Publication number
CN115412702B
CN115412702B CN202211057792.7A CN202211057792A CN115412702B CN 115412702 B CN115412702 B CN 115412702B CN 202211057792 A CN202211057792 A CN 202211057792A CN 115412702 B CN115412702 B CN 115412702B
Authority
CN
China
Prior art keywords
video
data
conference
audio
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211057792.7A
Other languages
Chinese (zh)
Other versions
CN115412702A (en
Inventor
刘忠勇
雷云斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Huawang Technology Co ltd
Original Assignee
Shenzhen Huawang Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Huawang Technology Co ltd filed Critical Shenzhen Huawang Technology Co ltd
Priority to CN202211057792.7A priority Critical patent/CN115412702B/en
Publication of CN115412702A publication Critical patent/CN115412702A/en
Application granted granted Critical
Publication of CN115412702B publication Critical patent/CN115412702B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/152Multipoint control units therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • H04N7/155Conference systems involving storage of or access to video conference sessions
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L2021/02082Noise filtering the noise being echo, reverberation of the speech

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Quality & Reliability (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明适用于视频会议技术领域,提供了一种会议终端与电视墙一体化装置及系统,该装置包括:主控系统,所述主控系统用于获取远程音视频数据、本地音视频数据以及会议相关数据;与所述主控系统通信连接的会议处理系统,用于接收所述主控系统发送的远程音视频数据、本地音视频数据以及会议相关数据,并进行对应处理后按照第一播放规则发送至音视频播放设备中,以对会议画面与会议音频进行播放;与所述主控系统通信连接的电视墙处理模块,用于接收所述主控系统发送的远程视频数据,并进行对应处理后按照第二播放规则发送至视频播放设备,以对电视墙画面进行播放。通过在一个设备中同时实现会议终端与电视墙功能,有效节省了用户成本,且安装简单。

The present invention is applicable to the field of video conferencing technology and provides an integrated device and system for a conference terminal and a TV wall. The device includes: a main control system for acquiring remote audio and video data, local audio and video data, and conference-related data; a conference processing system communicatively connected to the main control system for receiving remote audio and video data, local audio and video data, and conference-related data sent by the main control system, and performing corresponding processing and sending the data to an audio and video playback device in accordance with a first playback rule to play the conference screen and conference audio; a TV wall processing module communicatively connected to the main control system for receiving remote video data sent by the main control system, and performing corresponding processing and sending the data to a video playback device in accordance with a second playback rule to play the TV wall screen. By simultaneously realizing the functions of a conference terminal and a TV wall in one device, user costs are effectively saved and installation is simple.

Description

Conference terminal and video wall integrated equipment and system
Technical Field
The invention belongs to the technical field of conference video, and particularly relates to conference terminal and video wall integrated equipment and system.
Background
With the continuous development of digital networks and electronic information technologies, video conference systems are coming out and becoming popular, so that users can conveniently conduct online conferences and the like, and the use of users is greatly facilitated.
In a traditional video conference system, a conference terminal and a video wall are used as two different types of equipment, and are respectively used for solving the requirements of different types of application scenes. For example, in some large project applications, a conference terminal and a matched peripheral are generally configured in a conference room to realize audio/video interaction and communication with a main conference room, and the main conference room needs to be configured with the conference terminal to realize audio/video interaction and communication with the conference room, and a television wall device is also required to be configured for video monitoring and order supervision of all the conference rooms.
This results in the user having to purchase an additional set of video wall related equipment, which not only increases the cost of the user, but also makes the installation and use of the whole system more cumbersome and detrimental to the user experience.
Disclosure of Invention
The invention provides conference terminal and video wall integrated equipment and a system, and aims to solve the problems that in the prior art, the cost is high and the installation and the use are complicated because the video wall and the conference terminal are required to be arranged at the same time.
The invention is realized in such a way that a conference terminal and a video wall integrated device comprises:
the main control system is used for acquiring remote audio and video data, local audio and video data and conference related data;
The conference processing system is in communication connection with the main control system and is used for receiving remote audio and video data, local audio and video data and conference related data sent by the main control system, correspondingly processing the remote audio and video data, and sending the processed local audio and video data and conference related data to the audio and video playing equipment according to a first playing rule so as to play conference pictures and conference audios;
And the television wall processing system is in communication connection with the main control system and is used for receiving the remote video data sent by the main control system, correspondingly processing the remote video data and then sending the remote video data to video playing equipment according to a second playing rule so as to play the television wall picture.
In an embodiment, the apparatus comprises:
the audio acquisition module is in communication connection with the main control system and is used for acquiring local audio data;
and the video acquisition module is in communication connection with the main control system and is used for acquiring local video data.
In an embodiment, the apparatus further comprises:
and the communication module is in communication connection with the main control system and is used for establishing network connection with remote conference terminals of various conference sites participating in the conference so as to acquire remote audio and video data and conference related data sent by the remote conference terminals.
In one embodiment, the conference processing system includes:
The first video processing module is used for carrying out corresponding processing on the remote video data and the local video data;
The audio processing module is used for carrying out corresponding processing on the remote audio data and the local audio data;
and the data processing module is used for processing the conference related data.
In one embodiment, the television wall processing system comprises:
And the second video processing module is used for carrying out corresponding processing on the remote video data.
In an embodiment, the audio/video playing device includes a plurality of conference video displays and a voice playing device, and the conference processing system is configured to perform communication connection with the conference video displays through a video output interface, and send different video data to different conference video displays for display according to user requirements and types of the video data;
the conference processing system is also used for being in communication connection with the voice playing device through the voice output interface and used for playing voice through the voice playing device.
In an embodiment, the video playing device includes a video wall display, and the video wall processing system is configured to determine a split screen mode according to a user requirement or the number of remote video data, and perform split screen display in a playing interface of the video wall display according to the split screen mode.
In an embodiment, the apparatus comprises:
the noise reduction module is in communication connection with the main control system and is used for carrying out noise reduction treatment on the local audio data and the environmental noise in the remote language data;
and the echo cancellation module is in communication connection with the main control system and is used for canceling the echoes in the local audio data and the remote language data.
In an embodiment, the apparatus comprises:
the subtitle conversion module is used for respectively converting the local audio data and the remote audio data into subtitles;
And the translation module is used for translating the local audio data and the remote audio data into different languages and converting the different languages into subtitles in the corresponding languages through the subtitle conversion module so as to display the subtitles.
Audio data
In a second aspect, a conference terminal and video wall integrated system is provided, including:
The conference terminal and video wall integrated device is arranged at a main conference site and is used for performing audio/video interaction and supervision with each sub conference site;
And the conference terminals are respectively arranged at each conference site and are used for collecting remote audio and video data of each conference site and sending the remote audio and video data to the conference terminal and video wall integrated equipment.
The embodiment of the application provides a conference terminal and video wall integrated device and a system, wherein the conference terminal and video wall integrated device comprises a main control system, a conference processing system and a video wall processing system, wherein the main control system is used for acquiring remote audio and video data, local audio and video data and conference related data, the conference processing system is in communication connection with the main control system and is used for receiving the remote audio and video data, the local audio and video data and the conference related data which are transmitted by the main control system, correspondingly processing the remote audio and video data, the local audio and video data and the conference related data and transmitting the corresponding processed remote audio and video data to audio and video playing equipment according to a first playing rule so as to play a video wall picture. In the embodiment of the application, the conference terminal and the television wall function are realized in one device, so that the cost of a user is effectively saved, the installation is simple, the user can select to simultaneously open the conference terminal and the television wall function according to the needs, and only one of the conference terminal or the television wall function can be opened, so that various requirements of the user can be met, and the user experience is improved.
Drawings
Fig. 1 is a schematic structural diagram of a conference terminal and video wall integrated device according to an embodiment of the present application;
FIG. 2 is a schematic diagram of an interface display state according to an embodiment of the present application;
Fig. 3 is a schematic structural diagram of a conference terminal and video wall integrated system according to an embodiment of the present application.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1, an embodiment of the present application provides a conference terminal and video wall integrated device, including:
the main control system is used for acquiring remote audio and video data, local audio and video data and conference related data;
The conference processing system is in communication connection with the main control system and is used for receiving remote audio and video data, local audio and video data and conference related data sent by the main control system, correspondingly processing the remote audio and video data, and sending the processed local audio and video data and conference related data to the audio and video playing equipment according to a first playing rule so as to play conference pictures and conference audios;
And the television wall processing system is in communication connection with the main control system and is used for receiving the remote video data sent by the main control system, correspondingly processing the remote video data and then sending the remote video data to video playing equipment according to a second playing rule so as to play the television wall picture.
In the embodiment of the application, the main control system can comprise controllers such as a singlechip, a main control chip, an MCU and the like.
In the embodiment of the application, the remote audio and video data can specifically comprise audio data and video data of each sub-conference site, namely the remote audio data and the remote video data, and the audio and video data of conference personnel of each conference site can be specifically collected through conference terminals arranged at each sub-conference site.
In the embodiment of the application, the local audio/video data may include audio data and video data of a main conference site, i.e., local audio data and local video data.
In an embodiment of the present application, the conference related data may include document data, screen flow data, and the like.
In the embodiment of the application, after the main control module acquires the remote audio/video data, the local audio/video data and the conference related data, the main control module can determine the data sent to the conference processing system and the video wall processing system according to the conference requirement of the type of the data after preprocessing the remote audio/video data, the local audio/video data and the conference related data so as to display conference pictures and video wall pictures simultaneously.
In the embodiment of the application, the audio acquisition module is in communication connection with the main control system and is used for acquiring local audio data, and the video acquisition module is in communication connection with the main control system and is used for acquiring local video data. Specifically, the local audio and video data can be collected through the local audio collection module and the local video collection module and sent to the main control system to generate an audio file and a video file.
Further, the device may further include an audio source identification module configured to identify a main audio source of the current environment according to the image of the surrounding environment acquired by the video acquisition module, and the audio acquisition module is further configured to acquire an audio signal corresponding to the audio source identified by the audio source identification module. Under the condition that the number of participants is large, the voice of speaking or discussion in the environment is too loud, and the audio data of the current speaker cannot be correctly collected, so that the current speaker can be determined through the image collected by the video collection module, and the audio collection can be carried out through the audio collection module corresponding to the current speaker in a mode of closing or reducing the audio collection modules corresponding to other participants.
The audio acquisition module can be a wireless microphone, a wired microphone, a gooseneck microphone and the like. The audio acquisition module can comprise a plurality of audio acquisition modules which are respectively arranged around different participants and are used for acquiring audio data of the different participants
In an embodiment of the present application, the apparatus includes:
and the noise reduction module is in communication connection with the main control system and is used for carrying out noise reduction processing on the local audio data and the environmental noise in the remote audio data and removing the interference of the environmental noise on the audio data.
In the embodiment of the application, the equipment can also comprise an echo cancellation module which is in communication connection with the main control system and is used for canceling the echo in the local audio data and the remote audio data. To improve the fidelity of the sound.
In the embodiment of the application, the video acquisition module may include one or more video acquisition modules, for example, when the video acquisition module is one, the video acquisition module can be rotated to shoot each position of the meeting participants and the meeting place through omnibearing rotation, and shooting positions can be identified according to audio sources, for example, the current position to be shot is determined according to the sounds emitted by different meeting participants, and the video acquisition device is rotated to obtain corresponding pictures.
The video acquisition module can be a camera.
In the embodiment of the application, the device further comprises a communication module which is in communication connection with the main control system and is used for establishing network connection with the remote conference terminals of the conference sites participating in the conference so as to acquire remote audio and video data and conference related data sent by the remote conference terminals. So as to realize real-time bidirectional audio-video interaction.
The communication module may be a 4G communication module, a 5G, WIFI communication module, or the like.
The conference processing system comprises a first video processing module, an audio processing module and a data processing module, wherein the first video processing module is used for correspondingly processing remote video data and local video data, the audio processing module is used for correspondingly processing the remote audio data and the local audio data, and the data processing module is used for processing the conference related data.
The audio processing module is used for decoding the data through the audio decoding submodule after receiving the audio data, then placing each path of decoded audio data into each data buffer zone, taking out the data packet with the earliest time from each buffer zone queue by the audio synthesis submodule, mixing the audio data packets, and transmitting the mixed data to the voice playing equipment for playing.
The video rendering sub-module takes out data packets from each buffer area queue according to the sequence, decodes the data by the video decoding sub-module, and then renders each path of decoded video data to the video display area of the corresponding conference video display according to the current preset split screen mode.
The data processing module is used for firstly placing the data packets into a data buffer area queue when the received related data format is a video stream format, taking out the data packets from the buffer area queue according to the sequence by the data stream rendering sub-module, decoding the data by the video decoding sub-module, and rendering the decoded data stream to a data display area. If the received related data format is a picture format, the data stream rendering sub-module can directly render the picture to the data display area of the corresponding conference video display.
In the embodiment of the application, the television wall processing system comprises a second video processing module which is used for correspondingly processing the remote video data. The video rendering sub-module takes out data packets from each buffer area queue according to the sequence, decodes the data by the video decoding sub-module, and then renders each path of decoded video data to the video display area of the corresponding television wall picture respectively according to the currently set split screen mode.
In the embodiment of the application, the audio/video playing device comprises a plurality of conference video displays and a voice playing device, and the conference processing system is used for carrying out communication connection with the conference video displays through a video output interface and sending different video data to the different conference video displays according to the first playing rule for displaying.
The conference processing system is also used for being in communication connection with the voice playing device through the voice output interface and used for playing voice through the voice playing device.
Specifically, the conference processing system can put different video output pictures into a plurality of displays for playing according to different user requirements, conference project requirements and video types and numbers, for example, one path of video output displays a document or a screen stream data picture, the other path of video output displays video pictures of each conference site, or both paths of video output displays video pictures of different conference sites. To present data frames + interactive video frames, or main meeting place frames + interactive video frames,
The interactive video pictures can also be presented according to different split-screen modes, such as single split-screen, four split-screens, 16 split-screens and the like.
The voice output interface may include SDI, HDMI, DVI, CVBS, YPbPr or other interface formats.
The video output interface may include a plurality of interface forms such as HDMI, DVI, VGA, RGB, S terminals.
In the embodiment of the application, the video playing device comprises a television wall display, and the television wall processing system is used for determining a split screen mode according to the user requirement or the number of the remote video data and carrying out split screen display in a playing interface of the television wall display according to the split screen mode.
Specifically, the television wall subsystem can put television wall pictures into a plurality of displays for playing according to different user requirements and different project requirements in a way of outputting one or more paths of videos, and the displays can also display the television wall video pictures according to different split-screen modes, such as 16 split-screens, 25 split-screens, 36 split-screens, 64 split-screens and the like.
Further, the number of the split screens of the television wall processing system is larger than that of the conference system.
In embodiments of the present application, the television wall display may include a plurality of television wall displays.
In the embodiment of the application, the split screen mode can be switched according to the number of the participating users in real time, for example, in some scenes, the users with partial conference sites may have network delay or other conditions, so that the users gradually join in the conference after the conference starts, at this time, when the split screen interface of the television wall cannot meet the requirement of presenting all the video of the conference sites, the split screen module can be replaced, and when the split screen mode is maximum, that is, the number of split screens reaches the limit, at this time, another television wall display can be started for displaying the television wall interface.
In the embodiment of the application, the remote video data can also comprise terminal identifiers, each split screen interface in the television wall can respectively establish a mapping relation with the identifiers of different participant terminals, and when the corresponding video data is acquired, the corresponding split screen interface can be used for displaying.
In the implementation of the application, the video data displayed on each split screen interface in the video wall can be determined according to the sequence of joining the conference by different joining user terminals, the video data of the first joining user terminal is displayed on the first split screen interface, the video data of the second joining user terminal is displayed on the second split screen interface, and the like until all the video data are displayed.
In the embodiment of the application, the conference terminal and video wall integrated equipment can further comprise a subtitle conversion module, wherein the subtitle conversion module is used for converting local audio data and remote audio data into subtitles and outputting the subtitles corresponding to corresponding video pictures, so that the current conference content can be known by watching the subtitles when the environment is noisy and the voice of a user cannot be heard.
Further, the caption may include multi-language captions, for example, chinese, english, etc., and the apparatus may further include a translation module for translating the local audio data and the remote audio data into different languages, that is, translating the voices output by each user participating in the conference into different voices, and forming captions corresponding to the different languages through the caption module, so as to synchronously display the captions in different video display interfaces, thereby realizing communication between multiple languages and improving interaction fluency.
In the embodiment of the application, the device further comprises a video recording module for recording and storing the remote audio and video data and the local audio and video data, and the device can be directly called when the meeting needs to be tidied and other led so as to trace back the meeting.
The embodiment of the application provides a conference terminal and video wall integrated device which comprises a main control system, a conference processing system and a video wall processing system, wherein the main control system is used for acquiring remote audio and video data, local audio and video data and conference related data, the conference processing system is in communication connection with the main control system and is used for receiving the remote audio and video data, the local audio and video data and the conference related data which are transmitted by the main control system, correspondingly processing the remote audio and video data, the local audio and video data and the conference related data and then transmitting the corresponding processed remote audio and video data, the local audio and video data and the conference related data to audio and video playing equipment according to a first playing rule so as to play conference pictures and conference audios, and the video wall processing system is in communication connection with the main control system and is used for receiving the remote video data transmitted by the main control system and correspondingly processing the remote video data and then transmitting the remote video data to the video playing equipment according to a second playing rule so as to play video wall pictures. In the embodiment of the application, the conference terminal and the television wall function are realized in one device, so that the cost of a user is effectively saved, the installation is simple, the user can select to simultaneously open the conference terminal and the television wall function according to the needs, and only one of the conference terminal or the television wall function can be opened, so that various requirements of the user can be met, and the user experience is improved.
In an embodiment of the application, a conference terminal and video wall integrated system is also provided, which comprises the conference terminal and video wall integrated device, a plurality of conference terminals respectively arranged at each conference site and the conference terminal and video wall integrated device, and a plurality of conference terminals respectively arranged at each conference site and the conference terminal and video wall integrated device, wherein the conference terminal and video wall integrated device is arranged at a main conference site and used for performing audio-video interaction and supervision with each conference site, and the conference terminals are used for acquiring remote audio-video data of each conference site and sending the remote audio-video data to the conference terminal and video wall integrated device for displaying. The video interaction between the main meeting place and each sub meeting place can be realized, and the interaction video picture can be displayed.
The conference terminal can comprise an audio acquisition unit and a video acquisition unit, and is used for acquiring audio and video data of different sub-conference sites, and the conference terminal and video wall integrated equipment can acquire audio and video data of a main conference site and can send the audio and video data to the conference terminal, so that bidirectional audio and video interaction is realized.
In the embodiment of the application, the system also comprises a control device for switching, scaling, deleting and the like the played picture, and the device can be started and closed. For example, when a person in a certain conference room is reporting, the video image of the conference room may be enlarged in the conference display interface or moved to a central position for display, so that the person may watch it with emphasis.
The control device can be a touch device, such as a mobile phone, a tablet computer and the like, and controls the conference terminal and the integrated device through a touch instruction input by a user.
The application can simultaneously realize the conference terminal and the television wall function in one system, effectively saves the cost of users, has simple installation, can select to simultaneously start the conference terminal and the television wall function according to the needs, can also only start one of the conference terminal or the television wall function, can meet various requirements of the users, and improves the user experience.
The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, and alternatives falling within the spirit and principles of the invention.

Claims (6)

1. A conference terminal and video wall integrated device, the device comprising:
the main control system is used for acquiring remote audio and video data, local audio and video data and conference related data;
The conference processing system is in communication connection with the main control system and is used for receiving remote audio and video data, local audio and video data and conference related data sent by the main control system, correspondingly processing the remote audio and video data, and sending the processed local audio and video data and conference related data to the audio and video playing equipment according to a first playing rule so as to play conference pictures and conference audios;
The television wall processing system is in communication connection with the main control system and is used for receiving the remote video data sent by the main control system, correspondingly processing the remote video data and then sending the remote video data to video playing equipment according to a second playing rule so as to play television wall pictures;
the audio acquisition module is in communication connection with the main control system and is used for acquiring local audio data;
the video acquisition module is in communication connection with the main control system and is used for acquiring local video data;
The audio source identification module is used for identifying a main audio source of the current environment according to the images of the surrounding environment acquired by the video acquisition module, acquiring an audio signal corresponding to the audio source identified by the audio source identification module, and rotating the video acquisition module according to the audio source identified by the audio source so as to determine a shooting direction;
The audio/video playing device comprises a plurality of conference video displays and voice playing devices, and the conference processing system comprises an audio processing module, a data buffer area and a voice processing module, wherein the audio processing module is used for decoding data through an audio decoding sub-module after receiving audio data, and then placing each path of decoded audio data into the respective data buffer area; taking out the data packets with earliest time from each buffer area queue by the audio synthesis submodule, mixing the audio data packets, and transmitting the mixed data to the voice playing equipment for playing; the system comprises a first video processing module, a video rendering sub-module, a data processing module, a data stream rendering sub-module, a video display sub-module and a video display sub-module, wherein the first video processing module is used for firstly putting each path of video data into a respective data buffer area after receiving remote video data and/or local video data, the video rendering sub-module sequentially takes out data packets from each buffer area queue, decodes the data by the video decoding sub-module, and then respectively renders each path of decoded video data to a video display area of a corresponding conference video display according to a preset split screen mode;
The video rendering sub-module takes out data packets from each buffer area queue according to the sequence, decodes the data by the video decoding sub-module, and then renders each path of decoded video data to the video display area of the corresponding video wall picture respectively according to the currently set split screen mode;
The video playing device comprises a video wall display, wherein the video wall processing system is used for determining a split screen mode according to user requirements or the number of remote video data, performing split screen display in a playing interface of the video wall display according to the split screen mode, switching according to the number of the participating user terminals in real time, starting another video wall display to display the video wall interface when the split screen mode is maximum, determining the video data displayed on each split screen interface in the video wall according to the sequence of joining conferences of different participating user terminals, displaying the video data of the first joining user terminal on a first split screen interface, displaying the video data of the second joining user terminal on a second split screen interface, and the like until all the video data are displayed.
2. The conference terminal and video wall integrated device of claim 1, wherein the device further comprises:
And the communication module is in communication connection with the master control system and is used for establishing network connection with remote conference terminals of various conference sites participating in the conference so as to acquire the remote audio/video data and conference related data sent by the remote conference terminals.
3. The conference terminal and video wall integrated device according to claim 2, wherein the conference processing system is configured to perform communication connection with the conference video display through a video output interface, and send different video data to different conference video displays for display according to user requirements and types of video data;
the conference processing system is also used for being in communication connection with the voice playing device through the voice output interface and used for playing voice through the voice playing device.
4. The conference terminal and video wall integrated apparatus of claim 1, wherein the apparatus comprises:
the noise reduction module is in communication connection with the main control system and is used for carrying out noise reduction treatment on the remote audio data and the environmental noise in the local audio data;
And the echo cancellation module is in communication connection with the main control system and is used for canceling the echoes in the local audio data and the remote audio data.
5. The conference terminal and video wall integrated apparatus of claim 1, wherein the apparatus comprises:
the subtitle conversion module is used for respectively converting the local audio data and the remote audio data into subtitles;
And the translation module is used for translating the local audio data and the remote audio data into different languages and converting the different languages into subtitles in the corresponding languages through the subtitle conversion module so as to display the subtitles.
6. A conference terminal and video wall integrated system, the system comprising:
The conference terminal and video wall integrated device according to any one of claims 1-5, wherein the conference terminal and video wall integrated device is arranged at a main conference site and is used for performing audio-video interaction and supervision with each sub conference site;
And the conference terminals are respectively arranged at each conference site and are used for collecting remote audio and video data of each conference site and sending the remote audio and video data to the conference terminal and video wall integrated equipment.
CN202211057792.7A 2022-08-31 2022-08-31 Conference terminal and video wall integrated equipment and system Active CN115412702B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211057792.7A CN115412702B (en) 2022-08-31 2022-08-31 Conference terminal and video wall integrated equipment and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211057792.7A CN115412702B (en) 2022-08-31 2022-08-31 Conference terminal and video wall integrated equipment and system

Publications (2)

Publication Number Publication Date
CN115412702A CN115412702A (en) 2022-11-29
CN115412702B true CN115412702B (en) 2025-08-01

Family

ID=84164495

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211057792.7A Active CN115412702B (en) 2022-08-31 2022-08-31 Conference terminal and video wall integrated equipment and system

Country Status (1)

Country Link
CN (1) CN115412702B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117768726B (en) * 2023-05-19 2024-09-20 深圳火山视觉技术发展有限公司 Intelligent media playing control system and audio and video display method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1816134A (en) * 2005-02-06 2006-08-09 中兴通讯股份有限公司 Multi-spot video conference system and media processing method
CN104954729A (en) * 2014-03-31 2015-09-30 鸿富锦精密工业(深圳)有限公司 Video conference data processing method and system
CN106101734A (en) * 2016-06-15 2016-11-09 广州科技职业技术学院 The net cast method for recording of interaction classroom and system
CN114071059A (en) * 2021-11-10 2022-02-18 中铁建工集团山东有限公司 A wireless video conference system for intelligent building construction management

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101820524A (en) * 2010-03-22 2010-09-01 中兴通讯股份有限公司 Video display method for video conference
CN203071964U (en) * 2012-12-28 2013-07-17 上海良讯科技有限公司 Extended multi-screen display system used in video conference
CN104202539A (en) * 2014-09-17 2014-12-10 北京中科先拓科技发展有限公司 Tiled screen meeting display method
CN205320192U (en) * 2015-12-02 2016-06-15 江苏省电力公司信息通信分公司 Videoconference's intelligence control system
CN107172093A (en) * 2017-07-04 2017-09-15 合肥市乐腾科技咨询有限公司 Video conference data processing method and system
CN208739283U (en) * 2018-08-21 2019-04-12 云南电网有限责任公司 Video conference content and quality detection apparatus
CN111050104A (en) * 2019-12-13 2020-04-21 安徽文香信息技术有限公司 Cloud recording and broadcasting system, method and device
CN111464803B (en) * 2020-04-16 2022-04-12 中国长城科技集团股份有限公司 Display control system
CN112073674A (en) * 2020-08-07 2020-12-11 广东迷听科技有限公司 A conference terminal, remote video conference system, method and storage medium
CN212696104U (en) * 2020-08-27 2021-03-12 北京文香信息技术有限公司 Audio and video conference recording and broadcasting system
US11431665B1 (en) * 2021-03-03 2022-08-30 Microsoft Technology Licensing, Llc Dynamically controlled permissions for managing the communication of messages directed to a presenter
KR102326212B1 (en) * 2021-05-25 2021-11-12 김우영 Non-face-to-face online and offline video conference system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1816134A (en) * 2005-02-06 2006-08-09 中兴通讯股份有限公司 Multi-spot video conference system and media processing method
CN104954729A (en) * 2014-03-31 2015-09-30 鸿富锦精密工业(深圳)有限公司 Video conference data processing method and system
CN106101734A (en) * 2016-06-15 2016-11-09 广州科技职业技术学院 The net cast method for recording of interaction classroom and system
CN114071059A (en) * 2021-11-10 2022-02-18 中铁建工集团山东有限公司 A wireless video conference system for intelligent building construction management

Also Published As

Publication number Publication date
CN115412702A (en) 2022-11-29

Similar Documents

Publication Publication Date Title
US10788963B2 (en) Accelerated instant replay for co-present and distributed meetings
EP1449369B1 (en) A system and method for providing an awareness of remote people in the room during a videoconference
US6795106B1 (en) Method and apparatus for controlling a video camera in a video conferencing system
CN102006453B (en) Superposition method and device for auxiliary information of video signals
US9179100B2 (en) Video conferencing method and device thereof
US8379075B2 (en) Method, device, and computer-readable medium for processing images during video conferencing
PT2154885E (en) A caption display method and a video communication control device
CN108924469B (en) Display picture switching transmission system, intelligent interactive panel and method
CN113132671B (en) Video conference system
JPH07336660A (en) Video conference system
CN113132670A (en) Video conference system
WO2014094461A1 (en) Method, device and system for processing video/audio information in video conference
CN118524192B (en) A portable mobile shooting terminal multi-channel display and directing method
CN109753259B (en) Screen projection system and control method
CN115412702B (en) Conference terminal and video wall integrated equipment and system
US20230283888A1 (en) Processing method and electronic device
CN111107301A (en) A video conference platform and a communication method based on the video conference platform
JP2001268078A (en) Communication controller, its method, providing medium and communication equipment
US5675512A (en) Low-cost room-based video conferencing systems
US20190238792A1 (en) Conversion device, connection conference system and connection conference method
TWI636691B (en) Video picture intelligent switching method and system thereof
CN105208319B (en) Conference terminal and system
CN212256592U (en) Double-screen teaching system based on education all-in-one machine
JP2003339034A (en) Network conference system, network conference method, and network conference program
JP4568442B2 (en) Video conference system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant