CN117812217A - An intelligent paperless conference control and management platform - Google Patents
An intelligent paperless conference control and management platform Download PDFInfo
- Publication number
- CN117812217A CN117812217A CN202410036160.5A CN202410036160A CN117812217A CN 117812217 A CN117812217 A CN 117812217A CN 202410036160 A CN202410036160 A CN 202410036160A CN 117812217 A CN117812217 A CN 117812217A
- Authority
- CN
- China
- Prior art keywords
- module
- screen
- mobile terminal
- sharing
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/161—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/164—Adaptation or special uses of UDP protocol
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明涉及一种无纸化会议管理平台，具体地说，涉及一种智能无纸化会议控制与管理平台。其包括控制终端包括通信模块、处理单元和投屏模块；控制终端与移动端通过通信模块进行通信，并将移动端投屏数据传输给处理单元，移动端包括若干移动设备，移动设备至少包括共享模块，共享模块用于向控制终端发送数据共享请求指令；投屏指令确认模块用于接收并确认投屏模块的投屏共享请求；互联模块基于共享决策模型实现若干移动设备之间的数据交互。通过引入自适应阈值，对差异传输算法的优化，通过优化像素数据的传输，减少传输数据量，提高了视频压缩和传输的效率，大幅减少对网络带宽的需求，提高了视频传输的速度和质量。
The invention relates to a paperless conference management platform, specifically, to an intelligent paperless conference control and management platform. It includes a control terminal including a communication module, a processing unit and a screen projection module; the control terminal communicates with the mobile terminal through the communication module, and transmits the mobile terminal screen projection data to the processing unit. The mobile terminal includes several mobile devices, and the mobile device at least includes a shared screen. Module, the sharing module is used to send data sharing request instructions to the control terminal; the screen casting instruction confirmation module is used to receive and confirm the screen sharing request of the screen casting module; the interconnection module implements data interaction between several mobile devices based on the shared decision-making model. By introducing adaptive thresholds and optimizing the differential transmission algorithm, by optimizing the transmission of pixel data, the amount of transmitted data is reduced, the efficiency of video compression and transmission is improved, the demand for network bandwidth is significantly reduced, and the speed and quality of video transmission are improved. .
Description
Technical Field
The invention relates to a paperless conference management platform, in particular to an intelligent paperless conference control and management platform.
Background
The intelligent paperless conference is a conference form which digitizes and intellectuzes conference scenes by utilizing advanced technology, aims at enabling the conference to be more efficient and convenient through a digitizing tool and an intelligent platform, reduces dependence on paper files, provides a remote conference function, supports video conference, real-time interaction and remote participation, promotes interaction and communication among participants, supports screen throwing control, realizes that mobile terminal content is thrown on a large screen device or other display devices, displays conference data and content, reduces paper file use, improves instantaneity and accessibility of conference information, and promotes communication and cooperation among the participants through remote participation, real-time interaction and instant sharing of information.
However, when video conference, real-time interaction or screen-throwing control is performed, the amount of data to be transmitted gradually increases with the increase of participants, at this time, there is a higher requirement on the stability of the network, and when the participants are more, the problem of video transmission interruption or screen-jamming may occur, especially when the network burden is larger for the scene requiring real-time communication and high-quality video, so an intelligent paperless conference control and management platform is designed.
Disclosure of Invention
The invention aims to provide an intelligent paperless conference control and management platform, which is used for solving the problems that video transmission is interrupted or pictures are blocked when a large number of participants are involved in the background technology, and the network burden is large.
In order to achieve the above purpose, the invention aims to provide an intelligent paperless conference control and management platform which comprises a control terminal, a mobile terminal and a display terminal, wherein the control terminal comprises a communication module, a processing unit and a screen throwing module;
the control terminal is communicated with the mobile terminal through the communication module, screen projection data of the mobile terminal are transmitted to the processing unit, the processing unit performs coding optimization on the screen projection data of the mobile terminal based on a difference transmission algorithm, the optimized screen projection data are transmitted to the screen projection module, and the screen projection module projects the screen projection data of the mobile terminal to the display terminal for display; the communication module is based on the Wi-F i module, realizes communication between the control terminal and the mobile terminal through a local area network, establishes a TCP/IP connection protocol for data transmission, and provides a faster data transmission speed and a larger coverage area by the Wi-F i module.
The mobile terminal comprises a plurality of mobile devices, and the mobile devices at least comprise:
the sharing module is used for sending a data sharing request instruction to the control terminal; after the control terminal receives the shared content of the mobile device a, the control terminal can send the content to other mobile devices through the screen throwing module, and the other mobile devices select whether to receive and display the screen throwing content through the screen throwing instruction confirmation module;
the screen throwing instruction confirmation module is used for receiving and confirming a screen throwing sharing request of the screen throwing module;
the interconnection module is used for realizing interconnection communication among a plurality of mobile devices based on local area network interconnection, the mobile terminals need to be connected into the same local area network, any one of TCP/IP, UDP or HTTP communication protocols is selected for data transmission among the mobile terminals, the interconnection module is used for realizing data interaction among a plurality of mobile devices based on a sharing decision model, and the data interconnection specifically comprises screen data sharing and conference text information.
The display terminal is used for displaying the content to be projected on the screen of the mobile terminal, and the display terminal is large-screen display equipment or other display equipment.
As a further improvement of the technical scheme, the processing unit at least comprises a device coordination module and a data processing module;
the device coordination module receives screen projection data from different mobile devices based on a conference strategy algorithm, coordinates screen projection requests initiated by the different mobile devices, and processes the screen projection requests according to the priority of the screen projection instructions of the mobile devices; receiving feedback information about the priority of the equipment from the equipment coordination module, and dynamically adjusting an optimization algorithm and parameters of the data processing module according to the feedback; and dynamically adjusting the priority of the equipment according to the activity condition of the equipment in the conference, the user operation or the system strategy.
The data processing module optimizes the screen projection data based on a differential transmission algorithm.
As a further improvement of the technical scheme, the conference policy algorithm specifically comprises:
P a ＝P o +W s ×(D s -0.5)；
wherein D is s Indicating whether the device is the current speaker, a flag, typically binary, 1 indicating that it is the current speaker, 0 indicating that it is not; 0.5 represents a central value; p (P) a Indicating adjusted device priority, P o Representing the original priority of the device; w (W) s Representing a weight associated with the current speaker device for adjusting the priority of the speaker device, the degree of influence of the speaker device on the device priority in the progress of the conference; if the device is the current speaker, its priority may be adjusted up or down accordingly, the priority of the device may be adjusted according to the progress of the current conference, the current speaker device may obtain a higher priority to ensure that the primary speaker in the conference can communicate information more clearly, flexible design may be performed according to the importance of the speaker device, and ensuring that the speaker device can obtain the proper priority in the conference.
As a further improvement of the technical scheme, the specific steps of the differential transmission algorithm for carrying out coding optimization on the screen projection data of the mobile terminal are as follows:
s4.1, for continuous video frames, determining the change pixel data to be transmitted by calculating the difference of pixel values between adjacent frames;
s4.2, recoding pixels exceeding a threshold value through differential coding, and transmitting the recoded pixels to a receiving end for decoding and reconstruction;
s4.3, finding out motion information between two frames through a motion estimation algorithm to obtain a pixel-level motion vector; the motion vector describes the displacement of the pixel in time;
specifically, the motion estimation algorithm specifically adopts a block matching algorithm, and the specific calculation formula is as follows:
wherein MV (x, y) represents a motion vector of a pixel point having coordinates (x, y) in the image; n represents the block size; arg min represents a parameter value that minimizes the objective function; Δx, Δy represents the offset relative to the current block during the search; i and j represent indexes for traversing pixels within a block; i 1 (x+i, y+j) represents the value of the pixel within the block in the reference frame; i 2 (x+Δx+i, y+Δy+j) represents the value of the intra-block pixel in the frame to be searched (target frame);
the block matching algorithm described above finds the offset that minimizes the Mean Square Error (MSE) during the search to obtain the best motion vector, representing the motion or displacement between adjacent frames.
S4.4, correcting the current frame by using a motion vector so as to compensate pixel information of a previous frame and reconstruct an image of a receiving end, wherein the motion vector is the value of MV (x, y) in the step S4.3, and the motion vector is used for correcting the current frame so as to compensate the pixel information of the previous frame, so that the image of the receiving end can be reconstructed, and the data quantity required to be transmitted is reduced by motion compensation, thereby improving the efficiency of image transmission.
As a further improvement of the present technical solution, the difference transmission algorithm is used for measuring pixel differences between adjacent frames, specifically:
wherein I is 1 (i) And I 2 (i) Gray values respectively representing corresponding pixel positions in two adjacent frames refer to pixel values of the same position in the adjacent frames or images; n represents the total number of pixels, i.e. the number of pixels in the image;
the adaptive threshold is introduced into the calculation of the differential transmission algorithm, the variable threshold is adapted by adjusting the differential measurement, the differential measurement is dynamically adjusted according to the adaptive threshold, and the pixels can be more flexibly controlled to be considered as important changes, so that the change information in the image is better captured, the optimization of the differential transmission algorithm is realized, and the specific algorithm after the optimization is as follows:
wherein f (I) 1 (i)，I 2 (i) Representing an adaptive function representing the contribution of the pixel to the difference metric, adjusted according to the characteristics of the pixel and an adaptive threshold.
As a further improvement of the technical scheme, the sharing decision model coordinates sharing requests among a plurality of mobile terminals based on a sharing coordination algorithm, and if there are N mobile terminals, the probability that each mobile terminal i sends a sharing request isThe specific coordination steps are as follows:
s6.1, calculating the total probability P of the sharing request sent by all the mobile terminals al ；
S6.2, at an initial time (i.e. t=0), setting an initial resource allocation weight for each mobile terminal i
Initial resource allocation weightsDefining the resource allocation condition of the system to each mobile terminal at the beginning;
s6.3, monitoring the request probability of each mobile terminal i at each time point tWhether a change occurs; if the request probability changes, the change of the use mode, the requirement or the behavior of the mobile terminal is implied, so that the system can sense and adapt to the change more timely, and the requirement of a user can be met better.
S6.4 based on total probability P al For each mobile terminal i, at each time point t, calculating the resource allocation weight of the mobile terminal i at the time t according to a sharing coordination algorithm
S6.5, according to the resource allocation weight of each mobile terminal at the current time pointAnd performing resource allocation and processing.
As a further improvement of the technical scheme, the sharing coordination algorithm specifically comprises:
wherein,a resource allocation weight of the mobile terminal i at time t is represented; α represents an exponentially weighted moving average coefficient, typically between 0 and 1, that controls the degree of influence of the new request, determining the relative importance of the probability of the new request and the previous weights;The request probability of the mobile terminal i at time t is represented as the probability of the terminal i sending out a sharing request at the current time point;the resource allocation weight of the mobile terminal i at the time t-1 is indicated, and the weight is allocated to the resource at the last time point and used for influencing the weight allocation at the current time point.
As a further improvement of the technical scheme, the sharing module comprises a region capturing module, a screen capturing module and a request module;
the region capturing module is used for capturing the screen region of the mobile device in a self-defined mode, and selective content sharing is achieved;
the screen capturing module is used for capturing the whole screen area of the mobile equipment and realizing the whole content sharing of the mobile equipment;
and sending the captured data of the region capturing module or the screen capturing module to a control terminal through a request module for data sharing, wherein the request module and the control terminal perform data interaction through a communication module.
As a further improvement of the technical scheme, the screen throwing instruction confirmation module is used for receiving a screen throwing sharing request from the screen throwing module, and after receiving the screen throwing request, the mobile terminal selects to receive the sharing data or refuses to share the data through the screen throwing instruction confirmation module.
As a further improvement of the technical scheme, the mobile device further comprises a conference sign-in module and a conference annotating module;
the conference sign-in module is used for signing in through the mobile equipment when conference participants arrive at a conference site;
the meeting annotation module is used for allowing participants to add text annotations on meeting documents and shared content of the mobile device.
Compared with the prior art, the invention has the beneficial effects that:
1. in the intelligent paperless conference control and management platform, the self-adaptive threshold is introduced to better capture the change information in the image according to the screen-throwing sharing requirement in the paperless conference, so that the optimization of a differential transmission algorithm is realized, the transmission of pixel data is optimized, the transmission data amount is reduced, the video compression and transmission efficiency is improved, the requirement on network bandwidth is greatly reduced, and the video transmission speed and quality are improved.
2. In the intelligent paperless conference control and management platform, aiming at priority processing and resource allocation of different devices, sharing requests among a plurality of mobile terminals are dynamically coordinated based on a sharing coordination algorithm, so that dynamic allocation of resources is realized, and users are more likely to obtain stable and efficient sharing experience when sharing by using the mobile terminals.
Drawings
FIG. 1 is an overall flow diagram of the present invention;
fig. 2 is a flow chart of a mobile device of the present invention.
The meaning of each reference sign in the figure is:
1. a control terminal; 11. a communication module; 12. a processing unit; 13. a screen throwing module; 2. a mobile terminal; 21. a sharing module; 22. a screen throwing instruction confirmation module; 23. an interconnection module; 24. a conference sign-in module; 25. a conference annotating module; 3. and displaying the terminal.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Examples
Referring to fig. 1-2, an intelligent paperless conference control and management platform is provided, which comprises a control terminal 1, a mobile terminal and a display terminal 3, wherein the control terminal 1 comprises a communication module 11, a processing unit 12 and a screen projection module 13;
the display terminal 3 is used for displaying the content to be projected by the mobile terminal, and the display terminal 3 is a large-screen display device or other display devices.
The control terminal 1 communicates with the mobile terminal through the communication module 11, and transmits screen projection data of the mobile terminal to the processing unit 12, the processing unit 12 performs coding optimization on the screen projection data of the mobile terminal based on a difference transmission algorithm, the optimized screen projection data are transmitted to the screen projection module 13, and the screen projection module 13 projects the screen projection data of the mobile terminal to the display terminal 3 for display; the communication module 11 is based on a Wi-Fi module, so that communication between the control terminal 1 and the mobile terminal 2 through a local area network is realized, a TCP/IP connection protocol is established for data transmission, and the Wi-Fi module provides a faster data transmission speed and a larger coverage area.
In this embodiment, the specific steps of performing coding optimization on the screen projection data of the mobile terminal through the differential transmission algorithm are as follows:
s4.1, for continuous video frames, determining the change pixel data to be transmitted by calculating the difference of pixel values between adjacent frames;
s4.2, recoding pixels exceeding a threshold value through differential coding, and transmitting the recoded pixels to a receiving end for decoding and reconstruction;
s4.3, finding out motion information between two frames through a motion estimation algorithm to obtain a pixel-level motion vector; wherein the motion vector describes the displacement of the pixel in time;
in this embodiment, the motion estimation algorithm specifically adopts a block matching algorithm, and its specific calculation formula is as follows:
wherein MV (x, y) represents a motion vector of a pixel point having coordinates (x, y) in the image; n represents the block size; argmin represents a parameter value that minimizes the objective function; Δx, Δy represents the offset relative to the current block during the search; i and j represent indexes for traversing pixels within a block; i 1 (x+i, y+j) represents the value of the pixel within the block in the reference frame; i 2 (x+Δx+i，y+Δy+j) represents the value of the pixel in the middle block of the target frame to be searched;
the block matching algorithm described above finds the offset that minimizes the Mean Square Error (MSE) during the search to obtain the best motion vector, representing the motion or displacement between adjacent frames.
And S4.4, correcting the current frame by using the motion vector, so as to compensate pixel information of the previous frame, and reconstructing an image of the receiving end. The motion vector is the value of MV (x, y) in the step S4.3, and is used for correcting the current frame so as to compensate the pixel information of the previous frame, thus the image of the receiving end can be reconstructed, and the data quantity required to be transmitted is reduced through motion compensation, thereby improving the efficiency of image transmission.
The coding optimization step reduces the transmitted data volume and improves the video compression and transmission efficiency by transmitting only the changed pixel information and the motion vector.
The difference transmission algorithm is used for measuring pixel differences between adjacent frames, and specifically comprises the following steps:
wherein I is 1 (i) And I 2 (i) Gray values respectively representing corresponding pixel positions in two adjacent frames refer to pixel values of the same position in the adjacent frames or images; n represents the total number of pixels, i.e. the number of pixels in the image;
the adaptive threshold is introduced into the calculation of the differential transmission algorithm, the variable threshold is adapted by adjusting the differential measurement, the differential measurement is dynamically adjusted according to the adaptive threshold, and the pixels can be more flexibly controlled to be considered as important changes, so that the change information in the image is better captured, the optimization of the differential transmission algorithm is realized, and the specific algorithm after the optimization is as follows:
wherein f (I) 1 (i)，I 2 (i) Representing an adaptive function representing the contribution of the pixel to the difference metric, adjusted according to the characteristics of the pixel and an adaptive threshold.
By introducing an adaptive threshold, which pixels are considered as important changes can be controlled more flexibly, so that change information in an image is captured better, and the optimization of a differential transmission algorithm is realized.
By transmitting the motion vector and reconstructing the frame, the receiving end can restore the original picture more accurately, and the problem of blurring or distortion of the picture in the transmission process is avoided. By transmitting only the changed pixel data and motion vectors, rather than the entire picture, the amount of data that needs to be transmitted is greatly reduced. This helps to reduce network load, reduce bandwidth requirements, and more smoothly transfer video content, especially in the case of poor network conditions or limited bandwidth, with an optimized coding scheme resulting in faster transfer speeds and shorter response times. The method is beneficial to realizing real-time video transmission, reduces transmission delay and improves user experience, and is particularly important for conferences requiring instant communication and interaction.
In this embodiment, the mobile terminal includes a plurality of mobile devices, and the mobile devices at least include a sharing module 21, where the sharing module 21 is configured to send a data sharing request instruction to the control terminal 1; after receiving the shared content of the mobile device a, the control terminal 1 can send the content to other mobile devices through the screen projection module 13, and the other mobile devices select whether to receive and display the screen projection content through the screen projection instruction confirmation module 22;
further, the sharing module 21 includes a region capturing module, a screen capturing module, and a request module;
the region capturing module is used for capturing the screen region of the mobile device in a self-defined mode, and selective content sharing is achieved;
the screen capturing module is used for capturing the whole screen area of the mobile equipment and realizing the whole content sharing of the mobile equipment;
and sending a data sharing request to the control terminal 1 through a request module by capturing data of the region capturing module or the screen capturing module, wherein the request module and the control terminal 1 perform data interaction through a communication module.
The mobile device further comprises a screen-throwing instruction confirmation module 22, wherein the screen-throwing instruction confirmation module 22 is used for receiving and confirming a screen-throwing sharing request of the screen-throwing module 13; the screen-throwing instruction confirmation module 22 is configured to receive a screen-throwing sharing request from the screen-throwing module 13, and after receiving the screen-throwing request, the screen-throwing instruction confirmation module 22 verifies validity and accuracy of the request, and the mobile terminal 2 selects to receive the sharing data or refuses to share the data through the screen-throwing instruction confirmation module 22.
After the screen-throwing instruction confirmation module 22 confirms and passes the screen-throwing sharing request, the mobile device receives the screen-throwing data from the screen-throwing module 13;
when the screen shot instruction confirmation module 22 refuses the screen shot sharing request, the mobile device can perform independent operation.
The screen-throwing instruction confirming module 22 performs data interaction with the control terminal 1 through the communication module 11, and sends confirmation information to the control terminal 1 so that the control terminal 1 knows which mobile devices can throw screen contents onto the display terminal 3.
The mobile device further comprises an interconnection module 23, the interconnection module 23 is used for realizing interconnection communication among a plurality of mobile devices based on local area network interconnection, the mobile terminal 2 needs to be connected to the same local area network, any one of TCP/IP, UDP or HTTP communication protocols is selected for data transmission among the mobile terminals 2, the interconnection module 23 is used for realizing data interaction among a plurality of mobile devices based on a sharing decision model, and the data interconnection specifically comprises screen data sharing and conference text information sharing.
Still further, in the present embodiment, the processing unit 12 includes at least a device coordination module and a data processing module; the device coordination module receives screen projection data from different mobile devices based on a conference strategy algorithm, coordinates screen projection requests initiated by the different mobile devices, and processes the screen projection requests according to the priority of the screen projection instructions of the mobile devices; receiving feedback information about the priority of the equipment from the equipment coordination module, and dynamically adjusting an optimization algorithm and parameters of the data processing module according to the feedback; and dynamically adjusting the priority of the equipment according to the activity condition of the equipment in the conference, the user operation or the system strategy.
The data processing module optimizes the screen projection data based on a differential transmission algorithm.
The mobile device further comprises a conference sign-in module 24 and a conference annotating module 25;
wherein the conference check-in module 24 is used for checking in by the mobile device when the conference participant arrives at the conference site;
conference endorsement module 25 is used to allow participants to add text endorsements on the conference documents and shared content of the mobile device.
The sign-in module is helpful for counting the attendance and managing the participants, and the annotating module supports content marking, communication and discussion in the conference process.
Specifically, the conference policy algorithm specifically includes:
P a ＝P o +W s ×(D s -0.5)；
wherein D is s Indicating whether the device is the current speaker, a flag, typically binary, 1 indicating that it is the current speaker, 0 indicating that it is not; 0.5 represents a central value; p (P) a Indicating adjusted device priority, P o Representing the original priority of the device; w (W) s Representing a weight associated with the current speaker device for adjusting the priority of the speaker device, the degree of influence of the speaker device on the device priority in the progress of the conference; if the device is the current speaker, its priority may be adjusted up or down accordingly, the priority of the device may be adjusted according to the progress of the current conference, the current speaker device may obtain a higher priority to ensure that the primary speaker in the conference can communicate information more clearly, flexible design may be performed according to the importance of the speaker device, and ensuring that the speaker device can obtain the proper priority in the conference.
The sharing decision model coordinates sharing requests among a plurality of mobile terminals based on a sharing coordination algorithm, and if N mobile terminals exist, each mobile terminal i sends out probability of the sharing requestsIs thatThe specific coordination steps are as follows:
s6.1, calculating the total probability P of the sharing request sent by all the mobile terminals al ；
Wherein P is al Representing the total probability of sharing requests sent by all mobile terminals; n represents the number of mobile terminals and the number of mobile terminals in the system.
Based on the total probability P al Deciding how to balance and allocate resources to meet the needs of each mobile terminal, helping to understand whether there is a prominent need in the system or that the request probability of some mobile terminals is abnormally high, so that special resource allocation or adjustment may be required; by monitoring and calculating P al The system is better able to understand the dynamic changes of the overall request. The method is beneficial to optimizing the resource allocation strategy, so that the system can improve the resource utilization efficiency and reduce the possible resource waste while meeting the request of the mobile terminal.
S6.2, at the initial time (t=0), setting an initial resource allocation weight for each mobile terminal i
Initial resource allocation weightsDefining the resource allocation condition of the system to each mobile terminal at the beginning; the method is equivalent to setting the initial state of the system when the system is started, and the initial state setting is configured based on the expected requirements, the historical data and the characteristics of the mobile terminal, so that the system is facilitated to have a reasonable resource allocation scheme in the initial stage.
S6.3, monitoring the request probability of each mobile terminal i at each time point tWhether a change occurs; if the request probability changes, the change of the use mode, the requirement or the behavior of the mobile terminal is implied, so that the system can sense and adapt to the change more timely, and the requirement of a user can be met better. The change of the request probability can be used as the basis for adjusting the resource allocation strategy. When the probability of a request changes, the system may re-evaluate the resource allocation policy based on the new situation. If the probability of a request by a certain mobile terminal increases, the system may consider adjusting its resource allocation weights to more optimally meet its needs.
S6.4 based on total probability P al For each mobile terminal i, at each time point t, calculating the resource allocation weight of the mobile terminal i at the time t according to a sharing coordination algorithm
S6.5, according to the resource allocation weight of each mobile terminal at the current time pointAnd performing resource allocation and processing.
In this embodiment, the sharing coordination algorithm specifically includes:
wherein,a resource allocation weight of the mobile terminal i at time t is represented; α represents an exponentially weighted moving average coefficient, typically between 0 and 1, that controls the degree of influence of the new request, determining the relative importance of the probability of the new request and the previous weights;Representing mobile terminalsThe request probability of the terminal i at the time t is the probability of the terminal i sending out a sharing request at the current time point;the resource allocation weight of the mobile terminal i at the time t-1 is indicated, and the weight is allocated to the resource at the last time point and used for influencing the weight allocation at the current time point.
The sharing coordination algorithm allows the system to more flexibly adjust the resource allocation weights to meet the changing demands of the mobile terminal 2 at different points in time, while also allowing the system to take into account previous allocation conditions and dynamic changes requested by the mobile terminal 2 in the resource allocation.
The foregoing has shown and described the basic principles, principal features and advantages of the invention. It will be understood by those skilled in the art that the present invention is not limited to the above-described embodiments, and that the above-described embodiments and descriptions are only preferred embodiments of the present invention, and are not intended to limit the invention, and that various changes and modifications may be made therein without departing from the spirit and scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.
Claims (10)
1. An intelligent paperless conference control and management platform is characterized in that: the mobile terminal comprises a control terminal (1), a mobile terminal and a display terminal (3), wherein the control terminal (1) comprises a communication module (11), a processing unit (12) and a screen projection module (13);
the control terminal (1) communicates with the mobile terminal through the communication module (11) and transmits screen projection data of the mobile terminal to the processing unit (12), the processing unit (12) performs coding optimization on the screen projection data of the mobile terminal based on a difference transmission algorithm, the optimized screen projection data are transmitted to the screen projection module (13), and the screen projection module (13) projects the screen projection data of the mobile terminal to the display terminal (3) for display;
the mobile terminal comprises a plurality of mobile devices, and the mobile devices at least comprise:
a sharing module (21), wherein the sharing module (21) is used for sending a data sharing request instruction to the control terminal (1);
the screen throwing instruction confirmation module (22), the screen throwing instruction confirmation module (22) is used for receiving and confirming a screen throwing sharing request of the screen throwing module (13);
the interconnection module (23), interconnection module (23) are based on the interconnection of LAN realize the interconnection communication between a plurality of mobile devices, and interconnection module (23) is based on sharing decision model realize the data interaction between a plurality of mobile devices.
2. The intelligent paperless conference control and management platform of claim 1, wherein: the processing unit (12) comprises at least a device coordination module and a data processing module;
the device coordination module receives screen projection data from different mobile devices based on a conference strategy algorithm and coordinates screen projection requests initiated by the different mobile devices;
the data processing module optimizes the screen projection data based on a differential transmission algorithm.
3. The intelligent paperless conference control and management platform of claim 2, wherein: the conference policy algorithm specifically comprises the following steps:
P a ＝P o +W s ×(D s -0.5)；
wherein D is s Indicating whether the device is the current speaker; 0.5 represents a central value; p (P) a Indicating adjusted device priority, P o Representing the original priority of the device; w (W) s Representing the weight associated with the current speaker device.
4. The intelligent paperless conference control and management platform of claim 1, wherein: the specific steps of the differential transmission algorithm for carrying out coding optimization on the screen projection data of the mobile terminal are as follows:
s4.1, for continuous video frames, determining the change pixel data to be transmitted by calculating the difference of pixel values between adjacent frames;
s4.2, recoding the pixel exceeding the threshold value, and transmitting the recoded pixel to a receiving end for decoding and reconstruction;
s4.3, finding out motion information between two frames through a motion estimation algorithm to obtain a pixel-level motion vector;
and S4.4, correcting the current frame by using the motion vector, so as to compensate pixel information of the previous frame, and reconstructing an image of the receiving end.
5. The intelligent paperless conference control and management platform of claim 4, wherein: the difference transmission algorithm is used for measuring pixel differences between adjacent frames, and specifically comprises the following steps:
wherein I is 1 (i) And I 2 (i) Gray values respectively representing the positions of corresponding pixels in two adjacent frames; n represents the total number of pixels;
introducing the self-adaptive threshold value into the calculation of the differential transmission algorithm to realize the optimization of the differential transmission algorithm, wherein the specific algorithm after the optimization is as follows:
wherein f (I) 1 (i)，I 2 (i) A) represents an adaptive function.
6. The intelligent paperless conference control and management platform of claim 1, wherein: the sharing decision model coordinates sharing requests among a plurality of mobile terminals (2) based on a sharing coordination algorithm, and if N mobile terminals (2) exist, the probability of each mobile terminal (2) i sending the sharing request is thatIts specific coordinationThe method comprises the following steps:
s6.1, calculating the total probability P of the sharing request sent by all the mobile terminals (2) al ；
S6.2, at the initial time, setting an initial resource allocation weight for each mobile terminal (2) i
S6.3, at each point in time t, monitoring the probability of request of each mobile terminal (2) iWhether a change occurs;
s6.4 based on total probability P al For each mobile terminal (2) i, at each point in time t, calculating the resource allocation weight of the mobile terminal (2) i at the time t according to a shared coordination algorithm
S6.5, according to the resource allocation weight of each mobile terminal (2) at the current time pointAnd performing resource allocation and processing.
7. The intelligent paperless conference control and management platform of claim 6, wherein: the sharing coordination algorithm specifically comprises the following steps:
wherein,a resource allocation weight representing the mobile terminal (2) i at time t; alpha represents an exponentially weighted moving average coefficient controlling the degree of influence of the new request;Representing a request probability of the mobile terminal (2) i at time t;The resource allocation weight of the mobile terminal (2) i at time t-1 is indicated.
8. The intelligent paperless conference control and management platform of claim 1, wherein: the sharing module (21) comprises a region capturing module, a screen capturing module and a request module;
the area capturing module is used for capturing the screen area of the mobile device in a self-defined mode; the screen capturing module is used for capturing the whole screen area of the mobile device;
the method comprises the steps that captured data of a region capturing module or a screen capturing module sends a data sharing request to a control terminal (1) through a request module, and the request module and the control terminal (1) conduct data interaction through a communication module.
9. The intelligent paperless conference control and management platform of claim 1, wherein: the screen throwing instruction confirmation module (22) is used for receiving a screen throwing sharing request from the screen throwing module (13), and after receiving the screen throwing request, the mobile terminal (2) selects to receive the sharing data or refuses to share the data through the screen throwing instruction confirmation module (22).
10. The intelligent paperless conference control and management platform of claim 1, wherein: the mobile device further comprises a conference sign-in module (24) and a conference endorsement module (25);
wherein the conference sign-in module (24) is used for signing in by mobile equipment when conference participants arrive at a conference site;
the meeting annotation module (25) is for allowing participants to add text annotations on meeting documents and shared content of the mobile device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410036160.5A CN117812217B (en) | 2024-01-10 | 2024-01-10 | Intelligent paperless conference control and management platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410036160.5A CN117812217B (en) | 2024-01-10 | 2024-01-10 | Intelligent paperless conference control and management platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117812217A true CN117812217A (en) | 2024-04-02 |
| CN117812217B CN117812217B (en) | 2024-07-23 |
Family
ID=90427873
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410036160.5A Active CN117812217B (en) | 2024-01-10 | 2024-01-10 | Intelligent paperless conference control and management platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117812217B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060010392A1 (en) * | 2004-06-08 | 2006-01-12 | Noel Vicki E | Desktop sharing method and system |
| CN107645492A (en) * | 2017-08-11 | 2018-01-30 | 天津秋水鱼悦文化传播有限公司 | A kind of conference management method of green high-efficient |
| US20190394057A1 (en) * | 2017-01-20 | 2019-12-26 | Samsung Electronics Co., Ltd. | Device and method for adaptively providing meeting |
| CN115297289A (en) * | 2022-10-08 | 2022-11-04 | 南通第二世界网络科技有限公司 | Efficient storage method for monitoring video |
| US20230300320A1 (en) * | 2022-03-16 | 2023-09-21 | Qualcomm Incorporated | Decoder-side motion vector refinement (dmvr) inter prediction using shared interpolation filters and reference pixels |
| CN117176901A (en) * | 2023-10-08 | 2023-12-05 | 安徽态度信息技术有限公司 | Method and system for realizing remote audio/video conference |
-
2024
- 2024-01-10 CN CN202410036160.5A patent/CN117812217B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060010392A1 (en) * | 2004-06-08 | 2006-01-12 | Noel Vicki E | Desktop sharing method and system |
| US20190394057A1 (en) * | 2017-01-20 | 2019-12-26 | Samsung Electronics Co., Ltd. | Device and method for adaptively providing meeting |
| CN107645492A (en) * | 2017-08-11 | 2018-01-30 | 天津秋水鱼悦文化传播有限公司 | A kind of conference management method of green high-efficient |
| US20230300320A1 (en) * | 2022-03-16 | 2023-09-21 | Qualcomm Incorporated | Decoder-side motion vector refinement (dmvr) inter prediction using shared interpolation filters and reference pixels |
| CN115297289A (en) * | 2022-10-08 | 2022-11-04 | 南通第二世界网络科技有限公司 | Efficient storage method for monitoring video |
| CN117176901A (en) * | 2023-10-08 | 2023-12-05 | 安徽态度信息技术有限公司 | Method and system for realizing remote audio/video conference |
Non-Patent Citations (1)
| Title |
|---|
| 高旭等: "多媒体会议系统的发言权控制协议研究", 计算机学报, vol. 24, no. 8, 31 August 2001 (2001-08-31), pages 845 - 852 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117812217B (en) | 2024-07-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111147893B (en) | A video adaptive method, related device and storage medium | |
| US11190570B2 (en) | Video encoding using starve mode | |
| US11575894B2 (en) | Viewport-based transcoding for immersive visual streams | |
| CN107333143B (en) | 5G multi-access concurrent transmission control system and method | |
| CN115209189B (en) | Video stream transmission method, system, server and storage medium | |
| CN115633143A (en) | Self-adaptive video stream transmission system with edge-side collaborative super-resolution | |
| Yang et al. | Delay-optimized multi-user VR streaming via end-edge collaborative neural frame interpolation | |
| CN111654660B (en) | Video conference system coding transmission method based on image segmentation | |
| CN117812217B (en) | Intelligent paperless conference control and management platform | |
| CN114598853B (en) | Video data processing method, device and network side equipment | |
| CN112752058B (en) | Method and device for adjusting attribute of video stream | |
| Wang et al. | Adaptive VR video data transmission method using mobile edge computing based on AIoT cloud VR | |
| Madarasingha et al. | Edge assisted frame interpolation and super resolution for efficient 360-degree video delivery | |
| Chapagain et al. | A novel solution for real time video and path quality, and latency minimization: tele-training in surgical education | |
| CN117255177A (en) | Client self-adaptive video playing and requesting method, device, system and medium | |
| CN115633189A (en) | Online teaching text video super-resolution method based on SVC and edge calculation | |
| Xiao et al. | Bilateral Bargaining-Based Adaptive Video Transmission: A Frame Rate Perspective | |
| CN116436870A (en) | Bandwidth adaptive method, device and storage medium | |
| US20200107068A1 (en) | Mobile Device Content Provisioning Adjustments based on Wireless Communication Channel Bandwidth Condition | |
| CN116033127B (en) | Adaptive bandwidth collaborative allocation method for video surveillance transmission network in areas without mobile networks | |
| WO2021196860A1 (en) | Video transmission method and system, and related device and storage medium | |
| KR102107139B1 (en) | Method and apparatus for providing video streaming service in wireless network system | |
| US12518462B2 (en) | 3D stream processing | |
| EP2888657A1 (en) | Controlling cpu usage to balance fast and slow devices | |
| US20240298051A1 (en) | Data relay apparatus, distribution system, data relay method, and computer-readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |