CN115633019B - Media playback method, device, electronic device and storage medium - Google Patents
Media playback method, device, electronic device and storage mediumInfo
- Publication number
- CN115633019B CN115633019B CN202211279374.2A CN202211279374A CN115633019B CN 115633019 B CN115633019 B CN 115633019B CN 202211279374 A CN202211279374 A CN 202211279374A CN 115633019 B CN115633019 B CN 115633019B
- Authority
- CN
- China
- Prior art keywords
- media data
- media
- module
- playing
- conference module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/64—Addressing
- H04N21/6402—Address allocation for clients
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The technical scheme of the embodiment of the invention discloses a media playing method, a device, electronic equipment and a storage medium. The method comprises the steps of detecting whether a conference module exists in current equipment, monitoring a port corresponding to a detection result, receiving media data, sending the media data to a television wall, and controlling the television wall to play the media data. The technical scheme of the embodiment of the invention realizes the flexible selection of the port for receiving the media data, ensures the flexibility of processing the media data, ensures the stability of playing the media data and simultaneously flexibly improves the transmission efficiency of the media data.
Description
Technical Field
The present invention relates to the field of network applications, and in particular, to a media playing method, a device, an electronic device, and a storage medium.
Background
With the development of internet technology, conference live broadcast is increasingly widely used.
Currently, the receiving, transmitting, decoding and encoding of media data of a conference are all processed uniformly by the equipment running the conference system.
For small conferences, the equipment system where the conference system is located has the problem of excessive performance, and for large conferences, the media data cannot be normally played due to the overlarge data volume carried by the equipment where the conference system is located. Therefore, how to flexibly ensure the stability of playing media data is needed to be solved.
Disclosure of Invention
The invention provides a media playing method, a device, electronic equipment and a storage medium, which flexibly ensure the playing stability of media data.
According to an aspect of the present invention, there is provided a media playing method, including:
detecting whether a conference module exists in the current equipment;
Monitoring a port corresponding to the detection result and receiving media data;
And sending the media data to the television wall and controlling the television wall to play the media data.
According to another aspect of the present invention, there is provided a media playing device including:
the conference module detection module is used for detecting whether a conference module exists in the current equipment;
the port monitoring module is used for monitoring ports corresponding to the detection results and receiving media data;
And the media data transmitting module is used for transmitting the media data to the television wall and controlling the television wall to play the media data.
According to another aspect of the present invention, there is provided an electronic apparatus including:
At least one processor, and
A memory communicatively coupled to the at least one processor, wherein,
The memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the media playing method of any one of the embodiments of the present invention.
According to another aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to execute a media playing method according to any one of the embodiments of the present invention.
According to the technical scheme, whether the conference module exists in the current equipment or not is detected, the port corresponding to the detection result is monitored, the media data is received, the media data is sent to the television wall, the media data is controlled to be played in the television wall, flexible selection of the port for receiving the media data is achieved, flexibility of media data processing is guaranteed, stability of media data playing is guaranteed, and meanwhile transmission efficiency of the media data is flexibly improved.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flowchart of a media playing method according to a first embodiment of the present invention;
FIG. 2 is a flowchart of a media playing method according to a second embodiment of the present invention;
FIG. 3 is a flowchart of a media playing method according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a media playing device according to a fourth embodiment of the present invention;
Fig. 5 is a schematic structural diagram of an electronic device implementing a media playing method according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
Fig. 1 is a flowchart of a media playing method according to an embodiment of the present invention, where the method may be performed by a media playing device, and the media playing device may be implemented in hardware and/or software, and the media playing device may be configured in an electronic device. As shown in fig. 1, the method includes:
s110, detecting whether a conference module exists in the current equipment.
The current device may be the device in which the video wall control module is located. The video wall control module may be a module that processes and transmits media data. The television wall control module can receive the media data sent by the conference module, process the media data, synthesize multiple pictures and send the multiple pictures to the television wall. The conference module is used for receiving the media data sent by the at least one terminal device and sending the media data to the video wall control module. The terminal device is used for collecting media data. The conference module may exist on the current device or on other devices than the current device. Optionally, if there are fewer participants in the conference, the conference module and the video wall control module may all belong to the current device. At this time, the current device is used to receive, transmit, decode, and encode media data. The performance of the current device can meet the total processing process of the media data, and the playing stability of the media data is ensured. Meanwhile, the conference module and the video wall control module belong to the same module, so that the transmission speed of media data can be improved. The transmission efficiency of the media data is improved while the playing stability of the media data is considered. If the conference participants are more, the conference module and the video wall control module can belong to different devices, namely the video wall control module belongs to the current device, and the conference module belongs to other devices. At this time, the equipment at the conference module is only used for receiving the media data, and the current equipment is used for decoding, encoding and sending the media data, so that the data processing pressure of the equipment at the conference module is relieved, the normal processing and playing of the media data are ensured, and the playing stability of the media data is ensured.
Specifically, whether a conference module exists in the current device where the video wall control module is located can be detected. Optionally, the current device may send a broadcast message to the conference module, where the conference module sends feedback information to the current device after receiving the broadcast message, and the current device detects the feedback information after receiving the feedback information to determine whether the conference module exists in the current device. The broadcast message may be a message confirming the device in which the conference module is located. The broadcast message may be, for example, a message such as "whether the conference module is currently on the device" or "please confirm the device on which the conference module is located". The feedback information may be response information of the broadcast information. For example, if the broadcast message is "whether the conference module is currently on the device", the feedback information may be "yes" or "no". If the broadcast message is "please confirm the device where the conference module is located", the feedback information may be device information of the device where the conference module is located.
Alternatively, the multi-picture configuration information may also be used to determine whether the device information to which the conference module in the front-end configuration information belongs is the same as the device information to which the video wall control module in the current device belongs. If the device information is the same, it may be determined that a conference module exists in the current device. The multi-picture configuration information may be configuration information required when playing the media data in multiple pictures. The multi-picture configuration information may include a mapping relationship between the conference module and the video wall control module, a mapping relationship between a port of the conference module transmitting media data and a port of the video wall control module receiving media data, a mapping relationship between a port of the video wall control module transmitting media data and a video wall multi-picture display window, media adaptation parameters of the video wall, and the like. The technician can set and adjust the multi-screen configuration information in the front-end page. The device information may be unique identification information of the device. The device information may be, for example, an IP address (Internet Protocol Address, network protocol address) of the device. The current device or other devices may be uniquely determined based on the device information.
S120, monitoring a port corresponding to the detection result and receiving media data.
The detection result may include the presence of a conference module in the current device or the absence of a conference module in the current device. Different ports corresponding to different detection results are different. The port corresponding to the detection result is used for receiving the data sent by the conference module.
The media data may be data displayed on a television wall. Alternatively, the media data may include video data, audio data, and the like. The method comprises the steps that media data are collected through terminal equipment and are sent to a sending port of a conference module by the terminal equipment, and the conference module sends the media data to current equipment according to the mapping relation between the port of the conference module for sending the media data and the port of the video wall control module for receiving the media data in the multi-picture configuration information. Optionally, the conference module may receive media data sent by a plurality of terminal devices through a plurality of ports respectively. Based on the mapping relation between the port of the conference module for transmitting the media data and the port of the video wall control module for receiving the media data, the current device can respectively receive the media data of a plurality of ports transmitted by the conference module.
Specifically, if the detection result is that the conference module exists in the current device, monitoring a port corresponding to the detection result that the conference module exists in the current device, and receiving media data sent by the conference module. If the detection result is that the conference module does not exist in the current equipment, monitoring a port corresponding to the detection result that the conference module does not exist in the current equipment, and receiving media data sent by the conference module.
And S130, sending the media data to the television wall, and controlling the television wall to play the media data.
The video wall may be used to display media data for multiple pictures. Specifically, after the current device receives the media data, the video wall control module in the current device decodes the media data and then encodes the media data corresponding to the port. The current device sends the encoded media data to the television wall and controls the television wall to play the media data. Optionally, the conference module may send the media data collected by the multiple terminals to the receiving ports corresponding to the current device through different sending ports of the conference module. The current device receives the media data and decodes and encodes the media data received by different ports respectively. And according to the one-to-one mapping relation between the ports of the television wall control module for transmitting the media data and the multi-picture display windows of the television wall in the multi-picture configuration information, the media data of the ports can be displayed in the multi-picture display windows corresponding to the television wall.
The technical scheme of the embodiment of the invention monitors the port corresponding to the detection result and receives the media data by detecting whether the conference module exists in the current equipment, sends the media data to the television wall and controls the television wall to play the media data, realizes flexible selection of the port for receiving the media data according to the equipment of the conference module, ensures the flexibility of media data processing, ensures the stability of media data playing, and simultaneously flexibly improves the transmission efficiency of the media data.
Example two
Fig. 2 is a flowchart of a media playing method according to a second embodiment of the present invention, where on the basis of the foregoing embodiment, a port corresponding to a detection result is monitored, specifically, when the detection result includes a conference module, a local address port is monitored, or when the detection result includes no conference module, an external network address port is monitored. As shown in fig. 2, the method includes:
s210, detecting whether a conference module exists in the current equipment, if yes, executing S220, and if not, executing S230.
S220, monitoring a local address port and receiving media data when the detection result comprises the conference module.
The local address port may be a port that receives media data sent by the conference module of the current device. When the detection result includes that the conference module exists, the local address port is utilized to receive the media data, and the media data only needs to pass through a small number of switches in the current equipment, so that the speed of media data transmission is improved. Meanwhile, loss of the media data in the process of multiple transmission is avoided, the integrity of the media data is guaranteed, and the playing stability of the media data is further guaranteed.
S230, or when the detection result comprises that the conference module does not exist, monitoring an external network address port and receiving media data.
The external network address port may be a port that receives media data sent by a conference module of the other device. The other device may be a device other than the current device. When media data is transmitted by using the external network address port, the media data needs to pass through the switch of the current device and a plurality of switches in the process of being transmitted to other devices. The external network address port is used for transmitting the media data, the transmission speed and the integrity of the media data are lower than those of the local address port, but the number of the participants in the conference is larger, the data volume of the media data to be processed is larger, and the system performance is more occupied. The current equipment is utilized to decode, encode and send the media data, so that the normal processing process of the media data can be effectively ensured, the conditions of system breakdown and the like caused by the media data processing by the same participant are avoided, and the stability of playing the media data is ensured although the part of transmission speed and the integrity of the media data are sacrificed.
And S240, sending the media data to the television wall, and controlling the television wall to play the media data.
The technical scheme of the embodiment of the invention monitors the local address port by the presence of the conference module in the detection result or monitors the external network address port by the absence of the conference module in the detection result, flexibly realizes the selection of the local address port and the external network address port, and further improves the transmission efficiency and the integrity of media data and further ensures the playing stability of the media data while ensuring the normal processing performance in a small conference with fewer participants. When large conferences with more participants exist, the normal processing of a large amount of media data is ensured, and the stability of the media data is ensured. Under the condition of meeting different orders, the stability of playing the media data is ensured.
Example III
Fig. 3 is a flowchart of a media playing method according to a third embodiment of the present invention, where the embodiment sends media data to a tv wall based on the above embodiment, specifically includes obtaining media playing adaptive parameters of the tv wall, adjusting the media data by using the media playing adaptive parameters, and sending the adjusted media data to the tv wall.
S310, detecting whether a conference module exists in the current equipment.
S320, monitoring a port corresponding to the detection result and receiving the media data.
S330, acquiring media playing adaptation parameters of the television wall.
The media play adaptation parameters may be adaptation parameters of the video wall play media data. The media adaptation parameters of the television wall can be preset in the multi-picture configuration information. The types of media play adaptation parameters are also different for different types of media data. By way of example, if the media data is audio data, the parameter types of the media play adaptation parameters may include frequency, number of sampling bits, number of channels, loudness, bit rate, etc. If the media data is video data, the types of the media play adaptation parameters may include resolution, code rate, frame rate, video capacity, video format, and the like.
Specifically, the media play adaptation parameters of the video wall adaptation can be obtained from the multi-picture configuration information.
And S340, adjusting the media data by adopting the media play adaptation parameters.
Specifically, the video wall control module in the current device decodes the media data to obtain decoded media data. And adjusting the media playing parameters of the decoded media data by adopting the media playing adaptation parameters of the television wall to obtain the adjusted media data. The media playing parameter may be a playing parameter of media data obtained after decoding. The parameter type of the media play parameter may be the same as the parameter type of the media play adaptation parameter.
And S350, sending the adjusted media data to the television wall.
Specifically, the adjusted media data may be encoded, and the encoded media data may be sent to the tv wall based on a mapping relationship between a port of the tv wall control module for sending the media data and a multi-picture display window of the tv wall.
In an alternative embodiment of the invention, the media data is adjusted by adopting the media play adaptive parameters, which is concretely implemented by acquiring the media type of the media data, decoding the media data by adopting a decoder corresponding to the media type, and encoding the decoded media data by adopting an encoder corresponding to the media play adaptive parameters to obtain the adjusted media data.
Wherein, S3401, acquire the media type of the media data.
The media type of the media data may include video data, audio data, and the like.
Specifically, the media data may be detected, and the media type of the media data may be obtained.
And S3402, decoding the media data by adopting a decoder corresponding to the media type.
Specifically, a decoder corresponding to the media type may be created and selected according to the type of the media data, and the media data may be decoded using the decoder.
Illustratively, if the media type is video data, the current device directly creates a video decoder and decodes the video data using the video decoder, and if the media type is audio data, the current device directly creates an audio decoder and decodes the audio data using the audio decoder.
S3403, adopting an encoder corresponding to the media playing adaptation parameters to encode the decoded media data to obtain the adjusted media data.
Specifically, the current device may create an encoder corresponding to the media play adaptation parameter according to the media play adaptation parameter, and encode the decoded media data by using the encoder to obtain an encoder adjusted according to the media play adaptation parameter.
The scheme obtains the media type of the media data, decodes the media data by adopting a decoder corresponding to the media type, encodes the decoded media data by adopting an encoder corresponding to the media playing adaptation parameter to obtain the adjusted media data, and realizes the self-adaptive creation of the encoder according to the media type, thereby ensuring the dynamic processing of the media data and further ensuring the playing stability of the media data.
In an alternative embodiment of the invention, the media data comprises a data packet, and the media type of the media data is acquired by acquiring the packet head identification information of the data packet, and determining the media type of the media data according to the packet head identification information.
And S34011, acquiring the packet head identification information of the data packet.
The header identification information may be header identification information of the data packet. The header identification information is used to determine the type of the data packet. The header identification information may be set and adjusted according to the experience of the skilled person. The header identification information may include a numerical value or a character string, etc. Illustratively, the header identification information may be a PT (Payload Type) value.
Specifically, if the media data includes a data packet, header identification information of the data packet may be obtained.
S34012, determining the media type of the media data according to the packet head identification information.
Specifically, the media type of the media data corresponding to the packet header identification information may be determined according to the packet header identification information.
For example, when the header identification information is preset to be 0-99, the media type of the media data is audio data, and when the header identification information is 100-199, the media type of the media data is video data. If the acquired packet header identification information of the data packet is 50, it may be determined that the media type of the media data is audio data according to the packet header identification information.
According to the scheme, the media type of the media data is determined by introducing the packet header identification information and utilizing the packet header identification information, detection and feedback of the media type of the media data do not need to be carried out in advance, the current equipment can directly determine the media type according to the packet header identification information, and a decoder is adaptively created, so that the dynamic processing of the media data is ensured, and the playing stability of the media data is further ensured.
In an alternative embodiment of the present invention, after the media data is sent to the tv wall and the playing of the media data in the tv wall is controlled, the method further includes receiving playing failure information, modifying media playing adaptive parameters according to the playing failure information, adjusting the media data by using the updated media playing adaptive parameters, and sending the adjusted media data to the tv wall.
And A, receiving playing fault information.
The playback failure information may be failure information of a television playback. The playback failure information can be fed back to the current device by the video wall. The playout failure information may include media adaptation parameters specific to the failure.
Specifically, the current device receives the playing fault information fed back by the television wall.
And B, modifying media playing adaptation parameters according to the playing fault information.
Specifically, the media playing adaptation parameters can be adjusted according to the playing fault information, so that the original single or multiple media playing adaptation parameters are reduced.
And step C, adjusting the media data by adopting the updated media play adaptive parameters.
Specifically, the current device may use the updated media play adaptation parameters to readjust the media play parameters of the decoded media data.
And D, sending the adjusted media data to the television wall.
Specifically, the adjusted media data may be encoded and then sent to the tv wall for display by the tv wall.
According to the scheme, the media playing adaptive parameters are modified according to the playing fault information, the updated media playing adaptive parameters are adopted to adjust the media data, the adjusted media data are sent to the television wall, and the television wall can adjust the media data by automatically adjusting the media playing adaptive parameters under the condition that the media data have playing faults, so that the situation that normal playing cannot be performed due to mismatching of the media playing adaptive parameters is avoided, self-healing in the playing process of the media data is realized, fault tolerance of the playing of the media data is guaranteed, and stability of playing of the media data is improved.
In an alternative embodiment of the invention, the playout failure information includes at least one of resolution and frame number.
The resolution may be an effective pixel value per unit length. For example, the resolutions may include 360P, 480P, 720P, 1080P, 4K, and so on. The frame number may be a measure for measuring the display frame number. For example, the frame number may include 30fps, 60fps, etc.
For example, the playback failure information is set to 1080P resolution, 60fps frame rate, and playback cannot be performed normally. The current device receives the playing fault information fed back by the television wall. The media play adaptive parameters can be adjusted according to the play fault information, so that the original single or multiple media play adaptive parameters are reduced, for example, the resolution is adjusted to 720P, and the frame rate is adjusted to 30fps. The current device may use the updated media play adaptation parameters to readjust the media play parameters of the decoded media data. The adjusted media data can be encoded and then sent to the television wall for display by the television wall.
According to the scheme, the playing fault information is embodied into the resolution and the frame rate, a specific example of the playing fault with the unmatched resolution and the unmatched frame rate is provided, and the self-healing property in the playing process of the media data is improved and the playing stability of the media data is improved through the self-adaptive adjustment of the resolution and the frame rate.
The technical scheme of the embodiment of the invention comprises the steps of obtaining the media play adaptive parameters of the television wall, adjusting the media data by adopting the media play adaptive parameters, and sending the adjusted media data to the television wall. Based on the media playing adaptation parameters of the television wall, the media data are adjusted in advance before being sent to the television wall, so that the matching property of the media data sent to the television wall and the television wall is ensured, the adjusted media data can be accurately analyzed by the television wall, and the playing stability of the media data is further ensured.
Example IV
Fig. 4 is a schematic structural diagram of a media playing device according to a fourth embodiment of the present invention. As shown in fig. 4, the apparatus includes a conference module detection module 410, a port listening module 420, and a media data transmission module 430.
The conference module detection module 410 is configured to detect whether a conference module exists in the current device.
The port monitoring module 420 is configured to monitor a port corresponding to the detection result and receive media data.
The media data sending module 430 is configured to send media data to the tv wall and control playing of the media data in the tv wall.
The technical scheme of the embodiment of the invention monitors the port corresponding to the detection result and receives the media data by detecting whether the conference module exists in the current equipment, sends the media data to the television wall and controls the television wall to play the media data, realizes flexible selection of the port for receiving the media data according to the equipment of the conference module, ensures the flexibility of media data processing, ensures the stability of media data playing, and simultaneously flexibly improves the transmission efficiency of the media data.
In an alternative embodiment of the present invention, port listening module 420 includes:
The local port monitoring unit is used for monitoring the local address port when the detection result comprises a conference module, or the external network port monitoring unit is used for monitoring the external network address port when the detection result comprises no conference module.
In an alternative embodiment of the present invention, the media data transmission module 430 includes:
and the adaptive parameter acquisition unit is used for acquiring the media playing adaptive parameters of the television wall.
The first media data adjusting unit is used for adjusting the media data by adopting the media playing adapting parameters.
And the first media data sending unit is used for sending the adjusted media data to the television wall.
In an alternative embodiment of the invention, the media data adjustment unit comprises:
a media type acquisition subunit, configured to acquire a media type of the media data.
And the media data decoding subunit is used for decoding the media data by adopting a decoder corresponding to the media type.
And the media data coding subunit is used for coding the decoded media data by adopting an encoder corresponding to the media playing adaptation parameters to obtain the adjusted media data.
In an alternative embodiment of the invention, the media data comprises data packets and the media type acquisition subunit comprises:
the identification information obtaining slave unit is used for obtaining the packet head identification information of the data packet.
And the media type determining slave unit is used for determining the media type of the media data according to the packet head identification information.
In an alternative embodiment of the present invention, after the media data transmitting unit transmits the media data to the tv wall and controls the tv wall to play the media data, the media data transmitting module 430 further includes:
the fault information playing unit is used for receiving the playing fault information.
And the adaptation parameter modification unit is used for modifying the media playing adaptation parameters according to the playing fault information.
And the second media data adjusting unit is used for adjusting the media data by adopting the updated media play adaptive parameters.
And the second media data sending unit is used for sending the adjusted media data to the television wall.
In an alternative embodiment of the invention, the playout failure information includes at least one of resolution and frame number.
The media playing device provided by the embodiment of the invention can execute the media playing method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the executing method.
Example five
Fig. 5 shows a schematic diagram of an electronic device 500 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 5, the electronic device 500 includes at least one processor 501, and a memory communicatively connected to the at least one processor 501, such as a Read Only Memory (ROM) 502, a Random Access Memory (RAM) 503, etc., where the memory stores computer programs executable by the at least one processor, and the processor 501 may perform various suitable actions and processes according to the computer programs stored in the Read Only Memory (ROM) 502 or the computer programs loaded from the storage unit 508 into the Random Access Memory (RAM) 503. In the RAM503, various programs and data required for the operation of the electronic device 500 may also be stored. The processor 501, ROM 502, and RAM503 are connected to each other by a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
Various components in the electronic device 500 are connected to the I/O interface 505, including an input unit 506 such as a keyboard, a mouse, etc., an output unit 507 such as various types of displays, speakers, etc., a storage unit 508 such as a magnetic disk, optical disk, etc., and a communication unit 509 such as a network card, modem, wireless communication transceiver, etc. The communication unit 509 allows the electronic device 500 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The processor 501 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 501 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 501 performs the various methods and processes described above, such as a media playing method.
In some embodiments, the media playing method may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as storage unit 508. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 500 via the ROM 502 and/or the communication unit 509. When the computer program is loaded into RAM 503 and executed by processor 501, one or more steps of the media playing method described above may be performed. Alternatively, in other embodiments, the processor 501 may be configured to perform the media playing method in any other suitable manner (e.g., by means of firmware).
Various implementations of the systems and techniques described here above can be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be a special or general purpose programmable processor, operable to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user, for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback), and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a Local Area Network (LAN), a Wide Area Network (WAN), a blockchain network, and the Internet.
The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of high management difficulty and weak service expansibility in the traditional physical host and Virtual private server (VPS PRIVATE SERVER) service.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.
Claims (9)
1. A method of media playing, the method comprising:
Detecting whether a conference module exists in current equipment, wherein the current equipment is equipment in which a television wall control module is located;
Monitoring a port corresponding to the detection result and receiving media data;
The method comprises the steps of sending media data to a television wall, and controlling the television wall to play the media data, wherein the television wall is used for displaying the media data in multiple pictures;
The monitoring the port corresponding to the detection result comprises the following steps:
The detection result comprises the conference module, the local address port monitoring, or
Monitoring an external network address port when the detection result includes that the conference module does not exist;
the detecting whether a conference module exists in the current device comprises the following steps:
detecting feedback information of a broadcast message received by the current device and sent to the conference module, determining whether the conference module exists in the current device, or
Detecting whether equipment information of a conference module in the multi-picture configuration information is the same as equipment information of a video wall control module in current equipment, and determining whether the conference module exists in the current equipment;
the sending the media data to a television wall and controlling the television wall to play the media data comprises the following steps:
Respectively transmitting a plurality of media data to corresponding receiving ports of the current equipment through different transmitting ports of the conference module;
Receiving the media data through the current equipment, and respectively decoding and encoding the media data received by different receiving ports;
And displaying the media data of the ports of the television wall control modules for transmitting the media data in the multi-picture display windows corresponding to the television walls according to the mapping relation between the ports of the television wall control modules for transmitting the media data and the multi-picture display windows of the television walls in the multi-picture configuration information through the current equipment.
2. The method of claim 1, wherein said transmitting said media data to a television wall comprises:
acquiring media playing adaptation parameters of a television wall;
Adjusting the media data by adopting the media play adaptation parameters;
And sending the adjusted media data to the television wall.
3. The method of claim 2, wherein said adjusting said media data using said media play adaptation parameters comprises:
acquiring a media type of the media data;
Decoding the media data with a decoder corresponding to the media type;
And adopting an encoder corresponding to the media playing adaptation parameters to encode the decoded media data to obtain the adjusted media data.
4. The method of claim 3, wherein the media data comprises data packets, and wherein the obtaining the media type of the media data comprises:
acquiring the packet head identification information of the data packet;
and determining the media type of the media data according to the packet head identification information.
5. The method of claim 2, further comprising, after transmitting the media data to a television wall and controlling playback of the media data in the television wall:
receiving playing fault information;
modifying the media playing adaptation parameters according to the playing fault information;
Adjusting the media data by adopting the updated media play adaptive parameters;
And sending the adjusted media data to the television wall.
6. The method of claim 5, wherein the playout failure information includes at least one of resolution and frame number.
7. A media playing device, comprising:
the conference module detection module is used for detecting whether a conference module exists in the current equipment, wherein the current equipment is the equipment where the video wall control module is located;
the port monitoring module is used for monitoring ports corresponding to the detection results and receiving media data;
The system comprises a media data sending module, a television wall and a display module, wherein the media data sending module is used for sending the media data to the television wall and controlling the television wall to play the media data;
the port monitoring module comprises:
A local port monitoring unit for monitoring local address port when the detection result includes the existence of conference module, or
The external network port monitoring unit is used for monitoring an external network address port when the detection result comprises that the conference module does not exist;
The conference module detection module is specifically configured to:
detecting feedback information of a broadcast message received by the current device and sent to the conference module, determining whether the conference module exists in the current device, or
Detecting whether equipment information of a conference module in the multi-picture configuration information is the same as equipment information of a video wall control module in current equipment, and determining whether the conference module exists in the current equipment;
The media data sending module is specifically configured to:
Respectively transmitting a plurality of media data to corresponding receiving ports of the current equipment through different transmitting ports of the conference module;
Receiving the media data through the current equipment, and respectively decoding and encoding the media data received by different receiving ports;
And displaying the media data of the ports of the television wall control modules for transmitting the media data in the multi-picture display windows corresponding to the television walls according to the mapping relation between the ports of the television wall control modules for transmitting the media data and the multi-picture display windows of the television walls in the multi-picture configuration information through the current equipment.
8. An electronic device, the electronic device comprising:
At least one processor, and
A memory communicatively coupled to the at least one processor, wherein,
The memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the media playing method of any one of claims 1-6.
9. A computer readable storage medium storing computer instructions for causing a processor to perform the method of media playing of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211279374.2A CN115633019B (en) | 2022-10-19 | 2022-10-19 | Media playback method, device, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211279374.2A CN115633019B (en) | 2022-10-19 | 2022-10-19 | Media playback method, device, electronic device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115633019A CN115633019A (en) | 2023-01-20 |
| CN115633019B true CN115633019B (en) | 2025-09-02 |
Family
ID=84907069
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211279374.2A Active CN115633019B (en) | 2022-10-19 | 2022-10-19 | Media playback method, device, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115633019B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108055554A (en) * | 2017-12-14 | 2018-05-18 | 深圳Tcl数字技术有限公司 | Video broadcasting method, TV, server and computer readable storage medium |
| CN110910892A (en) * | 2018-09-17 | 2020-03-24 | 北京京东尚科信息技术有限公司 | Conference system terminal, audio data processing method and teleconference system |
| CN111147859A (en) * | 2019-12-31 | 2020-05-12 | 视联动力信息技术股份有限公司 | Video processing method and device |
| CN114025125A (en) * | 2021-11-04 | 2022-02-08 | 大连成者科技有限公司 | Wireless portable intelligent meeting controlling means |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5802281A (en) * | 1994-09-07 | 1998-09-01 | Rsi Systems, Inc. | Peripheral audio/video communication system that interfaces with a host computer and determines format of coded audio/video signals |
| US6025870A (en) * | 1998-10-14 | 2000-02-15 | Vtel Corporation | Automatic switching of videoconference focus |
| CN1925594A (en) * | 2005-08-31 | 2007-03-07 | 英业达股份有限公司 | Media data switching system and method |
| US8233930B1 (en) * | 2007-01-16 | 2012-07-31 | Sprint Spectrum L.P. | Dual-channel conferencing with connection-based floor control |
| US8392503B2 (en) * | 2007-06-19 | 2013-03-05 | Cisco Technology, Inc. | Reporting participant attention level to presenter during a web-based rich-media conference |
| CN101150706B (en) * | 2007-10-24 | 2010-10-13 | 华为终端有限公司 | Video conference device |
| CN101729828B (en) * | 2008-10-14 | 2012-09-05 | 中兴通讯股份有限公司 | Video conference terminal and control method of working states thereof |
| CN105306874A (en) * | 2015-11-19 | 2016-02-03 | 讯美电子科技有限公司 | Multifunctional video device |
| CN105898590A (en) * | 2015-12-10 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | Media content play method, device and system |
| CN205566499U (en) * | 2016-03-18 | 2016-09-07 | 深圳市金峰数码通讯有限公司 | Audio frequency and video binary channels input process circuit and video conferencing equipment thereof |
| CN111711784B (en) * | 2020-06-15 | 2022-10-18 | 北京字节跳动网络技术有限公司 | Conference control method and device, readable medium and electronic equipment |
| CN111787026B (en) * | 2020-07-27 | 2022-09-27 | 北京飞讯数码科技有限公司 | Method, device and equipment for transmitting media data and storage medium |
| CN112040167A (en) * | 2020-08-28 | 2020-12-04 | 林子电子科技(上海)有限公司 | Method for realizing connection of video conferences of different types |
| CN114125359B (en) * | 2021-11-23 | 2024-11-29 | 深圳市台电实业有限公司 | Expandable distributed media processing method and system |
-
2022
- 2022-10-19 CN CN202211279374.2A patent/CN115633019B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108055554A (en) * | 2017-12-14 | 2018-05-18 | 深圳Tcl数字技术有限公司 | Video broadcasting method, TV, server and computer readable storage medium |
| CN110910892A (en) * | 2018-09-17 | 2020-03-24 | 北京京东尚科信息技术有限公司 | Conference system terminal, audio data processing method and teleconference system |
| CN111147859A (en) * | 2019-12-31 | 2020-05-12 | 视联动力信息技术股份有限公司 | Video processing method and device |
| CN114025125A (en) * | 2021-11-04 | 2022-02-08 | 大连成者科技有限公司 | Wireless portable intelligent meeting controlling means |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115633019A (en) | 2023-01-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113259706B (en) | Live broadcast processing method, device, electronic device, and storage medium | |
| US8760490B2 (en) | Techniques for a rate-adaptive video conference bridge | |
| CN111432248A (en) | Quality monitoring method and device for live video stream | |
| CN111641804A (en) | Video data processing method and device, terminal, camera and video conference system | |
| CN115209189B (en) | Video stream transmission method, system, server and storage medium | |
| US11968379B2 (en) | Video decoding method and apparatus, video encoding method and apparatus, storage medium, and electronic device | |
| WO2021057477A1 (en) | Video encoding and decoding method and related device | |
| EP2645710A1 (en) | Method for monitoring terminal through ip network and mcu | |
| CN108419041A (en) | A kind of method and apparatus of video data processing | |
| CN105469772A (en) | Remote KVM (Keyboard Video Mouse) control method, remote KVM control terminal and system | |
| CN114051120A (en) | Video alarm method, device, storage medium and electronic equipment | |
| US8593500B2 (en) | Video conference device and method for using the same | |
| CN206117878U (en) | Intelligent video analysis device, equipment and video monitor system | |
| CN115633019B (en) | Media playback method, device, electronic device and storage medium | |
| CN112866390B (en) | A data transmission method, device, terminal equipment and storage medium | |
| CN117354600A (en) | Real-time audio and video playing method, device, equipment and medium | |
| CN110570614B (en) | Video monitoring system and intelligent camera | |
| CN114503569A (en) | AV1 codec for real-time video communication | |
| CN116781973B (en) | Video encoding and decoding method and device, storage medium and electronic equipment | |
| US20240292008A1 (en) | Monitoring video compression method, monitoring system, computer device and medium | |
| CN115766695A (en) | Websocket-based remote browsing method and device for real-time image of industrial camera | |
| CN116962613A (en) | Data transmission method and device, computer equipment and storage medium | |
| CN111385081B (en) | End-to-end communication method and device, electronic equipment and medium | |
| CN115942000A (en) | Video stream transcoding method, device, equipment and medium based on H.264 format | |
| CN115633149A (en) | Conference data transmission method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |