CN107302703A - Audio and video playing method and device - Google Patents

Abstract

The invention discloses an audio and video playback method. A video terminal is connected to an external device through a preset interface. When receiving an audio and video file to be decoded sent by another video terminal, the video terminal sends the The audio and video file to be decoded is sent to the external device, so that the external device decodes the audio and video file to be decoded and feeds back the decoded audio and video data through the preset interface, wherein the The decoding capability of the external device is higher than that of the hardware device installed in the video terminal; when the decoded audio and video data fed back by the external device is received, the audio and video is played according to the decoded audio and video data The audio and video corresponding to the data. The invention also discloses an audio and video playing device. The invention reduces the cost of playing audio and video by the video terminal.

Description

Audio and video playback method and device

technical field

The present invention relates to the field of multimedia technologies, in particular to an audio and video playing method and device.

Background technique

With the development of multimedia technology, video terminals are more and more widely used, such as video conferencing terminals. The current video conferencing terminals include common terminal devices such as mobile phones, tablets, and PCs. Since the hardware devices of terminal devices are fixed, The audio and video decoding capabilities of the corresponding video conferencing terminals are also constant, wherein the decoding capability indicates whether the original appearance of the video can be reproduced from the video file. If the user feels that the audio and video are distorted when using a video conferencing terminal to play audio and video, it means that the decoding capability of the video conferencing terminal is poor. If you want to upgrade the decoding capability of the video conferencing terminal, you need to use the The hardware device of the terminal is replaced with a hardware device with stronger decoding capability. Obviously, this audio and video playback method consumes a lot of cost.

Contents of the invention

The main purpose of the present invention is to provide a method and device for playing audio and video, aiming at solving the technical problem that the decoding of audio and video by the current video conferencing terminal consumes a lot of cost.

In order to achieve the above object, the present invention provides an audio and video playback method, in which a video terminal is connected to an external device through a preset interface, and the audio and video playback method includes:

When receiving the audio and video files to be decoded sent by other video terminals, the video terminal sends the audio and video files to be decoded to the external device through the preset interface, so that the external device can Decoding the audio and video file to be decoded and feeding back the decoded audio and video data through the preset interface, wherein the decoding capability of the external device is higher than that of the hardware device installed in the video terminal;

When receiving the decoded audio and video data fed back by the external device, play the audio and video corresponding to the audio and video data according to the decoded audio and video data.

Preferably, the video terminal is connected to the external device through a USB interface or a network card interface.

Preferably, the audio and video playback method also includes:

During the connection process between the video terminal and the external device, the video terminal compares the decoding capability of the external device with the decoding capability of the hardware device installed in the video terminal;

When the decoding capability of the external device is higher than that of the installed hardware device, if the audio and video files to be decoded sent by other video terminals are received, the video terminal will execute the decoding of the audio and video files to be decoded through the preset interface. The step of sending audio and video files to the external device;

When the decoding capability of the external device is lower than that of the installed hardware device, the video terminal disconnects from the external device and outputs an alarm message.

Preferably, when the audio and video files to be decoded include a plurality of audio and video files, when receiving the audio and video files to be decoded sent by other video terminals, the audio and video playing method further includes;

The video terminal sends each video file to be decoded to the external device and the installed hardware device, so that the external device and the hardware device can decode the audio and video file to be decoded and Feedback the decoded audio and video data.

Preferably, the audio and video playback method also includes;

The video terminal displays the prompt information of the external device connected to it in the preset display area, wherein the prompt information includes the identification information of the external device and the decoding capability corresponding to the external device. Parameter information.

In addition, in order to achieve the above purpose, the present invention also proposes an audio and video playback device, the audio and video playback device is connected to an external device through a preset interface, and the audio and video playback device includes:

The sending module is configured to send the audio and video files to be decoded to the external device through the preset interface when receiving the audio and video files to be decoded sent by other video terminals, so that the external device can Decoding the audio and video file to be decoded and feeding back the decoded audio and video data through the preset interface, wherein the decoding capability of the external device is higher than that of the hardware device installed in the video terminal;

The playing module is configured to play the audio and video corresponding to the audio and video data according to the decoded audio and video data when receiving the decoded audio and video data fed back by the external device.

Preferably, the audio and video playback device is connected to the external device through a USB interface or a network card interface.

Preferably, the audio and video playback device also includes:

A comparison module, configured to compare the decoding capability of the external device with the decoding capability of the hardware device installed in the video terminal during the connection process between the audio and video playback device and the external device;

The sending module is further configured to, when the decoding capability of the external device is higher than that of the installed hardware device, if the audio and video files to be decoded sent by other video terminals are received, the Send the audio and video files to be decoded to the external device;

A processing module, configured to disconnect the external device and output a warning message when the decoding capability of the external device is lower than that of the installed hardware device.

Preferably, the sending module is further configured to send each video file to be decoded to the external device and the installed hardware device when the audio/video file to be decoded includes multiple audio/video files for The external device and the hardware device decode the audio and video file to be decoded and feed back the decoded audio and video data.

Preferably, the audio and video playback device also includes;

A display module, configured to display prompt information of the external device connected to it in a preset display area, wherein the prompt information includes the identification information of the external device, and the corresponding decoding capability of the external device parameter information.

The audio and video playback method and device proposed by the present invention send audio and video files to be decoded to the external device through a preset interface when the video terminal is connected to the external device, wherein the decoding of the external device The capability is higher than the decoding capability of the hardware device installed in the video terminal, so that the external device can decode the audio and video file to be decoded and feed back the decoded audio and video data through the preset interface. When the decoded audio and video data is fed back by the external device, the audio and video corresponding to the audio and video data are played according to the decoded audio and video data, so that when the decoding ability of the video terminal is low, the decoding ability is higher than that of the video terminal. The external device with decoding capability of the terminal decodes the audio and video files without replacing the hardware device, thereby reducing the cost of audio and video playback by the video terminal.

Description of drawings

Fig. 1 is a schematic flow chart of the first embodiment of the audio and video playback method of the present invention;

Fig. 2 is the structural representation of external equipment among the present invention;

FIG. 3 is a schematic structural diagram of interaction between a video terminal and an external device in the present invention;

Fig. 4 is a schematic diagram of functional modules of the first embodiment of the audio and video playback device of the present invention.

The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

detailed description

It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

The invention provides an audio and video playing method.

Referring to FIG. 1 , FIG. 1 is a schematic flowchart of a first embodiment of an audio and video playback method according to the present invention.

This embodiment proposes an audio and video playback method, in which a video terminal is connected to an external device through a preset interface, and the audio and video playback method includes:

Step S10, when receiving the audio and video files to be decoded sent by other video terminals, the video terminal sends the audio and video files to be decoded to the external device through the preset interface for the external device The device decodes the audio and video file to be decoded and feeds back the decoded audio and video data through the preset interface, wherein the decoding capability of the external device is higher than that of the hardware device installed in the video terminal;

In this embodiment, the video terminal is first connected to the external device through the preset interface, and the way the video terminal is connected to the external device through the preset interface includes:

The video terminal is connected to the external device through a USB interface; that is, the video terminal can be connected to the external device through a universal USB (Universal Serial Bus, Universal Serial Bus) interface, it can be understood that , The video terminal is connected to the external device through the USB interface, no additional connection interface or cable is required, it is easy to use, and can be plug-and-play, and the user does not need to perform any additional complicated operations, and the convenience is high.

Or, the video terminal communicates with the external device through the network card interface, and when the video terminal communicates with the external device through the network card interface, it includes wired communication or wireless communication (such as WIFI) , improving the flexibility of the communication connection.

In this embodiment, the external device is a multimedia encoding and decoding capability enhancement device. Referring to FIG. 2, the external device is embodied as a hardware box, and the internal hardware of the box includes: a main processor chip, responsible for control logic, and control the interaction between other chips and video terminals; audio processing chip, responsible for audio processing on external devices, mainly responsible for encoding and decoding audio data, and interacting with video terminals through the main processor chip; video processing Chip, responsible for video processing on external devices, mainly responsible for encoding and decoding video data, and interacting with video terminals through the main processor chip; program storage chips, including Flash (Flash EEPROM Memory, a memory chip, also known as Flash memory) and ddr (memory) are two parts, which are the chip for storing and running the program data of the external device; the USB interface chip provides the USB interface capability of the external device; in addition, a network card chip can be added to The external device expands the external interface to support the communication connection with the video terminal through a wireless or wired network. It can be understood that the external device in this embodiment adopts an integrated hardware design, which integrates a professional multimedia processing chip and a USB universal interface or a network card interface into a portable hardware box, which is easy to carry, that is, Plug and play, easy to use and so on.

In this embodiment, the video terminal collects the real-time image, voice and related data information of a certain meeting point, compresses and encodes them, and multiplexes (that is, one channel transmits multiple signals at the same time) through the transmission channel Send to other video terminals, and can receive the image, voice and data information sent by other video terminals, decompose, decode, restore the image, voice and data of the other party's site, that is, the video terminal in this embodiment represents video conference terminal. The conference video terminal includes two types of software video conference terminal and hardware video conference terminal, wherein the software video conference terminal is a software video conference system that can run on a general-purpose terminal device, and can provide all functions of the video conference terminal; and The hardware video conferencing terminal is a hardware device specially used for video conferencing. It adopts a professional multimedia processing chip for hardware design and can provide a device for video conferencing functions. The structural connection diagram between the video terminal and the external device can refer to FIG. 3 . It can be seen from FIG. 3 that the video terminal in this embodiment preferably includes a video acquisition module, an audio acquisition module, an audio encoder A decoding module, a video codec module and a display module, that is to say, the video terminal can not only send audio and video files to be decoded to an external device for decoding, but also collect audio and video data, and collect audio and video The data is transmitted to the external device for encoding by the external device, and the specific operation mode is described in detail in the fourth embodiment.

In this embodiment, at the end where the external device is located, after the external device is connected to the video terminal, the built-in software system is first started, and then the connection status of the USB interface or the network card interface is detected. If it is currently connected, then Establish a software connection with the video terminal, and transmit the interactive protocol with the video terminal after the connection is successful, so as to transmit the parameter information of its decoding capability to the video terminal through the interactive protocol, and when the interaction is successful, enter the ready state and wait Receive audio and video data for decoding.

In this embodiment, when receiving the audio and video files to be decoded sent by other video terminals, the video terminal sends the audio and video files to be decoded to the external device through the preset interface for the The external device decodes the audio and video file to be decoded and feeds back the decoded audio and video data through the preset interface. Specifically, the external device uses the preset video processing chip and audio processing chip to The audio and video files are decoded, and the decoded audio and video data is fed back to the video terminal through the preset interface.

Step S20, when the decoded audio and video data fed back by the external device is received, play the audio and video corresponding to the audio and video data according to the decoded audio and video data.

In this embodiment, when the decoded audio and video data fed back by the external device is received, the audio and video corresponding to the audio and video data can be played according to the decoded audio and video data. It can be understood that the external device can be unplugged after the video communication is completed, and at this time, the video communication process between the video terminal and the external device ends.

In the audio and video playback method proposed in this embodiment, when the video terminal is connected to an external device, the audio and video file to be decoded is sent to the external device through a preset interface, wherein the decoding capability of the external device It is higher than the decoding capability of the hardware device installed in the video terminal, so that the external device can decode the audio and video file to be decoded and feed back the decoded audio and video data through the preset interface. When the decoded audio and video data fed back by the external device is described, the audio and video corresponding to the audio and video data are played according to the decoded audio and video data, so that when the decoding ability of the video terminal is low, the decoding ability of the video terminal is higher than that of the video terminal The audio and video files can be decoded by an external device with a strong decoding capability without replacing the hardware device, thereby reducing the cost of audio and video playback on the video terminal.

Further, in order to improve the intelligence of audio and video playback, a second embodiment of the audio and video playback method of the present invention is proposed based on the first embodiment. In this embodiment, the audio and video playback method includes:

During the connection process between the video terminal and the external device, the video terminal compares the decoding capability of the external device with the decoding capability of the hardware device installed in the video terminal;

When the decoding capability of the external device is higher than that of the installed hardware device, if the audio and video files to be decoded sent by other video terminals are received, the video terminal will execute the decoding of the audio and video files to be decoded through the preset interface. The step of sending audio and video files to the external device;

When the decoding capability of the external device is lower than that of the installed hardware device, the video terminal disconnects from the external device and outputs an alarm message.

In this embodiment, during the connection process between the video terminal and the external device, the video terminal first identifies the decoding capability of the external device. It can be understood that the decoding capability indicates whether the video file can The ability to reproduce the original appearance of the video, and the decoding ability is related to parameter information such as bit rate. The higher the bit rate, the stronger the decoding ability. Therefore, during the connection process between the video terminal and the external device, the The video terminal first identifies the code rate in the external device, specifically through the parameter information output in the interactive protocol, that is, the video terminal transmits the parameter information of the agreement with the external device through the interactive protocol, so as to Determining the decoding capability of the external device from the transmitted protocol. After determining the decoding capability of the external device, compare the decoding capability of the external device with the decoding capability of the hardware device installed in the video terminal, the specific comparison method is to compare the decoding capability of the external device The code rate is compared with the code rate of the installed hardware device to determine the relationship between the decoding capability of the external device and the installed hardware device. When the decoding capability of the external device is higher than that of the hardware device installed in the video terminal, if the audio and video files to be decoded sent by other video terminals are received, the video terminal sends the audio and video files to be decoded Send to the external device through the preset interface, so that the external device decodes the audio and video file to be decoded and feeds back the decoded audio and video data through the preset interface. When the decoding capability of the external device is lower than that of the installed hardware device, it means that the external device does not meet the decoding requirements of audio and video files. At this time, the video terminal is disconnected from the external device. The connection relationship of the device, and output alarm information, such as output: "external device is not connected" or "connection has been disconnected" and other text information, or output a whistle with a preset duration of 5S, or through flashing The preset LED light of the video terminal.

In this embodiment, by detecting the decoding capability of the external device and the decoding capability of the hardware device, and when the decoding capability of the external device is lower than the decoding capability of the installed hardware device, the connection with the external device is disconnected. connection relationship, and output alarm information, preventing the decoding operation of the connected external device and video terminal when the decoding ability is still low, thereby improving the intelligence of video decoding.

Of course, when the decoding capability of the external device is lower than or equal to the decoding capability of the installed hardware device, the connection between the video terminal and the external device is not disconnected, and the video terminal uses the installed The hardware device decodes the audio and video file to be decoded to obtain decoded audio and video data, and plays the audio and video corresponding to the audio and video data according to the decoded audio and video data.

That is to say, when the decoding capability of the external device is lower than that of the video terminal, at this time, the video terminal with strong decoding capability is preferentially used for decoding, thereby improving the flexibility of audio and video decoding. Of course, At this time, the connection relationship between the video terminal and the external device is not disconnected first, and when the audio-video file to be decoded includes multiple audio-video files, the decoding operation can be shared by the external device, which reduces the burden on the video terminal. Deal with stress.

Further, in order to improve the flexibility of audio and video playback, the third embodiment of the audio and video playback method of the present invention is proposed based on the first embodiment. In this embodiment, when the audio and video files to be decoded include multiple audio and video files, the Said audio and video playing method also includes:

The video terminal sends each video file to be decoded to the external device and the installed hardware device, so that the external device and the hardware device can decode the audio and video file to be decoded and Feedback the decoded audio and video data.

In this embodiment, when the audio and video files to be decoded include multiple audio and video files, that is, the audio and video files to be decoded sent by multiple video terminals are received at this time, or multiple audio and video files sent sequentially by the same video terminal are received. video file, at this time, the video terminal sends each video file to be decoded to the external device and the installed hardware device respectively, and the specific sending method can be:

The number of audio and video files to be decoded is divided into two parts, and the two parts of video files to be decoded are respectively sent to the external device and the installed hardware device for the external device and the hardware The device decodes the audio and video file to be decoded and feeds back the decoded audio and video data.

Or, one-time polling sends each video file to be decoded to the external device and the installed hardware device, so that the external device and the hardware device can decode the audio and video file to be decoded And feedback the decoded audio and video data.

Or, store each video file to be decoded in the sending queue, sequentially extract the audio and video files to be decoded from the sending queue and send them to the currently idle device, and extract the audio and video to be decoded from the sending queue when another device is idle The file is sent to the currently idle device. For example, the current external device is decoding the previous audio and video file to be decoded, and the hardware device of the video terminal is in an idle state. At this time, if the audio and video file to be decoded is received again file, then the received audio-video file to be decoded is sent to the hardware device of the video terminal for decoding.

Furthermore, a preset allocation strategy can also be obtained, which is set according to specific circumstances, including the three transmission methods described above, and also includes: a. Determining the audio and video to be decoded contained in the waiting queue of the device number of files, and send the audio and video to be decoded received again to the queue with the fewest number in the two waiting queues; b, determine the priority in the waiting queue of the device, and send the audio and video to be decoded received again Video files are sent to the queue with the highest priority among the two waiting queues. The higher the processor usage in the device, the lower the priority accordingly. That is to say, the received audio and video files to be decoded are sent to the processor devices with low occupancy. After the video terminal obtains the preset distribution strategy, according to the obtained distribution strategy, each video file to be decoded can be sent to the external device and the installed hardware device respectively, for all The external device and the hardware device decode the audio and video file to be decoded and feed back the decoded audio and video data, and finally the video terminal plays the audio and video corresponding to the audio and video data according to the decoded audio and video data .

In this embodiment, when the audio-video file to be decoded includes a plurality of audio-video files, each video file to be decoded is sent to the external device and the installed hardware device, instead of the audio-video file to be decoded All are sent to the external device or the hardware device of the video terminal for decoding, but the way of decoding is dynamically adjusted, which reduces the processing pressure on the processor of the external device or the hardware device, and also improves the audio and video files. decoding intelligence.

Further, the audio and video playback method also includes;

The video terminal displays the prompt information of the external device connected to it in the preset display area, wherein the prompt information includes the identification information of the external device and the decoding capability corresponding to the external device. Parameter information, the parameter information is the code rate corresponding to the decoding capability, for example, a value corresponding to the code rate is displayed in a preset display area. Further, the parameter information may also include resolution, and similarly, a numerical value corresponding to the resolution is displayed in a preset display area. It is worth noting that the video terminal displays the prompt information of the external device connected to it in the preset display area, which may be displayed during the connection process between the video terminal and the external device, or may be After the connection is successful, the audio and video files to be decoded are sent to the external device and displayed during the process of receiving the decoded audio and video data fed back by the external device.

From the above description process, it can be seen that the present invention proposes a novel video terminal usage scenario, that is, in the case of limited terminal hardware capabilities and without the need to replace hardware devices, the video conference can be quickly improved. A method of multimedia encoding and decoding capabilities of terminal hardware, which has the advantages of easy to use, easy to use, and cost saving

Further, in order to improve the flexibility of audio and video playback, a fourth embodiment of the audio and video playback method of the present invention is proposed based on the first, second, and third embodiments. In this embodiment, the communication method of the video terminal further includes ;

The video terminal collects audio and video data to be encoded, and sends the audio and video data to be encoded to the external device through the preset interface, so that the external device can encode the audio and video data to be encoded and Feedback the encoded audio and video files through the preset interface, wherein the encoding capability of the external device is higher than the encoding capability of the hardware device installed in the video terminal;

When receiving the encoded audio and video files fed back by the external device, the encoded audio and video files are sent to other video terminals.

Further, when the encoding capability of the external device is lower than or equal to the encoding capability of the installed hardware device, the video conferencing terminal uses the hardware device to encode the audio and video data to be encoded to obtain Encoded audio and video files, and send the encoded audio and video files to other video terminals.

Further, when the audio and video data to be encoded includes a plurality of audio and video data, the video terminal sends each audio and video data to be encoded to the external device and the installed hardware device, for the external The configuration device and the hardware device encode the audio and video data and feed back the encoded audio and video data.

Further, in this embodiment, the several hardware chips mentioned in the external device can also be implemented by software, and the external device can even directly include audio and video acquisition chips, etc., that is, not only realize The audio and video data sent by the video terminal is encoded, and the audio and video data can also be collected by the acquisition chip to directly encode the audio and video data.

The present invention provides a method for directly upgrading the decoding capability of a video terminal, which can conveniently upgrade the hardware capability of the user's existing video terminal and save the cost of replacing new equipment for the user. The device is connected to the video conferencing terminal with a general USB interface, which is convenient and quick to use, especially for the use of general terminal devices such as mobile phones, tablets, PCs, etc. to install software for video conferencing. Since professional video conferencing terminals are relatively weak, the present invention can quickly improve the multimedia encoding and decoding capabilities of user software video conferencing.

The present invention further provides an audio and video playing device.

Referring to FIG. 4 , FIG. 4 is a schematic diagram of functional modules of the first embodiment of the audio and video playback device of the present invention.

It should be emphasized that, for those skilled in the art, the functional block diagram shown in FIG. 4 is only an example diagram of a preferred embodiment. Those skilled in the art revolve around the functional modules of the audio and video playback device shown in FIG. 4 , Can easily carry out the supplement of new function module; The name of each function module is self-defined name, only for assisting each program function block of understanding this audio-video playing device, is not used for limiting the technical scheme of the present invention, the technical scheme of the present invention The core is the function to be achieved by each function module with a custom name.

This embodiment proposes an audio and video playback device, the audio and video playback device is connected to an external device through a preset interface, and the audio and video playback device includes:

The sending module 10 is configured to send the audio and video files to be decoded to the external device through the preset interface when receiving the audio and video files to be decoded sent by other video terminals, for the external device Decoding the audio and video file to be decoded and feeding back the decoded audio and video data through the preset interface, wherein the decoding capability of the external device is higher than that of the hardware device installed in the video terminal;

In this embodiment, the audio and video playback device is first connected to the external device through a preset interface, and the ways in which the audio and video playback device is connected to the external device through a preset interface include:

The audio-video player is connected with the external device through a USB interface; that is, the audio-video player can be connected with the external device through a general USB (Universal Serial Bus, Universal Serial Bus) interface, It can be understood that the audio and video playback device is connected to the external device through the USB interface, no additional connection interface or cable is required, it is easy to use, and can be plug-and-play, and the user does not need to perform any additional operations. Complex operation, high convenience.

Or, the audio-video playback device communicates with the external device through the network card interface, and when the audio-video playback device communicates with the external device through the network card interface, it includes wired communication or wireless communication (such as WIFI ) two ways to improve the flexibility of the communication connection.

In this embodiment, the external device is a multimedia encoding and decoding capability enhancement device. Referring to FIG. 2, the external device is embodied as a hardware box, and the internal hardware of the box includes: a main processor chip, responsible for control logic, and control the interaction between other chips and video terminals; audio processing chip, responsible for audio processing on external devices, mainly responsible for encoding and decoding audio data, and interacting with video terminals through the main processor chip; video processing Chip, responsible for video processing on external devices, mainly responsible for encoding and decoding video data, and interacting with video terminals through the main processor chip; program storage chips, including Flash (Flash EEPROM Memory, a memory chip, also known as Flash memory) and ddr (memory) are two parts, which are the chip for storing and running the program data of the external device; the USB interface chip provides the USB interface capability of the external device; in addition, a network card chip can be added to The external device expands the external interface to support the communication connection with the video terminal through a wireless or wired network. It can be understood that the external device in this embodiment adopts an integrated hardware design, which integrates a professional multimedia processing chip and a USB universal interface or a network card interface into a portable hardware box, which is easy to carry, that is, Plug and play, easy to use and so on.

In this embodiment, the audio and video playback device is the video terminal, and the video terminal collects real-time images, voices and related data information of a certain meeting point, compresses and encodes them, and multiplexes them (i.e. A channel transmits multiple signals at the same time) and sends them to other video terminals through the transmission channel, and can receive the image, voice and data information sent by other video terminals, decompose and decode them, and restore them to the image, voice and data of the other party's venue. That is, the video terminal in this embodiment represents a video conference terminal. The video conferencing terminal includes two types: a software video conferencing terminal and a hardware video conferencing terminal, wherein the software video conferencing terminal is a software video conferencing system that can run on a general-purpose terminal device and can provide all functions of the video conferencing terminal; and The hardware video conferencing terminal is a hardware device specially used for video conferencing. It adopts a professional multimedia processing chip for hardware design and can provide a device for video conferencing functions. The structural connection diagram between the video terminal and the external device can refer to FIG. 3 . It can be seen from FIG. 3 that the video terminal in this embodiment preferably includes a video acquisition module, an audio acquisition module, an audio encoder A decoding module, a video codec module and a display module, that is to say, the video terminal can not only send audio and video files to be decoded to an external device for decoding, but also collect audio and video data, and collect audio and video The data is transmitted to the external device for encoding by the external device, and the specific operation mode is described in detail in the fourth embodiment.

In this embodiment, at the end where the external device is located, after the external device is connected to the video terminal, the built-in software system is first started, and then the connection status of the USB interface or the network card interface is detected. If it is currently connected, then Establish a software connection with the video terminal, and transmit the interactive protocol with the video terminal after the connection is successful, so as to transmit the parameter information of its decoding capability to the video terminal through the interactive protocol, and when the interaction is successful, enter the ready state and wait Receive audio and video data for decoding.

In this embodiment, when the sending module 10 receives the audio and video files to be decoded sent by other video terminals, it sends the audio and video files to be decoded to the external device through the preset interface for The external device decodes the audio and video file to be decoded and feeds back the decoded audio and video data through the preset interface. Specifically, the external device uses a preset video processing chip and an audio processing chip to The audio and video files are decoded, and the decoded audio and video data is fed back to the video terminal through the preset interface.

The playing module 20 is configured to play the audio and video corresponding to the audio and video data according to the decoded audio and video data when receiving the decoded audio and video data fed back by the external device.

In this embodiment, upon receiving the decoded audio and video data fed back by the external device, the playing module 20 can play the audio and video corresponding to the audio and video data according to the decoded audio and video data. It can be understood that the external device can be unplugged after the video communication is completed, and at this time, the video communication process between the video terminal and the external device ends.

The audio and video playback device proposed in this embodiment sends the audio and video files to be decoded to the external device through a preset interface when the video terminal is connected to the external device, wherein the decoding capability of the external device It is higher than the decoding capability of the hardware device installed in the video terminal, so that the external device can decode the audio and video file to be decoded and feed back the decoded audio and video data through the preset interface. When the decoded audio and video data fed back by the external device is described, the audio and video corresponding to the audio and video data are played according to the decoded audio and video data, so that when the decoding ability of the video terminal is low, the decoding ability of the video terminal is higher than that of the video terminal The audio and video files can be decoded by an external device with a strong decoding capability without replacing the hardware device, thereby reducing the cost of audio and video playback on the video terminal.

Further, in order to improve the intelligence of audio and video playback, a second embodiment of the audio and video playback device of the present invention is proposed based on the first embodiment. In this embodiment, the audio and video playback device includes:

A comparison module, configured to compare the decoding capability of the external device with the decoding capability of the hardware device installed in the video terminal during the connection process between the audio and video playback device and the external device;

The sending module 10 is further configured to, when the decoding capability of the external device is higher than that of the installed hardware device, if the audio and video files to be decoded sent by other video terminals are received, the The audio and video files to be decoded are sent to the external device;

A processing module, configured to disconnect the external device and output a warning message when the decoding capability of the external device is lower than that of the installed hardware device.

In this embodiment, during the connection process between the video terminal and the external device, the decoding capability of the external device is first identified. It can be understood that the decoding capability indicates whether the video can be reproduced from the video file. The original appearance, and the decoding ability is related to parameter information such as code rate, the higher the code rate, the stronger the decoding ability, therefore, in the connection process between the video terminal and the external device, first identify the external device The code rate in the device can be specifically identified through the parameter information output in the interactive protocol, that is, the video terminal transmits the parameter information of the protocol with the external device through the interactive protocol, so as to determine the Decoding capabilities of external devices. After determining the decoding capability of the external device, the comparison module compares the decoding capability of the external device with the decoding capability of the hardware device installed in the video terminal. The specific comparison method is to compare the The code rate of the external device is compared with the code rate of the installed hardware device to determine the relationship between the decoding capabilities of the external device and the installed hardware device. When the decoding capability of the external device is higher than the decoding capability of the hardware device installed in the video terminal, if the audio and video files to be decoded sent by other video terminals are received, the sending module 10 sends the audio and video files to be decoded The file is sent to the external device through the preset interface, so that the external device can decode the audio and video file to be decoded and feed back the decoded audio and video data through the preset interface. When the decoding capability of the external device is lower than that of the installed hardware device, it means that the external device does not meet the decoding requirements of audio and video files. At this time, the processing module disconnects the connection with the external device relationship, and output alarm information, such as output: "external device is not connected" or "connection has been disconnected" and other text information, or output a whistle with a preset duration such as 5S, or flash the video terminal by flashing Set LED lights.

In this embodiment, by detecting the decoding capability of the external device and the decoding capability of the hardware device, and when the decoding capability of the external device is lower than the decoding capability of the installed hardware device, the connection with the external device is disconnected. connection relationship, and output alarm information, preventing the decoding operation of the connected external device and video terminal when the decoding ability is still low, thereby improving the intelligence of video decoding.

Of course, the video playback device also includes a decoding module, configured to not disconnect the video terminal from the external device when the decoding capability of the external device is lower than or equal to the decoding capability of the installed hardware device. connection relationship, the decoding module decodes the audio and video file to be decoded through the installed hardware device to obtain decoded audio and video data, and the playback module 20 plays the audio and video file according to the decoded audio and video data The audio and video corresponding to the audio and video data.

That is to say, when the decoding capability of the external device is lower than that of the video terminal, at this time, the video terminal with strong decoding capability is preferentially used for decoding, thereby improving the flexibility of audio and video decoding. Of course, At this time, the connection relationship between the video terminal and the external device is not disconnected first, and when the audio-video file to be decoded includes multiple audio-video files, the decoding operation can be shared by the external device, reducing the number of video terminals. handling pressure.

Further, in order to improve the flexibility of audio and video playback, the third embodiment of the audio and video playback device of the present invention is proposed based on the first embodiment. In this embodiment, when the audio and video files to be decoded include multiple audio and video files, the The audio and video playback device includes:

The sending module 10 is further configured to send each video file to be decoded to the external device and the installed hardware device when the audio/video file to be decoded includes a plurality of audio/video files, for the The external device and the hardware device decode the audio and video file to be decoded and feed back the decoded audio and video data.

In this embodiment, when the audio and video files to be decoded include multiple audio and video files, that is, the audio and video files to be decoded sent by multiple video terminals are received at this time, or multiple audio and video files sent sequentially by the same video terminal are received. video file, at this time, the sending module 10 sends each video file to be decoded to the external device and the installed hardware device respectively, and the specific sending method can be:

The number of audio and video files to be decoded is divided into two parts, and the two parts of video files to be decoded are respectively sent to the external device and the installed hardware device for the external device and the hardware The device decodes the audio and video file to be decoded and feeds back the decoded audio and video data.

Or, one-time polling sends each video file to be decoded to the external device and the installed hardware device, so that the external device and the hardware device can decode the audio and video file to be decoded And feedback the decoded audio and video data.

Or, store each video file to be decoded in the sending queue, sequentially extract the audio and video files to be decoded from the sending queue and send them to the currently idle device, and extract the audio and video to be decoded from the sending queue when another device is idle The file is sent to the currently idle device. For example, the current external device is decoding the previous audio and video file to be decoded, and the hardware device of the video terminal is in an idle state. At this time, if the audio and video file to be decoded is received again file, then the received audio-video file to be decoded is sent to the hardware device of the video terminal for decoding.

Further, the audio and video playback device may also include an acquisition module, configured to acquire a preset distribution strategy, which is set according to specific circumstances, including the three transmission methods described above, and also includes: a. Determine the number of audio and video files to be decoded contained in the waiting queue of the device, and send the audio and video to be decoded to be received again to the queue with the fewest numbers in the two waiting queues; b, determine the number of audio and video files in the waiting queue of the device priority, and send the audio and video files to be decoded again to the queue with higher priority among the two waiting queues, wherein the higher the processor usage in the device, the lower the priority accordingly, that is to say, the The received audio and video files to be decoded are sent to devices with a low processor occupancy rate, and the sending module 10 is also used to send each video file to be decoded to the device according to the obtained distribution strategy. In the external device and the installed hardware device, the external device and the hardware device decode the audio and video file to be decoded and feed back the decoded audio and video data, and finally the video terminal according to The decoded audio and video data plays the audio and video corresponding to the audio and video data.

In this embodiment, when the audio-video file to be decoded includes a plurality of audio-video files, each video file to be decoded is sent to the external device and the installed hardware device, instead of the audio-video file to be decoded All are sent to the external device or the hardware device of the video terminal for decoding, but the way of decoding is dynamically adjusted, which reduces the processing pressure on the processor of the external device or the hardware device, and also improves the audio and video files. decoding intelligence.

Further, the audio and video playback device also includes;

A display module, configured to display prompt information of the external device connected to it in a preset display area, wherein the prompt information includes the identification information of the external device, and the corresponding decoding capability of the external device Parameter information, the parameter information is the code rate corresponding to the decoding capability, for example, the value corresponding to the code rate is displayed in the preset display area. Further, the parameter information may also include resolution, and similarly, a numerical value corresponding to the resolution is displayed in a preset display area. It is worth noting that the display module displays the prompt information of the external device connected to it in the preset display area, which can be displayed during the connection process between the video terminal and the external device, or can be After the connection is successful, the audio and video files to be decoded are sent to the external device and displayed during the process of receiving the decoded audio and video data fed back by the external device.

From the above description process, it can be seen that the present invention proposes a novel video terminal usage scenario, that is, in the case of limited terminal hardware capabilities and without the need to replace hardware devices, the video conference can be quickly improved. A method of multimedia encoding and decoding capabilities of terminal hardware, which has the advantages of easy to use, easy to use, and cost saving

Further, in order to improve the flexibility of audio and video playback, a fourth embodiment of the audio and video playback device of the present invention is proposed based on the first, second and third embodiments. In this embodiment, the communication device of the video terminal further includes ;

The sending module 10 is also used to collect audio and video data to be encoded, and send the audio and video data to be encoded to the external device through the preset interface, so that the external device can process the audio and video data to be encoded. Encoding the video data and feeding back the encoded audio and video files through the preset interface, wherein the encoding capability of the external device is higher than the encoding capability of the hardware device installed in the video terminal;

The sending module 10 is further configured to send the encoded audio and video files to other video terminals when receiving the encoded audio and video files fed back by the external device.

Further, the processing module is further configured to encode the audio and video data to be encoded through the hardware device when the encoding capability of the external device is lower than or equal to the encoding capability of the installed hardware device , to obtain encoded audio and video files, and send the encoded audio and video files to other video terminals.

Further, the sending module 10 is also configured to send each audio and video data to be encoded to the external device and the installed hardware device respectively when the audio and video data to be encoded includes a plurality of audio and video data, The external device and the hardware device encode the audio and video data and feed back the encoded audio and video data.

Further, in this embodiment, the several hardware chips mentioned in the external device can also be implemented by software, and the external device can even directly include audio and video acquisition chips, etc., that is, not only realize The audio and video data sent by the video terminal is encoded, and the audio and video data can also be collected by the acquisition chip to directly encode the audio and video data.

The present invention provides a device for directly upgrading the decoding capability of a video terminal, which can conveniently upgrade the hardware capability of the user's existing video terminal, saving the cost of replacing new equipment for the user, and the external device provided by the present invention The device is connected to the video conferencing terminal with a general USB interface, which is convenient and quick to use, especially for the use of general terminal devices such as mobile phones, tablets, PCs, etc. to install software for video conferencing. Since professional video conferencing terminals are relatively weak, the present invention can quickly improve the multimedia encoding and decoding capabilities of user software video conferencing.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or system comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or system. Without further limitations, an element defined by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article or system comprising that element.

The serial numbers of the above embodiments of the present invention are for description only, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to make a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in various embodiments of the present invention.

The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related technical fields , are all included in the scope of patent protection of the present invention in the same way.

Claims (10)

1. A method for playing audio and video, characterized in that the video terminal is connected with an external device through a preset interface, and the method for playing audio and video may further comprise the steps: When receiving the audio and video files to be decoded sent by other video terminals, the video terminal sends the audio and video files to be decoded to the external device through the preset interface, so that the external device can Decoding the audio and video file to be decoded and feeding back the decoded audio and video data through the preset interface, wherein the decoding capability of the external device is higher than that of the hardware device installed in the video terminal; When receiving the decoded audio and video data fed back by the external device, play the audio and video corresponding to the audio and video data according to the decoded audio and video data. 2. The audio and video playback method according to claim 1, wherein the video terminal is connected to the external device through a USB interface or a network card interface. 3. audio and video playing method as claimed in claim 1, is characterized in that, described audio and video playing method also comprises: During the connection process between the video terminal and the external device, the video terminal compares the decoding capability of the external device with the decoding capability of the hardware device installed in the video terminal; When the decoding capability of the external device is higher than the decoding capability of the installed hardware device, if the audio and video files to be decoded sent by other video terminals are received, the video terminal will execute the decoding of the audio and video files to be decoded through the preset interface. The step of sending audio and video files to the external device; When the decoding capability of the external device is lower than that of the installed hardware device, the video terminal disconnects from the external device and outputs an alarm message. 4. The audio and video playing method as claimed in claim 1, wherein when the audio and video file to be decoded comprises a plurality of audio and video files, when receiving the audio and video file to be decoded sent by other video terminals, the The audio and video playback method also includes; The video terminal sends each video file to be decoded to the external device and the installed hardware device, so that the external device and the hardware device can decode the audio and video file to be decoded and Feedback the decoded audio and video data. 5. The audio and video playback method according to any one of claims 1-4, wherein the audio and video playback method further comprises; The video terminal displays the prompt information of the external device connected to it in the preset display area, wherein the prompt information includes the identification information of the external device and the decoding capability corresponding to the external device. Parameter information. 6. An audio and video playback device, characterized in that, the audio and video playback device is connected to an external device through a preset interface, and the audio and video playback device includes: The sending module is configured to send the audio and video files to be decoded to the external device through the preset interface when receiving the audio and video files to be decoded sent by other video terminals, so that the external device can Decoding the audio and video file to be decoded and feeding back the decoded audio and video data through the preset interface, wherein the decoding capability of the external device is higher than that of the hardware device installed in the video terminal; The playing module is configured to play the audio and video corresponding to the audio and video data according to the decoded audio and video data when receiving the decoded audio and video data fed back by the external device. 7. The audio and video playback device according to claim 6, wherein the audio and video playback device is connected to the external device through a USB interface or a network card interface. 8. The audio and video playback device as claimed in claim 6, wherein the audio and video playback device further comprises: A comparison module, configured to compare the decoding capability of the external device with the decoding capability of the hardware device installed in the video terminal during the connection process between the audio and video playback device and the external device; The sending module is further configured to, when the decoding capability of the external device is higher than that of the installed hardware device, if the audio and video files to be decoded sent by other video terminals are received, the Send the audio and video files to be decoded to the external device; A processing module, configured to disconnect the external device and output a warning message when the decoding capability of the external device is lower than that of the installed hardware device. 9. The audio and video playback device according to claim 6, wherein the sending module is also used to send each video file to be decoded to the The external device and the installed hardware device are used for the external device and the hardware device to decode the audio and video file to be decoded and feed back the decoded audio and video data. 10. The audio and video playback device according to any one of claims 6-9, wherein the audio and video playback device further comprises; A display module, configured to display prompt information of the external device connected to it in a preset display area, wherein the prompt information includes the identification information of the external device, and the corresponding decoding capability of the external device parameter information.