HK40051647B - A video definition switching method, device, electronic equipment and storage medium - Google Patents

Description

A method, apparatus, electronic device, and storage medium for switching video resolution.

Technical Field

This application relates to the field of computer technology, and specifically to a method, apparatus, electronic device, and storage medium for switching video resolution.

Background Technology

With the development of internet technology, users can now watch videos online using their devices. Videos from a single online source typically come in multiple bitrates, each offering different levels of clarity. Users can manually select the bitrate they wish to watch based on their viewing needs.

Currently, the main solution for switching video resolution is based on the real-time streaming media protocol (HTTP Live Streaming, HLS). This means that the video file is first divided into segments, and when switching resolutions, the segments are reloaded. However, the current switching solution has the problem of frame skipping, which consumes a lot of bandwidth.

Summary of the Invention

This invention provides a method, apparatus, electronic device, and storage medium for switching video resolution, which can solve the problem of frame skipping playback and thus reduce data consumption.

This invention provides a method for switching video resolution, including:

Get the currently playing video;

When a user-triggered request to switch video resolution is received, a video to be switched that is identical to the content of the currently playing video is obtained, wherein the bitrate of the currently playing video is different from that of the video to be switched.

Load the index data corresponding to the video to be switched;

Extract the current keyframe of the currently playing video to obtain the current keyframe;

Based on the current keyframe and index data, determine the keyframe in the video to be switched that corresponds to the current keyframe, and obtain the switching keyframe.

Based on the current keyframe, the switching keyframe, and the index data, the currently playing video is switched to the video to be switched.

Accordingly, embodiments of the present invention also provide a video resolution switching device, comprising:

The first acquisition module is used to acquire the currently playing video and obtain the currently playing video.

The second acquisition module is used to acquire a video to be switched that is consistent with the content of the currently playing video when a user-triggered video resolution switching request is received, wherein the bitrate of the currently playing video is different from the bitrate of the video to be switched.

A loading module is used to load the index data corresponding to the video to be switched.

The extraction module is used to extract the current keyframe of the currently playing video and obtain the current keyframe.

The determination module is used to determine the key frame in the video to be switched that corresponds to the current key frame based on the current key frame and index data, and obtain the switching key frame.

The switching module is used to switch the currently playing video to the video to be switched based on the current keyframe, the switching keyframe, and index data.

Optionally, in some embodiments of the present invention, the determining module includes:

The acquisition submodule is used to acquire the video data where the current keyframe is located from the currently playing video to obtain the first video data;

The determination submodule is used to select key frames that meet preset conditions in the video to be switched based on the first video data, the current key frame, and index data, and obtain the switching key frame.

Optionally, in some embodiments of the present invention, the determining submodule includes:

The acquisition unit is used to acquire the position of the current keyframe in the first video data and obtain the position information corresponding to the current keyframe.

The selection unit is used to select key frames that meet preset conditions in the video to be switched according to the index data, so as to obtain the switching key frames.

Optionally, in some embodiments of the present invention, the selection unit includes:

A loading subunit is used to load the video data corresponding to the video to be switched based on the index data to obtain the second video data;

The selection sub-unit is used to select a key frame that matches the location information in the second video data to obtain a switching key frame.

Optionally, in some embodiments of the present invention, the acquisition subunit is specifically used for:

Extract the timestamp corresponding to the current keyframe to obtain the first timestamp, and

Extract the timestamps corresponding to each keyframe in the second video data to obtain multiple second timestamps;

The key frame whose second timestamp matches the first timestamp is determined as the key frame corresponding to the current key frame, thus obtaining the switching key frame.

Optionally, in some embodiments of the present invention, the switching module is specifically used for:

Determine the video data that has been played in the currently playing video based on the current keyframe;

The video data that needs to be loaded for the video to be switched is calculated using the current keyframe, the already played video data, and the index data.

The preset video data buffer is updated by the video data to be loaded, resulting in the updated buffer;

Starting from the switching keyframe, based on the video data to be loaded and the updated buffer, the currently playing video is switched to the video to be switched.

Optionally, in some embodiments of the present invention, a deletion module is further included, which is specifically used to delete the video data corresponding to the currently playing video in the updated buffer.

Optionally, in some embodiments of the present invention, a construction module is further included, the construction module being specifically used for:

Construct a video data buffer;

The video data corresponding to the currently playing video is loaded into the video data buffer.

In this embodiment of the invention, after obtaining the currently playing video, when a user-triggered request to switch video resolution is received, a video to be switched to with content identical to the currently playing video is obtained, provided that the bitrate of the currently playing video is different from that of the video to be switched to. Then, the index data corresponding to the video to be switched to is loaded. Next, the current keyframe of the currently playing video is extracted to obtain the current keyframe. Then, based on the current keyframe and the index data, the keyframe in the video to be switched that corresponds to the current keyframe is determined to obtain the switching keyframe. Finally, based on the current keyframe, the switching keyframe, and the index data, the currently playing video is switched to the video to be switched to. Therefore, this solution can solve the problem of frame skipping during playback, thereby reducing data consumption.

Attached Figure Description

To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

Figure 1a is a schematic diagram of a scenario for the video resolution switching method provided in an embodiment of the present invention;

Figure 1b is a flowchart illustrating the video resolution switching method provided in an embodiment of the present invention;

Figure 2a is another flowchart illustrating the video resolution switching method provided in an embodiment of the present invention;

Figure 2b is a schematic diagram of the display page corresponding to the currently playing video in the video clarity switching method provided in the embodiment of the present invention;

Figure 2c is a schematic diagram of a video frame in the video resolution switching method provided in the embodiment of the present invention;

Figure 2d is a schematic diagram of switching the video to be switched in the video clarity switching method provided in the embodiment of the present invention;

Figure 3a is a schematic diagram of the first embodiment of the video resolution switching device provided in this invention;

Figure 3b is another structural schematic diagram of a second embodiment of the video resolution switching device provided in this invention;

Figure 3c is a structural schematic diagram of a third embodiment of the video resolution switching device provided in this invention;

Figure 4 is a schematic diagram of the structure of the electronic device provided in an embodiment of the present invention.

Detailed Implementation

The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

This invention provides a method, apparatus, electronic device, and storage medium for switching video resolution.

Specifically, the video resolution switching device can be integrated into the terminal, which may include a mobile phone, tablet computer, or personal computer (PC).

Please refer to Figure 1a. This embodiment of the invention provides a video resolution switching system (hereinafter referred to as the switching system). The switching system may include a terminal, a server, and a user. Taking the video resolution switching device integrated into a personal computer as an example, the personal computer may have a client installed. The client may be any client that can provide video playback services, such as a browser-based web client. The video playback service can support users to watch videos through a browser. During the video viewing process, users can also switch the video resolution of the same video. For example, when a user needs to switch the video resolution of the currently playing video, a video to be switched with the same content as the currently playing video is obtained. The bitrate of the video to be switched is different from that of the currently playing video. Then, the index data corresponding to the video to be switched is loaded. Next, the current keyframe of the currently playing video is extracted to obtain the current keyframe. Then, based on the current keyframe and the index data, the keyframe in the video to be switched that corresponds to the current keyframe is determined to obtain the switching keyframe. Finally, based on the current keyframe, the switching keyframe, and the index data, the currently playing video is switched to the video to be switched.

This solution determines the corresponding keyframe (i.e., the switching keyframe) in the video to be switched based on the current keyframe and index data. Then, based on the current keyframe, the switching keyframe, and index data, the currently playing video is switched to the video to be switched. In other words, this solution switches video clarity based on keyframes. Therefore, it can solve the problem of frame skipping in existing solutions and reduce bandwidth consumption.

The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the priority of the embodiments.

A method for switching video resolution includes: acquiring the currently playing video; when receiving a video resolution switching request triggered by a user, acquiring a video to be switched that has the same content as the currently playing video; loading the index data corresponding to the video to be switched; extracting the current keyframe of the currently playing video; determining the keyframe in the video to be switched that corresponds to the current keyframe based on the current keyframe and the index data; obtaining the switching keyframe; and switching the currently playing video to the video to be switched based on the current keyframe, the switching keyframe, and the index data.

Please refer to Figure 1b, which is a flowchart illustrating the video resolution switching method provided in an embodiment of the present invention. The specific flow of this video resolution switching method can be as follows:

101. Get the currently playing video.

There are several ways to obtain the currently playing video. For example, it can be obtained from the Internet and/or a specified database. The specific method depends on the actual application requirements. The currently playing video can include TV series, movies, and user-recorded videos, etc.

It should be noted that before switching videos, a video data buffer can be constructed. This buffer can be used to store and manage video source data segments. Optionally, before the step "obtain the currently playing video," the following additional steps may be included:

(11) Construct a video data buffer;

(12) Load the video data corresponding to the currently playing video into the video data buffer.

For example, if the currently playing video is video A before the video switch, then the video data buffer can load the video data corresponding to video A.

102. When a user-triggered request to switch video resolution is received, obtain the video to be switched that is consistent with the content of the currently playing video.

The bitrate of the currently playing video is different from the bitrate of the video to be switched. Bitrate is the number of bits of data transmitted per unit time during data transmission, and the unit is kbps (kilobits per second). It is also called sampling rate. The higher the sampling rate per unit time, the higher the accuracy, and the closer the processed file is to the original file. The higher the bitrate, the clearer the picture, and vice versa.

For example, when a user triggers a video resolution switching request, the switching request instructs that video A be switched to video B. That is, video A is the currently playing video, and video B is the video to be switched to. The content of video A is the same as that of video B, but the bitrate of video A is different from that of video B.

103. Load the index data corresponding to the video to be switched.

In this embodiment of the invention, during video playback, the terminal and the server follow a video transmission protocol, which may include Real Time Messaging Protocol (RTMP) and HLS (HTTP Live Streaming) protocol, etc. Unless otherwise specified, the following embodiments of the present invention will use the HLS protocol as an example. The HLS protocol is a streaming media solution that includes a video index and video segments. The video index contains a lot of basic information about the video stream. When a user plays a video through a terminal, the video index is not played directly, but the video index is parsed to obtain the index of each video segment, and the URL of the corresponding video segment is found and played according to the index. Each video segment is a segment of video content to be played, which includes data such as the timestamp of the key frame and the video content corresponding to the timestamp. For example, the format of the currently playing video and the video to be switched is the Moving Picture Experts Group 4 (MP4) format. For an MP4 file, the most important thing is the index data. The index data (also known as the header file) records the decoding information, timestamps, and positions of all subsequent audio and video frames. Of course, the same applies to switching the clarity of the currently playing video based on other streaming media protocols, which will not be elaborated here.

104. Extract the current keyframe of the currently playing video to obtain the current keyframe.

The video frames can include keyframes (I-frames), forward prediction frames (P-frames), and bidirectional prediction frames (B-frames). I-frames are internally encoded frames, the first frame of each image, and a complete picture. P-frames are forward prediction frames, which record changes relative to I-frames or the adjacent previous P-frame. B-frames are bidirectional interpolated frames. The difference between B-frames and P-frames is that B-frames can refer to I-frames or the adjacent previous frame, or they can refer to the adjacent next frame. That is, P-frames record changes relative to adjacent frames. In other words, to play a short segment of the picture, I-frames must be found, and then the corresponding B-frames and P-frames can be decoded successfully. It should be noted that the order of steps 103 and 104 is not limited.

105. Based on the current keyframe and index data, determine the keyframe in the video to be switched that corresponds to the current keyframe, and obtain the switching keyframe.

Since the content of the currently playing video is the same as the video to be switched, that is, the number of images recorded in the two videos is the same, the number of keyframes corresponding to the two videos is also the same. In other words, every keyframe in the video to be switched has a corresponding keyframe in the currently playing video. In this embodiment of the invention, the keyframe corresponding to the current keyframe in the video to be switched can be determined based on the current keyframe and index data. The difference lies in the different states of the two video frames. For example, when a user receives a request to switch the video clarity triggered by video A, the switching request indicates to switch to video B. At this time, keyframe I1 of video A is playing, so video frame I1 is determined to be the current keyframe. Based on video frame I1 and index data, the keyframe corresponding to video frame I1 in video B is determined to be keyframe I2, and then keyframe I2 is determined to be the switching keyframe.

For example, video data containing the current keyframe can be obtained from the currently playing video. Based on this video data, the current keyframe, and index data, the keyframe corresponding to the current keyframe in the video to be switched can be determined. That is, optionally, in some embodiments, the step "determining the keyframe corresponding to the current keyframe in the video to be switched based on the current keyframe and index data, and obtaining the switching keyframe" can specifically include:

(21) Obtain the video data of the current keyframe from the currently playing video to obtain the first video data;

(22) Select a key frame that meets the preset conditions in the video to be switched based on the first video data, the current key frame and the index data to obtain the switching key frame.

For example, based on the first video data, the current keyframe, and the index data, a keyframe whose image content is consistent with the current keyframe can be selected in the video to be switched to obtain the switching keyframe. Specifically, a neural network model can be used to identify the image content of the current keyframe and the image content corresponding to each keyframe in the video to be switched.

For example, the position of the current keyframe in the first video data can be obtained, and then the keyframe corresponding to the current keyframe in the video to be switched can be determined based on the position and index data. Then, the keyframe corresponding to the current keyframe in the video to be switched can be determined again based on the position and index data to obtain the switching keyframe. That is, optionally, the step "selecting keyframes that meet preset conditions in the video to be switched based on the first video data, the current keyframe, and the index data to obtain the switching keyframe" can specifically include:

(31) Obtain the position of the current keyframe in the first video data and get the position information corresponding to the current keyframe;

(32) Select key frames whose location information meets the preset conditions in the video to be switched based on the index data to obtain the switching key frames.

For example, specifically, the position of the current keyframe in the first video data is obtained, indicating that the current keyframe is at the position of the 8th frame in the first video data. Then, the video data corresponding to the video to be switched is loaded based on the index data, and the 8th frame keyframe is selected from the video data corresponding to the video to be switched to obtain the switching keyframe. That is, optionally, in some embodiments, the step "determine the keyframe corresponding to the current keyframe in the video to be switched based on the position information and the index data, and obtain the switching keyframe" may specifically include:

(41) Load the video data corresponding to the video to be switched based on the index data to obtain the second video data;

(42) Select the key frame that matches the location information in the second video data to obtain the switching key frame.

For example, specifically, the index data is parsed, and the video data corresponding to the video to be switched is loaded based on the parsing result to obtain the second video data. Then, the keyframe corresponding to the current keyframe is obtained from the second video data to obtain the switching keyframe. There are two ways to obtain the switching keyframe from the second video data:

The first method is to obtain the keyframe corresponding to the current keyframe from the second video data based on the position information of the current keyframe, and then obtain the switching keyframe. For example, if the current keyframe is the data of the 8th frame, then the 8th frame in the second video data can be determined as the keyframe corresponding to the current keyframe, and the switching keyframe can be obtained.

The second method: Based on the timestamp corresponding to the current keyframe and the timestamps corresponding to each keyframe in the second video data, a keyframe corresponding to the current keyframe can be selected from the second video data. Optionally, in some embodiments, the step "obtaining the keyframe corresponding to the current keyframe in the second video data to obtain the switching keyframe" may specifically include:

(51) Extract the timestamp corresponding to the current key frame to obtain the first timestamp, and extract the timestamp corresponding to each key frame in the second video data to obtain multiple second timestamps;

(52) Determine the key frames whose second timestamps are consistent with the first timestamps as the key frames corresponding to the current key frame to obtain the switching key frame.

For example, if both the currently playing video and the video to be switched are 100 seconds long, and the timestamp of the current keyframe indicates that the current keyframe is the 10th second keyframe, then the 10th second keyframe in the second video data can be determined as the keyframe corresponding to the current keyframe to obtain the switching keyframe. After obtaining the switching keyframe, step 106 can be executed.

106. Based on the current keyframe, the switching keyframe, and the index data, switch the currently playing video to the video to be switched.

For example, specifically, the video data that needs to be loaded for the video to be switched can be calculated based on the current keyframe, the switching keyframe, and the index data. Then, based on the switching keyframe and the video data to be loaded, the currently playing video is switched to play the video to be switched. That is, optionally, in some embodiments, the step "based on the current keyframe, the switching keyframe, and the index data, the currently playing video is switched to play the video to be switched" may specifically include:

(61) Determine the video data that has been played in the current video based on the current keyframe;

(62) Calculate the video data that needs to be loaded for the video to be switched using the current keyframe, the video data that has been played, and the index data;

(63) Update the preset video data buffer with the video data to be loaded to obtain the updated buffer;

(64) Starting from the switching keyframe, based on the switching keyframe and the updated buffer, switch the currently playing video to the video to be switched.

For example, specifically, if the current keyframe is the 3rd keyframe, the video data already played in the currently playing video can be determined based on this keyframe, including the video data of the 1st frame, the 2nd frame, and the 3rd frame. Then, the video data of the video to be switched can be obtained based on the index data, and the video data to be loaded for the video to be switched can be calculated using the current keyframe and the already played video data. Next, the size of the video data buffer to be loaded can be calculated in reverse using the already played video data and the video data to be loaded. That is, the preset video data buffer can be updated using the already played video data and the video data to be loaded. Finally, based on the switching keyframe and the video data to be loaded, the currently playing video is switched to the video to be switched.

To avoid unnecessary bandwidth waste, after switching the currently playing video to the video to be switched, the video data of the previous video in the updated buffer can be deleted. For example, after switching video A to video B, the video data of video A in the updated buffer can be deleted. That is, in some implementations, the step "starting from the switching keyframe, based on the video data to be loaded and the updated buffer, after switching the currently playing video to the video to be switched", can also include: deleting the video data corresponding to the currently playing video in the updated buffer.

This invention first acquires the currently playing video. When a user-triggered video resolution switching request is received, a video to be switched to, identical in content to the currently playing video, is acquired. Then, the index data corresponding to the video to be switched to is loaded. Next, the current keyframe of the currently playing video is extracted. Then, based on the current keyframe and the index data, the corresponding keyframe in the video to be switched is determined, resulting in the switching keyframe. Finally, based on the current keyframe, the switching keyframe, and the index data, the currently playing video is switched to the video to be switched. Compared to existing video resolution switching schemes, this invention's method can determine the corresponding keyframe in the video to be switched based on the current keyframe and the index data, obtaining the switching keyframe. Then, based on the current keyframe, the switching keyframe, and the index data, the currently playing video is switched to the video to be switched. In other words, this scheme performs video resolution switching based on keyframes, thus solving the frame skipping problem in existing schemes and reducing bandwidth consumption.

The method described in the embodiments will be further described in detail below with examples.

In this embodiment, the video resolution switching device will be specifically integrated into the terminal as an example for explanation.

Please refer to Figure 2a, which illustrates a method for switching video resolution. The specific process is as follows:

201. The terminal obtains the currently playing video and gets the currently playing video.

There are several ways for a terminal to obtain the currently playing video. For example, it can obtain it from the Internet and/or a specified database. The specific method depends on the actual application requirements. The currently playing video can include TV series, movies, and user-recorded videos, etc.

It should be noted that before switching videos, the terminal can construct a video data buffer, which can be used to store and manage video source data segments. That is, optionally, in some embodiments, the terminal can specifically construct a video data buffer, and then the terminal loads the video data corresponding to the currently playing video into the video data buffer.

202. When the terminal receives a video resolution switching request triggered by the user, it obtains the video to be switched that is consistent with the content of the currently playing video.

In this scenario, the bitrate of the currently playing video differs from that of the video to be switched. For example, as shown in Figure 2b, the terminal may have a client installed, which can be any client capable of providing video playback services. The terminal's display screen may show a display page corresponding to the currently playing video. This display page may include switching controls A, B, and C. When the terminal receives a video clarity switching request triggered by the user, such as when the terminal detects the user's selection operation on switching control C, it obtains the video to be switched that has the same content as the currently playing video and a clarity corresponding to switching control C.

203. The terminal loads the index data corresponding to the video to be switched.

For an MP4 file, the most important part is the index data. The index data records the decoding information, timestamps, and positions of all subsequent audio and video frames. Of course, the same applies to switching the resolution of the currently playing video based on other streaming media protocols, which will not be elaborated on here.

204. The terminal extracts the current keyframe of the currently playing video and obtains the current keyframe.

The video frames can include keyframes (I-frames), forward prediction frames (P-frames), and bidirectional prediction frames (B-frames). I-frames are internally encoded frames, the first frame of each image, and a complete picture. P-frames are forward prediction frames, recording changes relative to I-frames or the adjacent previous P-frame. B-frames are bidirectional interpolated frames, which differ from P-frames in that they can reference either I-frames or the adjacent previous frame, or the adjacent next frame. That is, P-frames record changes relative to adjacent frames, as shown in Figure 2c. Video playback can be understood as being completed by rendering consecutive picture frames in sequence. However, for video to be transmitted, it must be encoded and compressed. Each small video segment consists of one I-frame and multiple B-frames and P-frames. B-frames and P-frames rely on I-frames for compression encoding. In each video segment, the I-frame is always the first frame. That is to say, to play this small segment, the I-frame must be found first, and then the corresponding B-frames and P-frames can be decoded successfully. It should be noted that the order of steps 203 and 204 is not limited.

205. The terminal determines the key frame in the video to be switched that corresponds to the current key frame based on the current key frame and the index data, and obtains the switching key frame.

Since the content of the currently playing video is identical to that of the video to be switched, meaning the two videos record the same number of images, the number of keyframes corresponding to these two videos is also identical. In other words, every keyframe in the video to be switched has a corresponding keyframe in the currently playing video. For example, the terminal obtains the video data of the currently playing video to get the first video data. Then, the terminal determines the keyframe in the video to be switched that corresponds to the current keyframe based on the first video data, the current keyframe, and the index data, thus obtaining the switching keyframe. Further, for example, specifically, the terminal obtains the position of the current keyframe in the first video data, indicating that the current keyframe is at frame 8 in the first video data. Then, the terminal loads the video data corresponding to the video to be switched based on the index data, and the terminal obtains the keyframe corresponding to the current keyframe in the video data corresponding to the video to be switched based on this position information, thus obtaining the switching keyframe.

206. Based on the current keyframe, the switching keyframe, and the index data, the terminal switches the currently playing video to the video to be switched.

Specifically, the terminal can calculate the video data that needs to be loaded for the video to be switched based on the current keyframe, the switching keyframe, and the index data. Then, based on the switching keyframe and the video data to be loaded, the terminal switches the currently playing video to the video to be switched.

For example, referring to Figure 2d, if the current keyframe is the 3rd keyframe, the terminal can determine the video data already played in the currently playing video, including the video data of the 1st frame, the 2nd frame, and the 3rd frame. Then, the terminal can obtain the video data of the video to be switched based on the index data. The terminal calculates the video data that needs to be loaded for the video to be switched based on the current keyframe and the already played video data. Finally, the terminal switches the currently playing video to the video to be switched based on the switching keyframe and the video data to be loaded. For example, as shown in the figure, the video can be switched at the 3rd frame (I-frame). Or, to improve the smoothness of video playback, the video can be switched in the next frame after the switching keyframe, that is, at the 4th frame (I-frame). The specific settings depend on the actual situation.

Optionally, in some embodiments, after switching to play the video to be switched, the terminal may delete the video data corresponding to the currently playing video from the video data buffer.

As described above, the terminal of this invention first obtains the currently playing video. When it receives a user-triggered request to switch video resolution, the terminal obtains a video to be switched that is identical to the currently playing video. Then, the terminal loads the index data corresponding to the video to be switched. Next, the terminal extracts the current keyframe of the currently playing video. Then, the terminal determines the keyframe in the video to be switched that corresponds to the current keyframe based on the current keyframe and the index data. Finally, the terminal switches the currently playing video to play the video to be switched based on the current keyframe, the switching keyframe, and the index data. Compared to existing video resolution switching schemes, the terminal of this invention can determine the keyframe corresponding to the current keyframe in the video to be switched based on the current keyframe and the index data. Then, the terminal switches the currently playing video to play the video to be switched based on the current keyframe, the switching keyframe, and the index data. In other words, in this scheme, the terminal switches video resolution based on keyframes. Therefore, it can solve the problem of frame skipping in existing schemes, thereby reducing data consumption.

To facilitate better implementation of the video resolution switching method of the present invention, the present invention also provides a video resolution switching device (hereinafter referred to as the switching device). The meanings of the terms are the same as in the video resolution switching method described above, and specific implementation details can be found in the description of the method embodiments.

Please refer to Figure 3a, which is a schematic diagram of the first embodiment of the video resolution switching device provided in this invention. The switching device may include a first acquisition module 301, a second acquisition module 302, a loading module 303, an extraction module 304, a determination module 305, and a switching module 306, as follows:

The first acquisition module 301 is used to acquire the currently playing video and obtain the currently playing video.

The first acquisition module 301 can acquire the currently playing video in various ways, such as from the Internet and/or a specified database. The specific method can be determined according to the actual application requirements. The currently playing video can include TV series, movies, and user-recorded videos, etc.

The second acquisition module 302 is used to acquire the video to be switched that is consistent with the content of the currently playing video when a user-triggered video resolution switching request is received.

The bitrate of the currently playing video is different from the bitrate of the video to be switched. Bitrate is the number of bits of data transmitted per unit time during data transmission, and the unit is kbps (kilobits per second). It is also called sampling rate. The higher the sampling rate per unit time, the higher the accuracy, and the closer the processed file is to the original file. The higher the bitrate, the clearer the picture, and vice versa.

Loading module 303 is used to load the index data corresponding to the video to be switched.

In this embodiment of the invention, during video playback, the terminal and the server follow a video transmission protocol, which may include Real Time Messaging Protocol (RTMP) and HLS (HTTP Live Streaming) protocol, etc. Unless otherwise specified, the following embodiments of the present invention all use the HLS protocol as an example. The HLS protocol is a streaming media solution that includes a video index and video segments. The video index records the index of each video segment. When a user plays a video through a terminal, the video index is not played directly. Instead, the video index is parsed to obtain the index of each video segment, and the URL of the corresponding video segment is found and played according to the index. Each video segment is a segment of video content to be played, which includes data such as a timestamp and the video content corresponding to that timestamp. For example, the format of the currently playing video and the video to be switched is both Moving Picture Experts Group 4 (MP4) format. For an MP4 file, the most important thing is the index data. The index data records the decoding information, timestamps, and positions of all subsequent audio and video frames. Of course, the same applies to switching the clarity of the currently playing video based on other streaming media protocols, which will not be elaborated here.

Extraction module 304 is used to extract the current keyframe of the currently playing video and obtain the current keyframe.

The determination module 305 is used to determine the key frame in the video to be switched that corresponds to the current key frame based on the current key frame and index data, and obtain the switching key frame.

Since the content of the currently playing video is the same as that of the video to be switched, that is, the number of images recorded in the two videos is the same, the number of keyframes corresponding to the two videos is also the same. In other words, every keyframe in the video to be switched has a corresponding keyframe in the currently playing video. In this embodiment of the invention, the determining module 305 can determine the keyframe in the video to be switched that corresponds to the current keyframe based on the current keyframe and the index data.

Optionally, in some embodiments, the determining module 305 may specifically include:

The acquisition submodule is used to obtain the video data of the current keyframe from the currently playing video, and obtain the first video data;

The determination submodule is used to select keyframes that meet preset conditions from the video to be switched based on the first video data, the current keyframe, and the index data, and obtain the switching keyframes.

Optionally, in some embodiments, determining a submodule may specifically include:

The acquisition unit is used to acquire the position of the current keyframe in the first video data and obtain the position information corresponding to the current keyframe.

The selection unit is used to select key frames that meet preset conditions from the video to be switched based on the index data, and obtain the switching key frames.

Optionally, in some embodiments, the selection unit may specifically include:

The loading subunit is used to load the video data corresponding to the video to be switched based on the index data, so as to obtain the second video data.

The selection sub-unit is used to select a keyframe that matches the current keyframe position information in the second video data, thereby obtaining the switching keyframe.

Optionally, in some embodiments, the acquisition subunit may be specifically used to: extract the timestamp corresponding to the current key frame to obtain a first timestamp, and extract the timestamps corresponding to each key frame in the second video data to obtain multiple second timestamps, and determine the key frame whose second timestamp is consistent with the first timestamp as the key frame corresponding to the current key frame to obtain the switching key frame.

The switching module 306 is used to switch the currently playing video to the video to be switched based on the current keyframe, the switching keyframe, and the index data.

For example, specifically, the video data that needs to be loaded for the video to be switched can be calculated based on the current keyframe, the switching keyframe, and the index data. Then, based on the switching keyframe and the video data that needs to be loaded, the currently playing video can be switched to play the video to be switched.

Optionally, in some embodiments, the switching module 306 may be specifically used to: determine the video data already played in the currently playing video based on the current keyframe; calculate the video data to be loaded for the video to be switched using the current keyframe, the already played video data, and index data; update the preset video data buffer using the video data to be loaded to obtain the updated buffer; and, starting from the switching keyframe, switch the currently playing video to play the video to be switched based on the video data to be loaded and the updated buffer.

Optionally, in some embodiments, please refer to Figure 3b, a deletion module 307 is also included, which is specifically used to delete the video data corresponding to the currently playing video in the updated buffer.

Optionally, in some embodiments, please refer to FIG3c, a construction module 308 is also included. The construction module 308 may be specifically used to: construct a video data buffer and load the video data corresponding to the currently playing video into the video data buffer.

As can be seen, in the video clarity switching device of this embodiment, the first acquisition module 301 acquires the currently playing video. After acquiring the currently playing video, when the second acquisition module 302 receives a video clarity switching request triggered by the user, it acquires the video to be switched that is consistent with the content of the currently playing video. Then, the loading module 303 loads the index data corresponding to the video to be switched. Next, the extraction module 304 extracts the current keyframe of the currently playing video to obtain the current keyframe. Then, the determination module 305 determines the keyframe in the video to be switched that corresponds to the current keyframe based on the current keyframe and the index data to obtain the switching keyframe. Finally, the switching module 306 switches the currently playing video to play the video to be switched based on the current keyframe, the switching keyframe, and the index data. Compared to existing video resolution switching schemes, the determining module 305 of this invention can determine the keyframe corresponding to the current keyframe in the video to be switched based on the current keyframe and index data, and obtain the switching keyframe. Then, the switching module 306 switches the currently playing video to the video to be switched based on the current keyframe, the switching keyframe, and the index data. In other words, in this scheme, video resolution switching is based on keyframes. Therefore, it can solve the problem of frame skipping in existing schemes and reduce data consumption.

Furthermore, this invention also provides an electronic device, as shown in FIG4, which illustrates a structural schematic diagram of the electronic device involved in this invention. Specifically:

The electronic device may include components such as a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will understand that the electronic device structure shown in FIG4 does not constitute a limitation on the electronic device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:

The processor 401 is the control center of the electronic device. It connects various parts of the electronic device via various interfaces and lines. By running or executing software programs and/or modules stored in the memory 402, and by calling data stored in the memory 402, it performs various functions and processes data, thereby providing overall monitoring of the electronic device. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 401.

The memory 402 can be used to store software programs and modules. The processor 401 executes various functional applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.

The electronic device also includes a power supply 403 that supplies power to the various components. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 403 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

The electronic device may also include an input unit 404, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

Although not shown, the electronic device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 401 in the electronic device loads the executable files corresponding to the processes of one or more applications into the memory 402 according to the following instructions, and the processor 401 runs the applications stored in the memory 402 to realize various functions, as follows:

The system retrieves the currently playing video. When a user-triggered video resolution switching request is received, it retrieves the video to be switched, which is identical to the currently playing video. It loads the index data corresponding to the video to be switched, extracts the current keyframe of the currently playing video, and determines the corresponding keyframe in the video to be switched based on the current keyframe and the index data. Based on the current keyframe, the switching keyframe, and the index data, it switches the currently playing video to the video to be switched.

For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

This invention first acquires the currently playing video. When a user-triggered video resolution switching request is received, a video to be switched to, identical in content to the currently playing video, is acquired. Then, the index data corresponding to the video to be switched to is loaded. Next, the current keyframe of the currently playing video is extracted. Then, based on the current keyframe and the index data, the corresponding keyframe in the video to be switched is determined, resulting in the switching keyframe. Finally, based on the current keyframe, the switching keyframe, and the index data, the currently playing video is switched to play the video to be switched. Compared to existing video resolution switching schemes, this invention's method can determine the corresponding keyframe in the video to be switched based on the current keyframe and the index data, obtaining the switching keyframe. Then, based on the current keyframe, the switching keyframe, and the index data, the currently playing video is switched to play the video to be switched. In other words, this scheme switches video resolution based on keyframes, thus solving the frame skipping problem in existing schemes and reducing bandwidth consumption.

Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

To this end, embodiments of the present invention provide a storage medium storing a plurality of instructions that can be loaded by a processor to execute steps in any of the video resolution switching methods provided in the embodiments of the present invention. For example, the instructions can execute the following steps:

The system retrieves the currently playing video. When a user-triggered video resolution switching request is received, it retrieves the video to be switched, which is identical to the currently playing video. It loads the index data corresponding to the video to be switched, extracts the current keyframe of the currently playing video, and determines the corresponding keyframe in the video to be switched based on the current keyframe and the index data. Based on the current keyframe, the switching keyframe, and the index data, it switches the currently playing video to the video to be switched.

For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

The storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

Since the instructions stored in the storage medium can execute the steps in any of the video resolution switching methods provided in the embodiments of the present invention, the beneficial effects that any of the video resolution switching methods provided in the embodiments of the present invention can achieve can be realized, as detailed in the preceding embodiments, and will not be repeated here.

The foregoing has provided a detailed description of a video resolution switching method, apparatus, electronic device, and storage medium provided by embodiments of the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims (6)

1. A method for switching video resolution, characterized in that it includes: Get the currently playing video; When a user-triggered video resolution switching request is received, a video to be switched is obtained with the same number of images as the currently playing video. The resolution of the currently playing video is different from that of the video to be switched, and the number of keyframes corresponding to the currently playing video and the video to be switched is the same. Load the index data corresponding to the video to be switched, the index data including the decoding information, timestamps and positions of the audio frames and video frames in the video to be switched; Extract the current keyframe of the currently playing video to obtain the current keyframe; Obtain the video data containing the current keyframe from the currently playing video to obtain the first video data; Obtain the position of the current keyframe in the first video data to obtain the position information corresponding to the current keyframe; Based on the index data, the video data corresponding to the video to be switched is loaded to obtain the second video data; Selecting a keyframe that matches the location information from the second video data to obtain a switching keyframe includes: extracting the timestamp corresponding to the current keyframe to obtain a first timestamp; extracting the timestamps corresponding to each keyframe in the second video data to obtain multiple second timestamps; determining the keyframe among the multiple second timestamps that matches the first timestamp as the keyframe corresponding to the current keyframe to obtain a switching keyframe; wherein, the switching keyframe includes determining a keyframe in the video data corresponding to the video to be switched that matches the timestamp or image content of the current keyframe based on the video data where the current keyframe is located, the current keyframe, and the index data; Based on the current keyframe, the switching keyframe, and index data, the video data that needs to be loaded for the video to be switched is determined, and the video data buffer is updated according to the video data to be loaded. Based on the video data in the updated buffer, the currently playing video is switched to the video to be switched. This includes: determining the video data that has been played in the currently playing video according to the current keyframe; calculating the video data that needs to be loaded for the video to be switched using the current keyframe, the played video data, and index data; updating the preset video data buffer using the video data to be loaded to obtain the updated buffer; and switching the currently playing video to the video to be switched, starting from the switching keyframe and based on the video data to be loaded and the updated buffer. 2. The method according to claim 1, characterized in that, after switching the currently playing video to the video to be switched based on the video data to be loaded and the updated buffer, using the switching keyframe as the starting point, the method further includes: Delete the video data corresponding to the currently playing video in the updated buffer. 3. The method according to claim 1, characterized in that, before obtaining the currently playing video, it further includes: Construct a video data buffer; The video data corresponding to the currently playing video is loaded into the video data buffer. 4. A video resolution switching device, characterized in that it comprises: The first acquisition module is used to acquire the currently playing video and obtain the currently playing video. The second acquisition module is used to acquire a video to be switched with the same number of images as the currently playing video when a user-triggered request to switch video resolution is received. The resolution of the currently playing video is different from that of the video to be switched, and the number of keyframes corresponding to the currently playing video and the video to be switched is the same. The loading module is used to load the index data corresponding to the video to be switched. The index data includes the decoding information, timestamps and positions of the audio frames and video frames in the video to be switched. The extraction module is used to extract the current keyframe of the currently playing video and obtain the current keyframe. The determination module is used to determine the key frame in the video to be switched that corresponds to the current key frame based on the current key frame and index data, and obtain the switching key frame; wherein, the switching key frame includes a key frame in the video data corresponding to the video to be switched that is consistent with the timestamp or image content corresponding to the current key frame based on the video data where the current key frame is located, the current key frame and the index data. The switching module is used to determine the video data that needs to be loaded for the video to be switched based on the current keyframe, the switching keyframe, and index data, and to update the video data buffer as needed. Based on the video data in the updated buffer, the currently playing video is switched to the video to be switched. This includes: determining the video data already played in the currently playing video based on the current keyframe; calculating the video data that needs to be loaded for the video to be switched using the current keyframe, the already played video data, and index data; updating the preset video data buffer using the video data to be loaded to obtain an updated buffer; and switching the currently playing video to the video to be switched, starting from the switching keyframe and based on the video data to be loaded and the updated buffer. The determining module includes: The acquisition submodule is used to acquire the video data where the current keyframe is located from the currently playing video to obtain the first video data; The determination submodule is used to select key frames that meet preset conditions in the video to be switched based on the first video data, the current key frame and the index data, and obtain the switching key frame. The determining submodule includes: The acquisition unit is used to acquire the position of the current keyframe in the first video data and obtain the position information corresponding to the current keyframe. The selection unit is used to select key frames that meet preset conditions in the video to be switched according to the index data, and obtain the switching key frames. The selection unit includes: A loading subunit is used to load the video data corresponding to the video to be switched based on the index data to obtain the second video data; The selection subunit is used to select a key frame that matches the location information in the second video data to obtain a switching key frame. The subunit includes: extracting the timestamp corresponding to the current key frame to obtain a first timestamp; extracting the timestamps corresponding to each key frame in the second video data to obtain multiple second timestamps; and determining the key frame that matches the first timestamp among the multiple second timestamps as the key frame corresponding to the current key frame to obtain a switching key frame. 5. An electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of the video resolution switching method as described in any one of claims 1-3. 6. A storage medium, characterized in that it stores a computer program thereon, wherein the computer program, when executed by a processor, implements the steps of the video resolution switching method as described in any one of claims 1-3.