CN111813994B - Data processing and file playback method and device based on interactive whiteboard - Google Patents
Data processing and file playback method and device based on interactive whiteboard Download PDFInfo
- Publication number
- CN111813994B CN111813994B CN201910288425.XA CN201910288425A CN111813994B CN 111813994 B CN111813994 B CN 111813994B CN 201910288425 A CN201910288425 A CN 201910288425A CN 111813994 B CN111813994 B CN 111813994B
- Authority
- CN
- China
- Prior art keywords
- data
- playback
- original
- file
- describing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
Landscapes
- Engineering & Computer Science (AREA)
- Library & Information Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The application discloses a data processing method and a device based on an interactive whiteboard, a file playback method and a device based on the interactive whiteboard, a computer storage medium and electronic equipment, wherein the data processing method comprises the following steps: based on an original recording file of an interactive whiteboard, obtaining fragment data describing and playing back the original recording file, wherein the fragment data comprises playback key frames for describing and playing back snapshot information of the original recording file data and playback reference frames corresponding to the playback key frames and used for describing and playing back operation event information of the original recording file data; obtaining a target file for playback of the original recorded file according to the fragment data; and furthermore, the target file can be rendered based on the rendering mode of the event stream, and the playing speed of the target file is not limited by bandwidth when the target file is played back, and the playing definition is ensured.
Description
Technical Field
The application relates to the technical field of computers, in particular to a data processing method and device based on an interactive whiteboard. The application also relates to a file playback method and device based on the interactive whiteboard, a computer storage medium and electronic equipment.
Background
The interactive whiteboard is an electronic software product which can be applied to education, collaboration, conferences and other scenes. The content presented by the interactive whiteboard may be page information formed by rendering a plurality of page elements, for example: video information for teaching, video information for meetings, and the like.
At present, the mainstream data processing implementation modes of the interactive whiteboard are as follows: video streaming based and event stream based rendering.
The video stream transmission mode is that an operator of the interactive whiteboard generally transmits own desktop data content information to the server side in a video stream mode, and a viewer of the whiteboard acquires the video stream from the server side to view. However, the playing mode based on the video stream has rich transmission content, easy expansion and strong adaptability, but requires higher video transmission bandwidth at the same time.
When the recorded file of the interactive whiteboard is played back, higher video transmission bandwidth is required at the same time, so that when the terminal equipment plays back the recorded file of the interactive whiteboard, the playback transmission capacity is reduced due to the influence of the transmission bandwidth, and the video display is not smooth.
Disclosure of Invention
The application provides a data processing method based on an interactive whiteboard, which aims to solve the technical problem that a higher bandwidth is required when playing an interactive whiteboard recorded file in the prior art.
The application provides a data processing method based on an interactive whiteboard, which comprises the following steps:
Based on an original recording file of an interactive whiteboard, obtaining fragment data describing and playing back the original recording file, wherein the fragment data comprises playback key frames for describing and playing back snapshot information of the original recording file data and playback reference frames corresponding to the playback key frames and used for describing and playing back operation event information of the original recording file data;
And obtaining a target file for playback of the original recorded file according to the fragment data.
In some embodiments, further comprising:
and obtaining the original recorded file of the interactive whiteboard.
In some embodiments, the obtaining the original recording file of the interactive whiteboard includes:
And acquiring an original key frame used for describing and playing back the original recording file data snapshot information and an original reference frame used for describing and playing back the original recording file data operation event information in the original recording file.
In some embodiments, the method for obtaining clip data describing playback of the original recording file based on the interactive whiteboard, where the clip data includes a playback key frame for describing playback of snapshot information of the original recording file data and a playback reference frame corresponding to the playback key frame for describing playback of operation event information of the original recording file data, includes:
And encoding the original key frame and the original reference frame to generate fragment data, wherein the fragment data comprises a playback key frame for describing and playing back snapshot information of the original recorded file data and a playback reference frame which corresponds to the playback key frame and is used for describing and playing back operation event information of the original recorded file data.
In some embodiments, the obtaining the original key frame for describing playback of the original recording file data snapshot information and the original reference frame for describing playback of the original recording file data operation event information in the original recording file includes:
reading the original recorded file line by line to obtain text data;
Carrying out serialization operation on the text data to obtain serialized text data;
and determining that the read-in content is the original key frame or the original reference frame according to the serialized text data.
In some embodiments, the encoding the original recording file to generate clip data describing playback of the original recording file, where the clip data includes a playback key frame for describing playback of snapshot information of the original recording file data and a playback reference frame corresponding to the playback key frame for describing playback of operation event information of the original recording file data, and the method includes:
converting the read original key frame into a playback key frame;
Distributing a corresponding read-in original reference frame for the playback key frame to obtain a playback reference frame corresponding to the playback key frame;
and generating the fragment data according to the playback key frame and the corresponding playback reference frame.
In some embodiments, the converting the read-in original key frame into a playback key frame includes:
And converting the original key frame into a playback key frame according to the data content in the original recording file, and obtaining the playback key frame describing the snapshot information of the data of the original recording file.
In some embodiments, the generating the clip data from the playback key frame and the corresponding playback reference frame includes:
and merging the playback key frame with a playback reference frame between the next playback key frame adjacent to the playback key frame to generate the fragment data.
In some embodiments, further comprising:
generating index data describing the position information of the fragment data according to the start time and the end time of the fragment data;
And generating target data describing the playback content of the original recorded file according to the fragment data and the index data.
In some embodiments, the generating target data describing playback content of the original recording file according to the segment data and the index data includes:
and merging the fragment data and the index data to generate target data describing playback content of the original recorded file.
In some embodiments, the obtaining, according to the clip data, a target file for playback of the original recorded file includes:
And obtaining the target file for playback of the original recorded file according to the generated target data describing the playback content of the original recorded file.
In some embodiments, further comprising:
and configuring the number of playback reference frames corresponding to the playback key frames.
The application also provides a data processing device based on the interactive whiteboard, which comprises:
the first obtaining unit is used for obtaining fragment data describing and playing back the original recorded file based on the original recorded file of the interactive whiteboard, wherein the fragment data comprises playback key frames used for describing and playing back snapshot information of the original recorded file data and playback reference frames corresponding to the playback key frames and used for describing and playing back operation event information of the original recorded file data;
and the second obtaining unit is used for obtaining the target file for playing back the original recorded file according to the fragment data.
The application also provides a file playback method based on the interactive whiteboard, which comprises the following steps:
Acquiring a playback request for an original recorded file;
obtaining fragment data in a target file for playback of the original recorded file according to the playback request; the fragment data comprises playback key frames for describing and playing back the original recorded file data snapshot information and playback reference frames which correspond to the playback key frames and are used for describing and playing back the original recorded file data operation event information;
Rendering the fragment data;
And playing the rendered fragment data.
In some embodiments, further comprising:
Acquiring a playing request of cross-fragment data;
and determining fragment data to be rendered according to the target position information of the cross-fragment data in the playing request and the current position information of the currently played fragment data.
In some embodiments, the determining the fragment data to be rendered according to the target position information of the cross-fragment data and the current position information of the currently played fragment data in the play request includes:
determining whether the number of playback reference frames between the target position of the cross-segment data and the current position of the currently played segment data meets the number requirement of rendering the cross-segment data, and if so, rendering the cross-segment data.
In some embodiments, the rendering the cross-fragment data includes:
And rendering the data content corresponding to the playback key frame in the cross-fragment data.
In some embodiments, further comprising:
Rendering data content of a playback reference frame between the current position and the target position.
In some embodiments, further comprising:
And if the number of the playback reference frames between the target position of the cross-segment data and the current position of the current playing segment data does not meet the number requirement for rendering the cross-segment data, rendering the data content of the playback reference frames between the current position and the target position.
The application also provides a file playback device based on the interactive whiteboard, which comprises:
the acquisition unit is used for acquiring a playback request aiming at the original recorded file;
The obtaining unit is used for obtaining fragment data in a target file for playing back the original recorded file according to the playback request; the fragment data comprises playback key frames for describing and playing back the original recorded file data snapshot information and playback reference frames which correspond to the playback key frames and are used for describing and playing back the original recorded file data operation event information;
A rendering unit, configured to render the fragment data;
And the playing unit is used for playing the rendered fragment data.
The present application also provides a computer storage medium for storing a program;
the program, when read and executed, is capable of performing steps in the interactive whiteboard-based data processing method as described above, or in the interactive whiteboard-based file playback method as described above.
The present application also provides an electronic device including:
A processor;
a memory for storing a program which, when read by the processor, causes the electronic device to perform steps in the interactive whiteboard-based data processing method as described above, or the interactive whiteboard-based file playback method as described above.
Compared with the prior art, the application has the following advantages:
The application provides a data processing method based on an interactive whiteboard, which is characterized in that fragment data describing and playing back original recorded files are obtained based on the original recorded files of the interactive whiteboard, wherein the fragment data comprises playback key frames used for describing and playing back snapshot information of the original recorded files and playback reference frames corresponding to the playback key frames and used for describing and playing back operation event information of the original recorded files; obtaining a target file for playback of the original recorded file according to the fragment data; and the target file can be rendered based on the rendering mode of the event stream, and the playing speed of the target file is not limited by bandwidth when the target file is played back, and the playing definition is ensured.
The data processing method based on the interactive whiteboard provided by the application can also be used for rapidly positioning the playing position of the cross-fragment data through the index data.
The application also provides a file playback method based on the interactive whiteboard, which is used for obtaining fragment data in a target file for playback of the original recorded file through the obtained playback request for the original recorded file; the fragment data comprises a playback key frame for describing and playing back the original recording file data snapshot information and a playback reference frame which corresponds to the playback key frame and is used for describing and playing back the original recording file data operation event information, the fragment data is rendered, and then the rendered fragment data is played; therefore, the played fragment data can be rendered based on the event stream, the requirement on the playing bandwidth is reduced, and the fluent video playing requirement under most conditions is met. And the coding process before playing can be performed simultaneously, and the playing time can be shortened after processing one clip file.
In addition, in a playback state, the cross-segment data can be rapidly positioned and played through the index data, and whether the number of playback reference frames between the target position of the cross-segment data and the current position of the currently played segment data meets the number requirement of rendering the cross-segment data or not is determined, so that the content of the segment data to be rendered is determined, and the memory consumption of rendering is reduced.
Drawings
FIG. 1 is a flowchart of an embodiment of a data processing method based on an interactive whiteboard;
FIG. 2 is a schematic diagram of a segment data structure in an embodiment of a data processing method based on an interactive whiteboard;
FIG. 3 is a schematic diagram illustrating an encoding process in another embodiment of a data processing method based on an interactive whiteboard according to the present application;
FIG. 4 is a schematic diagram of an embodiment of an interactive whiteboard-based data processing apparatus according to the present application;
FIG. 5 is a flowchart of an embodiment of a method for playing back a file based on an interactive whiteboard;
Fig. 6 is a schematic structural diagram of an embodiment of a file playback device based on an interactive whiteboard.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. The present application may be embodied in many other forms than those herein described, and those skilled in the art will readily appreciate that the present application may be similarly embodied without departing from the spirit or essential characteristics thereof, and therefore the present application is not limited to the specific embodiments disclosed below.
The terminology used in the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The manner of description used in the present application and in the appended claims is for example: "a", "a" and "a" etc. are not limited in number or order, but are used to distinguish the same type of information from each other.
The data processing method based on the interactive whiteboard provided by the application is used for processing the recorded file of the interactive whiteboard, and playing back the recorded file after rendering the recorded file based on the rendering mode of the event stream, so that the playing speed of the played back file is not limited by bandwidth. An event may refer to a user's operation, such as: the presentation mode of the interactive whiteboard for the event is to display the data information conversion page element of the operation. The following describes in detail a data processing method based on an interactive whiteboard.
Referring to fig. 1, fig. 1 is a flowchart of an embodiment of a data processing method based on an interactive whiteboard, where the data processing method includes:
Based on an original recording file of an interactive whiteboard, obtaining fragment data describing and playing back the original recording file, wherein the fragment data comprises playback key frames for describing and playing back snapshot information of the original recording file data and playback reference frames corresponding to the playback key frames and used for describing and playing back operation event information of the original recording file data;
And obtaining a target file for playback of the original recorded file according to the fragment data.
Before the above steps are described in detail, it can be understood that the obtaining of the target file may be based on active obtaining, and the target file may be obtained after the original recording file based on the interactive whiteboard is obtained, or the active obtaining may not be required, and the original recording file is formed in the interactive whiteboard, so that the target file may be obtained based on the above steps. Therefore, the embodiment of the data processing method based on the interactive whiteboard provided by the application further comprises the following steps:
step S101: and obtaining the original recorded file of the interactive whiteboard.
The interactive whiteboard of step S101 may include: the method comprises the following steps of drawing a pen, erasing an eraser, setting a background picture, standard graphics, selecting frames and the like, and supporting a medium for document display and multi-terminal interaction.
The original recording file may be understood as a video data file based on the completion of the interactive whiteboard. The original recording file may include: an original key frame describing the original recording file data Snapshot (snappshot) information, and a plurality of original reference frames describing the original recording file data operation event (Events) information, or stated otherwise, the data content of the original recording file may include: the data content described in the original key frame and the data content described in the original reference frame. The original key may be represented by an original I-frame (snappshot) and the original reference frame may be represented by an original P-frame (Events).
Typically, the original key frame is data Snapshot (Snapshot) information describing the starting time of the original recorded file, where a Snapshot refers to an available copy of data at a certain point in time, that is, data presented by the Snapshot may still be subjected to a corresponding operation, for example: comment, edit, etc. In this embodiment, the snapshot includes: the structured data of all elements in the interactive whiteboard is summarized, for example, a rectangle is arranged in the snapshot, and the structured data can comprise description of the initial position, width and height, frame width, color and other attribute information of the square.
In this embodiment, the original key frame may be snapshot information describing the data content to be played for the original recording file at the beginning time. The original reference frame may be a series of operation information for the original recording file.
Thus, the specific implementation procedure of step S101 may include:
step S101-1: and acquiring an original key frame used for describing the data snapshot information of the original recording file and an original reference frame used for describing the data operation event information of the original recording file in the original recording file.
Because the original key frame and the original reference frame are both derived from the original recorded file, the acquisition of the original key frame and the original reference frame can be realized by adopting the following steps:
Step S101-11: reading the original recorded file line by line to obtain text data;
Step S101-12: carrying out serialization operation on the text data to obtain serialized text data;
step S101-13: and determining that the read-in content is the original key frame or the original reference frame according to the serialized text data.
The steps S101-11 to S101-13 may be performed by a Reader thread (read thread), and it is finally determined whether the read content is an original key frame or an original reference frame.
After the original key frame and the original reference frame in the original recorded file are obtained, the original key frame and the original reference frame need to be subjected to encoding pretreatment, so that a target file meeting the playback requirement can be obtained, and particularly, how to perform encoding pretreatment is described below.
Step S102: and encoding the original recording file based on the interactive whiteboard to obtain fragment data describing and playing back the original recording file, wherein the fragment data comprises playback key frames used for describing and playing back snapshot information of the original recording file data and playback reference frames corresponding to the playback key frames and used for describing and playing back operation event information of the original recording file data.
The purpose of step S102 is to convert the original recording file into fragment data after the encoding process, and the fragment data can be played back based on the event rendering requirement at the time of later playback.
Because the fragment data needs to expire after enough based on the requirement of the event rendering mode, the fragment data includes: and the playback reference frame is used for describing and playing back the operation event information of the original recorded file data, and corresponds to the playback key frame. In this embodiment, the playback key frame may be represented by a playback I frame, and the playback reference frame may be represented by a playback P frame, that is: and playing back the I frame description and the original recording file data snapshot information, and playing back the P frame description and the original recording file data operation event information.
It should be noted that, since the played back data is played back with respect to the original recorded file data, the content of the clip data is generated based on the content of the original recorded file, the playback key frame is also generated based on the original key frame, and the playback reference frame is also generated based on the original reference frame, which is different from the original recorded file in data format.
Therefore, in step S102, the generation of the segment data may specifically be that the original key frame and the original reference frame are encoded to generate the segment data, and referring to fig. 2, fig. 2 is a schematic diagram of a segment data structure in an embodiment of the data processing method based on the interactive whiteboard provided by the present application, where the segment data may include a playback key frame for describing the snapshot information of the original record file data and a playback reference frame corresponding to the playback key frame for describing the operation event information of playing back the original record file data.
The specific implementation process of the step S102 may be completed by a Handler (executing) thread, and the executing process may include the following steps:
Step S102-1: and converting the read original key frame into a playback key frame.
The purpose of step S102-1 is to convert only one original key frame in the original recording file into a playback key frame, where the converted playback key frame may include one or more than two, and when the converted playback key frame is plural, the converted formats are the same, but the described data content snapshot information is different.
In this embodiment, the specific implementation process of step S102-1 may be that the original key frame is converted into a playback key frame according to the data content in the original recording file, so as to obtain a playback key frame describing the data snapshot information of the original recording file. When the conversion is performed into a plurality of playback key frames, the playback of the original recorded file data snapshot information described by each playback key frame is different.
Step S102-2: distributing a corresponding read-in original reference frame for the playback key frame to obtain a playback reference frame corresponding to the playback key frame;
The purpose of step S102-2 is that each playback key frame should be followed by a corresponding operation event, and when the playback key frame includes two or more playback reference frames describing the operation event are provided between two adjacent playback key frames. In general, the playback reference frame between two playback key frames should be that an operation event occurs based on the data content of the previous playback key frame, in other words, the information described in the playback key frame that plays back the operation event occurring between the original recorded file data snapshot information and the next playback key frame is included in the playback key frame. But when there is no operational event, the playback reference frame is 0, i.e.: the final result in generating the fragment data may include: generating a playback key frame and a playback reference frame, wherein the playback reference frame can be operation event information describing playback of the original recorded file data, and the operation event information can be specific operation event existing or no operation event existing for playback of the original recorded file data, and the playback reference frame is 0, that is, if the operation event description is acquired, the playback reference frame is provided; otherwise, no, the generated clip data includes playback I frames and 0 playback P frames.
It should be noted that, without affecting playback, the position of the playback reference frame describing the operation event is not particularly limited, and the positional relationship between the playback reference frame and the playback key frame is also not particularly limited. In the present embodiment, the playback key frames and the playback reference frames are arranged in the play order, but the present invention is not limited thereto.
It should be noted that the playback key frame describes a snapshot of data information of the subsequent playback reference frame, and thus, the playback key frame may be determined according to an operation event.
Step S102-3: and generating the fragment data according to the playback key frame and the corresponding playback reference frame.
The purpose of step S102-3 is that the clip data includes two pieces of information, that is, snapshot information described by a playback key frame and operation event information described by the playback reference frame, and the clip data is generated from these two pieces of information.
It is to be understood that the clip data is not limited to two, but may be plural, but each clip data includes a playback key frame and a playback reference frame, respectively, and in this embodiment, the playback key frame in the clip data may be one, and the playback reference frame may be at least 1. Of course, this does not exclude the case where the playback key frame in the clip data includes a plurality of playback reference frames in other examples.
In this embodiment, the number of playback reference frames can be configured.
The specific implementation manner of the step S102-3 may be: and merging the playback key frame with a playback reference frame between the next playback key frame adjacent to the playback key frame to generate the fragment data.
Based on the foregoing, it can be understood that the clip data is based on a part of the content of the original recording file at the time of playback, and a plurality of clip data constitute a target file at the time of playback based on the original recording file. Therefore, the target file when the original recorded file is played back needs to be obtained according to the generated fragment data, so that the playback target file is completed under the architecture based on the event stream, and specifically, the following description may be referred to the description of step S103, and before the description of step S103, it should be noted that, in the data processing method based on the interactive whiteboard provided by the present application, for better implementing the positioning of the playback key frame, or the positioning of the playback reference frame, or the positioning of the playback key frame and the playback reference frame in the playback process, the data processing method further includes:
step S10a: and generating index data describing the position information of the fragment data according to the start time and the end time of the fragment data.
The index data in the step S10a may include position information describing each piece of data. As shown in fig. 3, fig. 3 is a schematic diagram of encoding processing in another embodiment of an interactive whiteboard-based data processing method according to the present application, wherein index. Txt represents index data, and 1.Txt15428948598-1542894938865 represents start time and end time of clip data 1.
Step S10b: and generating target data describing the playback content of the original recorded file according to the fragment data and the index data.
The objective of step S10b is to include not only the clip data but also the index data in the target data during playback, so that the position of the target data can be located according to the index data information, and the specific implementation process may be: and merging the fragment data and the index data to generate target data describing the playback content of the original recorded file.
It should be noted that, similar to the execution of step S102, the generation of the index data may be performed by a Handler (execution thread), so that the process of reading the data information of the original record file and generating the index data according to the read data information may be parallel operation, and the two processes are complementary and interfere with each other, thereby improving the efficiency of data processing.
Based on the above, the step S103 will be described below.
Step S103: and obtaining a target file for playback of the original recorded file according to the fragment data.
In the case of generating the index data based on the clip data, the specific implementation procedure of step S103 may be to obtain, according to the index data and the clip data, a target file for playback of the original recording file.
The target file may be understood as a playback file after changing the format for the original recording file.
The foregoing is a specific description of an embodiment of a data processing method based on an interactive whiteboard, corresponding to the foregoing embodiment of the data processing method based on an interactive whiteboard, and the application also discloses an embodiment of a data processing device based on an interactive whiteboard, please refer to fig. 4, and since the embodiment of the device is basically similar to the embodiment of the method, the description is simpler, and the relevant points refer to part of the description of the embodiment of the method. The device embodiments described below are merely illustrative.
Referring to fig. 4, fig. 4 is a schematic structural diagram of an embodiment of a data processing device based on an interactive whiteboard according to the present application, where the data processing device includes:
An obtaining unit 401, configured to obtain an original recording file of the interactive whiteboard;
the acquisition unit 401 includes:
And the frame acquisition subunit is used for acquiring an original key frame used for describing the data snapshot information of the original recording file and an original reference frame used for describing the data operation event information of the original recording file in the original recording file.
The frame acquisition subunit includes:
A reading operation subunit, configured to perform a line-by-line reading operation on the original recording file, so as to obtain text data;
A sequence text obtaining subunit, configured to perform a serialization operation on the text data, so as to obtain serialized text data;
And the determining subunit is used for determining whether the read-in content is the original key frame or the original reference frame according to the serialized text data.
A first obtaining unit 402, configured to obtain, based on an original recording file of an interactive whiteboard, clip data describing playback of the original recording file, where the clip data includes a playback key frame for describing playback of snapshot information of the original recording file data and a playback reference frame corresponding to the playback key frame for describing playback of operation event information of the original recording file data;
The first obtaining unit 402 is specifically configured to encode the original key frame and the original reference frame to generate clip data, where the clip data includes a playback key frame for describing snapshot information of playing back the original recorded file data and a playback reference frame corresponding to the playback key frame for describing operation event information of playing back the original recorded file data.
The first obtaining unit 402 includes:
the conversion sub-unit is used for converting the read original key frame into a playback key frame;
An allocation subunit, configured to allocate a corresponding read-in original reference frame to the playback key frame, so as to obtain a playback reference frame corresponding to the playback key frame;
and the generation subunit is used for generating the fragment data according to the playback key frame and the corresponding playback reference frame.
The conversion subunit is specifically configured to convert the original key frame into a playback key frame according to the data content in the original recording file, so as to obtain a playback key frame describing the snapshot information of the original recording file.
The generation subunit includes: and the merging subunit is used for merging the playback reference frame between the playback key frame and the next playback key frame adjacent to the playback key frame to generate the fragment data.
In some implementations, it may further include:
An index generation unit 40a for generating index data describing the position information of the clip data according to the start time and the end time of the clip data;
and a target data generating unit 40b for generating target data describing playback contents of the original recording file based on the clip data and the index data.
The target data generating unit is specifically configured to combine the segment data and the index data to generate target data describing playback content of the original recording file.
A second obtaining unit 403, configured to obtain, according to the clip data, a target file for playback of the original recorded file.
The second obtaining unit 403 is specifically configured to obtain the target file for playback of the original recording file, where the target data describing the playback content of the original recording file is generated in the target data generating subunit.
The above description of the embodiment of the data processing device based on the interactive whiteboard provided by the application is a brief summary of the process, and specific content is referred to the description of the embodiment of the data processing method based on the interactive whiteboard.
Based on the above detailed description of the embodiment of the data processing method based on the interactive whiteboard and the embodiment of the data processing device based on the interactive whiteboard provided by the application, the application also provides a file playback method based on the interactive whiteboard, please refer to fig. 5, and the embodiment of the file playback method is basically similar to the embodiment of the data processing method based on the interactive whiteboard, so that the description is simpler, and the relevant points refer to part of the description of the embodiment of the data processing method based on the interactive whiteboard.
First, it should be noted that, since the video playing (including playback) is generally performed based on the video stream, a higher bandwidth is further required, so that the video playing has a certain limitation. According to the file playback method based on the interactive whiteboard, the data content is rendered based on the event stream, so that the playing bandwidth requirement is reduced, and the fluent video playing requirement under most conditions is met.
Referring to fig. 5, fig. 5 is a flowchart of an embodiment of a file playback method based on an interactive whiteboard, where the playback method includes:
Step S501: acquiring a playback request for an original recorded file;
The playback request in step S501 is a replay request based on the original recorded file recorded by the interactive whiteboard, for example: in the education scene mode, for the playback request of the recorded file of a certain lesson, the playback request can be generated through the operation of a client on the recorded file, or can be automatically generated according to the set playback time, and the client can be understood as an electronic device carrying an interactive whiteboard.
Step S502: obtaining fragment data in a target file for playback of the original recorded file according to the playback request; the fragment data comprises playback key frames for describing and playing back the original recorded file data snapshot information and playback reference frames which correspond to the playback key frames and are used for describing and playing back the original recorded file data operation event information;
The purpose of the step S502 is to: based on the playback request, it is necessary to obtain clip data in the target file that satisfies the playback requirement based on the original recorded file.
The fragment data may include: and the playback reference frame is used for describing and playing back the operation event information of the original recorded file data, and corresponds to the playback key frame. The content of the specific fragment data may refer to the descriptions of step S101 to step S103 in the above embodiment of the interactive whiteboard-based data processing method, which are not described herein.
Step S503: rendering the fragment data;
The purpose of step S503 is to render each data content in the clip data to form data information that can be displayed for play.
In this embodiment, the playing step of step S504 may be performed after the partial content is rendered without performing the rendering under the condition that all the fragment data is obtained, and of course, the playing step of step S504 may be performed after the full fragment data is rendered.
Step S504: and playing the rendered fragment data.
In playing back a target file, there is a possibility of playing back cross-clip data, which can be generally understood as a drag (Seek) progress bar or a play time axis, so as to move a current play position to a target play position for playing. And under the normal condition of cross-fragment data playing, firstly, rendering an interactive whiteboard page according to a playback key frame (Snapshot) in target fragment data, namely an I frame, and then sequentially processing playback reference frames after the playback key frame until a drag (Seek) position point is reached. This approach is wasteful of resources in many scenarios because the playback key frames need to be re-rendered each time.
For easy understanding, please refer to fig. 2, the playing process of the above-mentioned cross-clip data in the playback state is as follows:
At present, when playing to the position t0, the user needs to manually drag the playing time axis to t1, because the drag causes cross-segment data, and the playback key frame (Snapshot 2) needs to be rendered first and then the playback reference frame (event 12) needs to be processed, however, the rendering consumption degree is far greater than that of directly rendering the playback reference frame (event 12) at the current position t0, and finally the playing content to be realized is consistent, therefore, the file playback method based on the interactive whiteboard provided by the application further comprises a playing embodiment based on the cross-segment data, and specifically comprises the following steps:
Step S50a: acquiring a playing request of cross-fragment data;
In the step S50a, the play request of the cross-clip data may be formed by the user dragging the play time axis, or may be formed by the input play time information, or may be formed by the set play time information, for example: several play position points can be set for playback, and cross-clip data play is automatically formed by the time set for the play position points. The acquisition form of the play request of the specific cross-clip data is not limited to the above.
Step S50b: and determining fragment data to be rendered according to the target position information of the cross-fragment data in the playing request and the current position information of the currently played fragment data.
The specific implementation process of step S50b may include:
Step S50b-1: determining whether the number of playback reference frames between the target position of the cross-segment data and the current position of the currently played segment data meets the number requirement of rendering the cross-segment data, and if so, rendering the cross-segment data.
The target position in step S50b-1 may be a play point reached by dragging the play time axis, and the current position is a current position point of the current play on the play time axis. The number requirement for rendering the cross-fragment data may be an empirical value, such as: the number is 10. The empirical value may be obtained by a number of practical test summaries, namely by testing the time taken to render 10 playback reference frames (events) and the time taken to render one playback key frame (snappshot). Of course, the number value is adjustable, and the requirement of adjusting the number value can be made according to the time spent by the actual rendering time.
The specific implementation procedure of the step S50b-1 may be that, if the number of playback reference frames between the target position and the current position is greater than the number requirement for rendering the cross-fragment data, the cross-fragment data is rendered, that is: and rendering the data content corresponding to the playback key frame in the cross-fragment data. And after the data content corresponding to the playback key frame is rendered, the data content of the playback reference frame between the current position and the target position is rendered.
The above is a description of meeting the rendering amount requirement, when the playback reference frame amount between the target position of the cross-clip data and the current position of the current play-clip data does not meet the rendering amount requirement of the cross-clip data, namely: and when the number of the playback reference frames between the target position and the current position is less than 10 or equal to 10, rendering the data content of the playback reference frames between the current position and the target position.
The above description of the embodiment of the file playback method based on the interactive whiteboard provided by the present application corresponds to the embodiment of the file playback method based on the interactive whiteboard provided by the present application, and the present application also discloses an embodiment of a file playback device based on the interactive whiteboard, please refer to fig. 6, and since the embodiment of the device is basically similar to the embodiment of the method, the description is simpler, and the relevant points refer to the part of the description of the embodiment of the method. The device embodiments described below are merely illustrative.
Fig. 6 is a schematic structural diagram of an embodiment of a file playback device based on an interactive whiteboard according to the present application. The file playback apparatus includes:
An obtaining unit 601, configured to obtain a playback request for an original recording file;
An obtaining unit 602, configured to obtain, according to the playback request, clip data in a target file for playback of the original recording file; the fragment data comprises playback key frames for describing and playing back the original recorded file data snapshot information and playback reference frames which correspond to the playback key frames and are used for describing and playing back the original recorded file data operation event information;
a rendering unit 603 for rendering the fragment data;
And a playing unit 604 for playing the rendered clip data.
In order to realize playing of the cross-clip data, the file playback method further comprises the following steps:
A play request acquiring unit 60a for acquiring a play request of the cross-clip data;
a determining unit 60b, configured to determine fragment data to be rendered according to the target location information of the cross-fragment data in the play request and the current location information of the currently played fragment data.
The determination unit includes:
and the quantity requirement determining subunit is used for determining whether the quantity of playback reference frames between the target position of the cross-fragment data and the current position of the currently played fragment data meets the quantity requirement of rendering the cross-fragment data, and if so, entering the rendering unit to execute the rendering operation of the cross-fragment data.
And after the rendering unit finishes the rendering operation of the cross-fragment data, executing the rendering operation on the data content corresponding to the playback key frame in the cross-fragment data.
And when the number requirement determination subunit determines that the number requirement determination subunit is not satisfied, the rendering unit performs a rendering operation on the data content of the playback reference frame between the current position and the target position.
Based on the foregoing, the present application also provides a computer storage medium storing a program;
the program, when read and executed, is capable of performing steps in the interactive whiteboard-based data processing method as described above, or in the interactive whiteboard-based file playback method as described above.
Based on the above, the present application also provides an electronic device, including:
A processor;
a memory for storing a program which, when read by the processor, causes the electronic device to perform steps in the interactive whiteboard-based data processing method as described above, or the interactive whiteboard-based file playback method as described above.
While the application has been described in terms of preferred embodiments, it is not intended to be limiting, but rather, it will be apparent to those skilled in the art that various changes and modifications can be made herein without departing from the spirit and scope of the application as defined by the appended claims.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.
1. Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer readable media, as defined herein, does not include non-transitory computer readable media (transmission media), such as modulated data signals and carrier waves.
2. It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Claims (20)
1.A data processing method based on an interactive whiteboard, comprising:
Based on an original recording file of an interactive whiteboard, obtaining fragment data describing and playing back the original recording file, wherein the fragment data comprises playback key frames for describing and playing back snapshot information of the original recording file data and playback reference frames corresponding to the playback key frames and used for describing and playing back operation event information of the original recording file data;
generating index data describing the position information of the fragment data according to the start time and the end time of the fragment data;
generating target data describing the playback content of the original recorded file according to the fragment data and the index data;
And obtaining the target file for playback of the original recorded file according to the generated target data describing the playback content of the original recorded file.
2. The interactive whiteboard-based data processing method according to claim 1, further comprising:
and obtaining the original recorded file of the interactive whiteboard.
3. The interactive whiteboard-based data processing method according to claim 2, wherein the obtaining the original recording file of the interactive whiteboard comprises:
And acquiring an original key frame used for describing and playing back the original recording file data snapshot information and an original reference frame used for describing and playing back the original recording file data operation event information in the original recording file.
4. The interactive whiteboard-based data processing method according to claim 3, wherein the interactive whiteboard-based original recording file obtains clip data describing playback of the original recording file, the clip data including a playback key frame describing playback of the original recording file data snapshot information and a playback reference frame corresponding to the playback key frame describing playback of the original recording file data operation event information, comprising:
And encoding the original key frame and the original reference frame to generate fragment data, wherein the fragment data comprises a playback key frame for describing and playing back snapshot information of the original recorded file data and a playback reference frame which corresponds to the playback key frame and is used for describing and playing back operation event information of the original recorded file data.
5. The interactive whiteboard-based data processing method according to claim 4, wherein the obtaining the original key frame for describing playback of the original recording file data snapshot information and the original reference frame for describing playback of the original recording file data operation event information in the original recording file comprises:
reading the original recorded file line by line to obtain text data;
Carrying out serialization operation on the text data to obtain serialized text data;
and determining that the read-in content is the original key frame or the original reference frame according to the serialized text data.
6. The interactive whiteboard-based data processing method according to claim 5, wherein the encoding the original recording file generates clip data describing playback of the original recording file, the clip data including a playback key frame describing playback of the original recording file data snapshot information and a playback reference frame corresponding to the playback key frame describing playback of the original recording file data operation event information, comprising:
converting the read original key frame into a playback key frame;
Distributing a corresponding read-in original reference frame for the playback key frame to obtain a playback reference frame corresponding to the playback key frame;
and generating the fragment data according to the playback key frame and the corresponding playback reference frame.
7. The interactive whiteboard-based data processing method according to claim 6, wherein said converting the read-in original key frame into a playback key frame comprises:
And converting the original key frame into a playback key frame according to the data content in the original recording file, and obtaining the playback key frame describing the snapshot information of the data of the original recording file.
8. The interactive whiteboard-based data processing method according to claim 6, wherein said generating said clip data from said playback key frame and said corresponding playback reference frame comprises:
and merging the playback key frame with a playback reference frame between the next playback key frame adjacent to the playback key frame to generate the fragment data.
9. The interactive whiteboard-based data processing method according to claim 1, wherein the generating target data describing playback contents of the original recording file based on the clip data and the index data includes:
and merging the fragment data and the index data to generate target data describing playback content of the original recorded file.
10. The interactive whiteboard-based data processing method according to claim 1, further comprising:
and configuring the number of playback reference frames corresponding to the playback key frames.
11. An interactive whiteboard-based data processing apparatus, comprising:
the first obtaining unit is used for obtaining fragment data describing and playing back the original recorded file based on the original recorded file of the interactive whiteboard, wherein the fragment data comprises playback key frames used for describing and playing back snapshot information of the original recorded file data and playback reference frames corresponding to the playback key frames and used for describing and playing back operation event information of the original recorded file data;
An index generation unit for generating index data describing the position information of the fragment data according to the start time and the end time of the fragment data;
A target data generating unit, configured to generate target data describing playback content of the original recording file according to the clip data and the index data;
and the second obtaining unit is used for obtaining the target file for playing back the original recorded file according to the target data.
12. A method for playing back a file based on an interactive whiteboard, comprising:
Acquiring a playback request for an original recorded file;
Obtaining fragment data in a target file for playback of the original recorded file according to the playback request; the fragment data comprises playback key frames for describing and playing back the original recorded file data snapshot information and playback reference frames which correspond to the playback key frames and are used for describing and playing back the original recorded file data operation event information; generating index data describing the position information of the fragment data according to the start time and the end time of the fragment data; generating target data describing the playback content of the original recorded file according to the fragment data and the index data;
rendering the target data;
And playing the rendered fragment data.
13. The interactive whiteboard-based file playback method as recited in claim 12, further comprising:
Acquiring a playing request of cross-fragment data;
and determining fragment data to be rendered according to the target position information of the cross-fragment data in the playing request and the current position information of the currently played fragment data.
14. The interactive whiteboard-based file playback method according to claim 13, wherein the determining the clip data to be rendered according to the target location information of the cross-clip data and the current location information of the currently playing clip data in the play request comprises:
determining whether the number of playback reference frames between the target position of the cross-segment data and the current position of the currently played segment data meets the number requirement of rendering the cross-segment data, and if so, rendering the cross-segment data.
15. The interactive whiteboard-based file playback method of claim 14, wherein said rendering the cross-clip data comprises:
And rendering the data content corresponding to the playback key frame in the cross-fragment data.
16. The interactive whiteboard-based file playback method as recited in claim 15, further comprising:
Rendering data content of a playback reference frame between the current position and the target position.
17. The interactive whiteboard-based file playback method as recited in claim 14, further comprising:
And if the number of the playback reference frames between the target position of the cross-segment data and the current position of the current playing segment data does not meet the number requirement for rendering the cross-segment data, rendering the data content of the playback reference frames between the current position and the target position.
18. An interactive whiteboard-based file playback apparatus, comprising:
the acquisition unit is used for acquiring a playback request aiming at the original recorded file;
The obtaining unit is used for obtaining fragment data in a target file for playing back the original recorded file according to the playback request; the fragment data comprises playback key frames for describing and playing back the original recorded file data snapshot information and playback reference frames which correspond to the playback key frames and are used for describing and playing back the original recorded file data operation event information; generating index data describing the position information of the fragment data according to the start time and the end time of the fragment data; generating target data describing the playback content of the original recorded file according to the fragment data and the index data;
A rendering unit, configured to render the target data;
And the playing unit is used for playing the rendered fragment data.
19. A computer storage medium storing a program;
The program, when read and executed, is capable of performing the steps of the interactive whiteboard based data processing method according to any one of claims 1-10, or the steps of the interactive whiteboard based file playback method according to any one of claims 12-17.
20. An electronic device, comprising:
A processor;
A memory for storing a program which, when read by the processor, causes the electronic device to perform the steps of the interactive whiteboard-based data processing method according to any one of claims 1-10, or the steps of the interactive whiteboard-based file playback method according to any one of claims 12-17.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910288425.XA CN111813994B (en) | 2019-04-11 | 2019-04-11 | Data processing and file playback method and device based on interactive whiteboard |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910288425.XA CN111813994B (en) | 2019-04-11 | 2019-04-11 | Data processing and file playback method and device based on interactive whiteboard |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111813994A CN111813994A (en) | 2020-10-23 |
| CN111813994B true CN111813994B (en) | 2024-06-07 |
Family
ID=72844280
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910288425.XA Active CN111813994B (en) | 2019-04-11 | 2019-04-11 | Data processing and file playback method and device based on interactive whiteboard |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111813994B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105847722A (en) * | 2015-01-16 | 2016-08-10 | 杭州海康威视数字技术股份有限公司 | Video storage method and device, video reading method and device and video access system |
| CN106686466A (en) * | 2017-01-10 | 2017-05-17 | 武汉卓威视讯科技有限公司 | Video data positioning method |
| CN109155862A (en) * | 2016-08-19 | 2019-01-04 | 惠州Tcl移动通信有限公司 | A kind of video stream data transmission method, base station and user equipment |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8179976B2 (en) * | 2008-01-11 | 2012-05-15 | Apple Inc. | Control of video decoder for reverse playback operation |
| US9247317B2 (en) * | 2013-05-30 | 2016-01-26 | Sonic Ip, Inc. | Content streaming with client device trick play index |
-
2019
- 2019-04-11 CN CN201910288425.XA patent/CN111813994B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105847722A (en) * | 2015-01-16 | 2016-08-10 | 杭州海康威视数字技术股份有限公司 | Video storage method and device, video reading method and device and video access system |
| CN109155862A (en) * | 2016-08-19 | 2019-01-04 | 惠州Tcl移动通信有限公司 | A kind of video stream data transmission method, base station and user equipment |
| CN106686466A (en) * | 2017-01-10 | 2017-05-17 | 武汉卓威视讯科技有限公司 | Video data positioning method |
Non-Patent Citations (1)
| Title |
|---|
| 基于Delphi的屏幕录像实现;邹瑛;;信息安全与通信保密;20110710(07);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111813994A (en) | 2020-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7801409B2 (en) | Glitch-free realtime playback | |
| CN101213606B (en) | Synchronization system and method for interactive multimedia presentation management | |
| KR101530101B1 (en) | Interfaces for digital media processing | |
| CN102089823B (en) | Multimedia display system and method | |
| US11197034B2 (en) | Recorded content storage and delivery management | |
| CN101689137B (en) | Use the digital data management in shared storage pond | |
| US20070169158A1 (en) | Method and system for creating and applying dynamic media specification creator and applicator | |
| CN101193250A (en) | System, method and medium for generating frame information of moving images | |
| KR20080019246A (en) | Motivational Features of Interactive Multimedia Presentation Management | |
| JP2001111937A (en) | Data recording/reproducing device, recording/ reproducing method for video data, disc drive unit and control unit for the data recording/reproducing device | |
| CN111813994B (en) | Data processing and file playback method and device based on interactive whiteboard | |
| JP2008270908A (en) | Information processing apparatus, control method therefor, program, and storage medium | |
| CN113259705A (en) | Method and device for recording and synthesizing video | |
| CN114942738B (en) | Processing method and related device for blackboard writing display | |
| US8200067B2 (en) | Processing of scalable compressed video data formats for nonlinear video editing systems | |
| JP2015510727A (en) | Method and system for providing file data for media files | |
| US20170329831A1 (en) | System and method for analyzing content usage events | |
| US7289169B2 (en) | Storage of projected presentations | |
| CN111629255B (en) | Audio and video recording method and device, computer equipment and storage medium | |
| CN114071225B (en) | Frame animation playing method, device and system | |
| CN121462830A (en) | Fast video rendering methods, apparatus, equipment, storage media, and software products | |
| CN119961464A (en) | Video generation method, device, storage medium and electronic device for presentation | |
| WO2025256375A1 (en) | Video editing method and apparatus, and terminal device | |
| CN116248964A (en) | Audio and video processing method, device and related equipment | |
| CN120780662A (en) | Reading and/or writing of media files |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |