CN1471305A

CN1471305A - Synchrnoous driven technique for multimedia audio-video and declarative word

Info

Publication number: CN1471305A
Application number: CNA021253226A
Authority: CN
Inventors: 梁肇新
Original assignee: Individual
Current assignee: Individual
Priority date: 2002-07-25
Filing date: 2002-07-25
Publication date: 2004-01-28

Abstract

The invented technique is realized through the following steps. The player requests audio/video stream and dot file at same time. When the audio/video stream is played back, meanwhile the comparison is carried out between the playing position (time), which is continuously obtained by time massage in the playing process, and the time in chain table (time list) obtained by parsing the dot file. If the result of the comparison is accord with requirement, the player triggers a event, which through a capture even of IE browser carries out the treatment of browsing literal information. The simultaneous technique is not related to format of audio/video stream. That is means the symbols marked by audio/video stream can be written into the dot file. Thus, the invention has wide suitable area and does not affect the playing effect. The technique can be used in multimedia network teaching.

Description

The synchronized drive technology of multimedia audio-video and comment

1 technical field

The present invention realizes audio frequency, and a special kind of skill that video and literal show does not synchronously need special video file format or changes video file format, but realize by the file (getting file ready) of a writing time and other information.

2 technical backgrounds

In today of software engineering develop rapidly, multimedia technology also in constantly raising and perfect, has especially reached certain level in the Voice ﹠ Video field, but has still lacked some technology in some field of multimedia.

Such as the ducoment with illusion technology, can browse literal when seldom having technology can be implemented in audio plays/video flowing.Though player can be realized ducoment with illusion when playing the video file of advanced streaming format (hereinafter to be referred as ASF), but the technology that it adopts is to insert some signs in the middle of audio, yet not every audio can be inserted sign in the centre, and this technology scope of application is smaller like this.What need now is to change audio, and can both realize the technology of ducoment with illusion when being adapted at playing any format audio/video flowing, and the present invention has just realized such technology.

3 summary of the invention

The method that audio is got ready is to indicate in audio, but sign is not to write in the audio but write the method for a file (getting file ready).

The form that audio is got file ready is that the beginning of file is unified resource ground (hereinafter to be referred as URL), then is the tabulation of the file of time and corresponding storage literal.

The method for synchronous of audio and literal is that file is got in player request in the request audio ready.Particularly, the broadcast process has a request audio thread and a request to get the file thread ready, get ready in the file thread to resolve in request and get file ready and write chained list (time list), by clock message retrieval time list, watch whether free node is within last second of current play position (time), if just trigger an incident.Catch simultaneously this incident in the IE browser, then the URL address that spreads out of by this incident of IE browser link is carried out literal and is browsed.Based on the audio of these all forms of technology can both realize with literal synchronously.

4 description of drawings

Fig. 1 is a form of getting file ready.

Fig. 2 has provided the process of the synchronous realization of audio and literal.

Fig. 3 gets file ready for resolving.

Fig. 4 is IE browser capturing events and the process of browsing literal.

5 embodiments

The present invention browses literal when being implemented in audio plays/video flowing by a series of processing method, and need not change audio.The basic thought of its realization is:

Produce the sign that a file (getting file ready) storage should be done in audio;

In player, ask audio and get file ready simultaneously, and do certain processing, be played in audio and produce an incident as extraneous interface when needing display text;

Catching this incident by the IE browser handles accordingly and browses literal.

When want to realize that audio and literal are synchronous, at first should in audio, indicate that player just can be known this display text in the process of player plays audio like this.The ASF video file format is exactly that so sign has been made in the place at this display text in its stream, and the whole video file is exactly one section video flowing one segment mark.When this format video file of player plays, just can realize that audio and literal are synchronous like this.But the audio/video stream file of not all form can both make this form into, can reduce result of broadcast even can change also.We write another place to these signs based on this, write in the file, and this file is called as gets file ready, so just need not change audio, no matter therefore the video file of which kind of form can be realized the synchronous of audio and literal.

Getting file ready is not the very complicated file of what form, and it is a text only.Form such as Fig. 1 comprise URL address, time tag and WEB filename or text (storage literal) name.

Real realization audio and literal are player synchronously.In program, the player process is divided two request threads, a thread request audio, and file such as Fig. 2 are got in another request ready.

Request is got the file thread ready and is mainly handled to resolve and get file (will check whether get file ready certainly in the player process, if just need not start this thread) ready.Check at first whether get fileinfo ready wrong, if wrong end thread is not resolved, if errorless analysis result is deposited in chained list (claiming time list here), wherein two word strings are as follows in chained list:

The word string 1=time

Word string 2=HTTP: //WEB server ip address/WEB virtual directory/filename word string 1 is that player is handled the time (being to be least unit with the second) required when synchronous, word string 2 is URL addresses that player spreads out of by incident when showing synchronously, and connects this URL address by the IE browser and browse literal.

In request audio thread, just read in stream and do not do any processing.Begin to play as Fig. 2 after reading in stream, in this broadcast process, handle whole synchronizing process.

In the broadcast process, be provided with clock (, be a second so clock interval is set, otherwise can produce synchronism deviation or repeatedly activate incident), in its call back function, carry out Synchronous Processing because the time in the time list is least unit with the second.Judged whether that at first audio plays, do not returned, because program stream is play and stopped to remake any processing and all do not have what meaning if do not make any processing function; So just judge further that not free tabulation is arranged if program stream is being play, if having, then whether the judgement time tabulation is empty; If be empty, then obtain current play position (time) from player, allow in front one second with the internal trigger incident at every turn, do not comprise just equaling current location last second.Whether the present node of review time tabulation in this scope, if, trigger event then; If this node is greater than current play position, so just tabulation retrieval time forward is up to retrieving satisfactory node and with this node trigger event of present node pointed, if just the trigger event node pointer is not motionless; If this node subtracts one second less than current play position, so search for first backward and subtract one second big node than current location and, if search is less than back node trigger event not always just with this node trigger event of present node pointed.In the broadcast forward that this process sound intermediate frequency/video flowing does not stop, just whether trigger event is received also not processing events regardless of incident.This incident is exactly an external interface, outwards spreads out of a parameter, and this parameter is the URL address string in the chained list.

Write as an assembly in this player process, in the IE browser, called the incident of this assembly and capture component triggering at any time.When player the time just in audio plays/video flowing, the IE browser is being waited for the generation of incident always, the IE browser will capture this incident when player produces incident, because the parameter that incident spreads out of is the URL address, the IE browser will be connected to this URL address, just can browse Word message in browser.

Whole process is exactly the synchronous realization of audio and literal, this know-why is similar to the video flowing of playing the ASF form, but difference is that it is the distillation of the simultaneous techniques of ASF format audio/video flowing and literal, and the audio that player need not depend on certain form just can realize the synchronous of audio and literal.

This technology can be used on multimedia net work teaching, by it, can be implemented in synchronous demonstration of Web-based instruction sound intermediate frequency, video and comment and broadcast, thereby can make the Web-based instruction lively more and effective.

Claims

1. audio and literal is to make the audio of various forms and literal show synchronously by certain method synchronously.The step of this method is:

Getting file logging ready by a special file needs at middle some signs that should do of audio, and these signs are when should trigger an incident for player in the process of audio plays/video flowing.

In the player process, realize synchronous process.Player requests divides two threads to carry out, and one is to get file request ready, and a resolution file and a parsing content deposit chained list in request process.Another is the audio request, be provided with clock in the broadcast process, when audio plays/video flowing while, the retrieval chained list is sought at the timing node of current play position (time) in last second in the call back function of clock, if any just trigger event of player, as external interface.

The IE browser is caught the incident that player triggers, and the URL address string that connection event spreads out of is browsed literal.

2. according to the process of claim 1 wherein that the method that audio is got ready is that the sign that do has been write in the file (getting file ready) in audio.Need not change the form of original audio, the form to audio does not have special requirement.

3. according to the method for claim 2, wherein getting file ready is exactly the text of the form of oneself, and file head is a URL address string, then is the tabulation of time and filename.The word string reorganization deposits chained list in behind the document analysis.