KR20000059516A - Method of transmitting and executing multimedia presentation mail and apparatus thereby - Google Patents

Abstract

The present invention is a presentation mail using a variety of multimedia data, such as video, sound, graphics beyond the existing text-based Internet mail. The biggest problem in developing this is that the elements that make up the presentation mail are generally multimedia data with huge capacity. The huge capacity of multimedia data has many problems in transmission and storage. To overcome this problem, the real data part and the control data are separated to deliver only the control program, and the actual data is on a distributed Internet or a remote server capable of high-speed access. It is stored in the server and transmitted from the server when actually performing. The present invention uses a VIP (Visual Interface Player) as a tool for producing a control program, and proposed a real-time rendering technique using a hyperlink. In addition, the current VIP program that generates an API (Application Programming Interface) for the Multimedia I / O Server (Mux) can be converted to a Synchronized Multimedia Integration Language (SMIL) to provide compatibility with multimedia presentation players that support SMIL scripts. do.

Description

METHOD OF TRANSMITTING AND EXECUTING MULTIMEDIA PRESENTATION MAIL AND APPARATUS THEREBY}

The present invention relates to a multimedia presentation mail, and more particularly, to create a presentation of multimedia data to send to others by mail, and to send a multimedia presentation mail that can correctly execute the transmitted presentation mail And a method and apparatus for performing the same.

Conventionally, data transmitted and downloaded through communication is mainly text-based mail, and when transmitting a presentation mail using multimedia data, that is, video, audio, and graphics, the capacity of the transmission equipment is large due to a large amount of data. It is necessary, takes a lot of transmission time, and there is an inconvenience that data is not executed during execution. In other words, the mail using the existing multimedia data has to download a large amount of multimedia data of the data, it takes time to download, and must secure a lot of storage space to store the data. Since the data must be downloaded separately, there is a troublesome problem of not having the concept of presentation of a presentation.

The presentation mail is an e-mail written to execute multimedia data such as video, sound, and graphics over a text-based e-mail which is currently widely used according to a set program. It will be more sensational mail. However, this requires a huge amount of multimedia data and encounters limitations in time taken for transmission and storage capacity at the receiving end. In order to overcome this problem, when sending a mail by separating the actual multimedia data from the control program, only the direction control program is sent, and the actual multimedia data is left on the sender side or stored in a remote server capable of high-speed access. Then, when the receiver plays the presentation mail, the multimedia data on the user side or the server is retrieved and reproduced through the Internet. In this way, the receiver does not need to store a large amount of multimedia data.

There are two major problems with doing this. The first is that mail should be used by the public, so it should be easy enough for non-professionals to use. The second problem is a very technical problem. When the receiver plays the production program, the receiver should be able to bring data in real time to satisfy the quality of service. However, when using the Internet, it is impossible to bring multimedia data to a remote location in real time. Therefore, the data required for the presentation must be imported in advance or scheduled for real time opening from the receiving computer.

However, there are several methods for describing what is to be produced using multimedia data including audio or video. The method of specifying temporal synchronization for multimedia presentation includes the interval-based specification that specifies the temporal priority of the presentation with the relationship between the media to be produced, and the media presentation time for the wide time zone. Specify event relationship between media using Time Axes-based Specification, Control Flow-based Specification that specifies the structure of the entire presentation, and PetriNet. Event-based specification, and the script method for documenting the synchronization scenario between media documents, SMIL (Syncronized Multimedia Integration Language). These methods, however, are sufficient to theoretically represent the temporal relationship between media, but not only one synchronization specification can specify all the actual presentations, but also a hyperpresentation that allows one to present another presentation during the presentation. It does not provide a way to specify the presentation. In addition, since it is provided in the form of API (Application Programming Interface) or script language, it is too difficult for ordinary people to describe multimedia presentation in order to send mail.

The present invention has been made to solve the above problems, an object of the present invention is to provide a method for creating a multimedia presentation mail using BIP.

Another object of the present invention is to provide a method for transmitting a written presentation mail.

It is still another object of the present invention to provide a method of executing a transmitted presentation mail.

It is still another object of the present invention to provide an apparatus for transmitting and executing a multimedia presentation mail.

1 is an overall perspective view schematically showing a driving environment of a presentation mail according to the present invention.

2 is a view schematically showing a combination station environment of a fish according to the present invention.

3 is a diagram schematically showing a relationship between BIP and MUX, a multimedia I / O server.

4 is a diagram showing a real-time rendering operation of the presentation mail on the receiving side.

5 is a diagram illustrating a hyper-presentation of a news progress scenario according to an embodiment of the present invention.

6 is a diagram illustrating a presentation composed of icons.

7 is a diagram illustrating a hyperpresentation window in which a presentation is registered.

8 is a diagram illustrating a hyperlink setting window.

9 is a diagram illustrating a hyperpresentation window.

10 is a diagram illustrating a received presentation mail.

Fig. 11 shows the internal structure of the presentation prs1.

Fig. 12 shows the internal structure of the presentation prs2.

Fig. 13 shows the internal structure of the presentation prs3.

14 is a diagram illustrating a prefetch list configuration.

15 is a diagram illustrating a prefetch list configuration.

16 is a diagram illustrating a dynamic list configuration.

17 is a diagram illustrating a static list configuration.

<Explanation of symbols for main parts of drawing>

11: Combi Station 21: A / V Board

22: PC 23: video camera

24: monitor 25: microphone

26: speaker 31: VIP

32: VIP program player 33: API

34: mux 51: the actual multimedia data

In order to achieve the above object, the present invention includes a first step of displaying a hyperpresentation window on the initial screen of the non-IP to create a scenario desired by the user; A second step of registering a presentation desired by a user by pressing a register presentation button of a toolbar in the hyperpresentation window displayed in the first step; In the second step, after registering a plurality of presentations in the hyperpresentation window, a queue and a hyperlink are set in each presentation so that all the presentations registered in the hyperpresentation window can be produced in the scenario desired by the user. Step 3; A method of creating and transmitting a multimedia presentation mail comprising a fourth step of transmitting a presentation mail, which is a configuration information registered in a hyperpresentation window, is performed after the third step.

In the second step, the presentation registered in the hyperpresentation window may include: an icon setting step of setting an icon representing a stored file while storing image data or text data as an arbitrary file; A stream creation step of creating a stream by selecting an icon corresponding to data desired by a user from the image data or text data; The stream data created by the synchronization setting step of setting and synchronizing an operation time to each icon constituting each stream created in the stream creation step is synchronized.

In the presentation mail transmitted in the fourth step, configuration information, which is a presentation in which a queue and a hyperlink are set, is transmitted to a hyperpresentation window, and actual data, which is multimedia data such as a video, sound, and graphics, is stored in a server. It is done.

In order to achieve the above object, the present invention allows a recipient to store or open a presentation mail and play the presentation mail. When the presentation mail is played, the actual data corresponding to the presentation mail stored in a remote server is statically prefetched. And a method of executing a presentation mail to be transmitted to my computer in real time by dynamic prefetching.

In order to achieve the above another object, the present invention provides a combination of a PC station, a camera, a monitor, a microphone, and a speaker is connected to a plurality of fish via a network, and each fish is connected to a non-IP. A mux program is provided, and each fish provides an apparatus for transmitting and executing a multimedia presentation mail each connected by a network connected through a mux server. Combi stations can be defined as PCs with minimal multimedia capabilities.

Hereinafter, the present invention will be described with reference to the accompanying drawings.

1 is an overall perspective view schematically showing a driving environment of a presentation mail according to the present invention, FIG. 2 is a diagram schematically showing a combination station environment of a fish according to the present invention, and FIG. 3 is a BIP and multimedia I / O. Fig. 4 is a diagram schematically showing the relationship between MUX, which is a server, and Fig. 4 is a diagram showing a real-time rendering operation of the presentation mail on the receiving side.

Referring to FIGS. 1 to 4, first, a plurality of Combi-Stations 11 are connected by a network, and the Combi Station 11 has a video camera 23 and a monitor ( 24, the microphone 25 and the speaker 26 is connected to form a combination station environment, the combination station 22 to the A / V board 21 and the PC 22 for transmitting and receiving audio and video signals It is composed. The combination station 11 is provided with a VIP 31, a VIP program player 32, a mux 34, and an API 33 to create and send a presentation mail. In the driving environment of the presentation mail, the VIP (Visual Interface Player), a visual icon program tool that enables the user to express the direction according to the desired scenario without programming, can easily and conveniently produce the scenario according to the scenario without the user programming the desired scenario. I can express it.

For example, if you want to send a news scenario by e-mail, you can use VIP, a program that creates a directing program, to express the directing relationship of audio or video data according to the scenario. Attach it to an Internet mail and send it to the recipient. Then, only the directing program written with a small VIP is transmitted to the mail, and the actual multimedia data with a large amount of data remains on the sender's side (server). On the other hand, the receiver checks the received mail at the time he wants and plays the playback command when he wants to see the presentation mail attached to the directing program. Then, the receiver gets the actual multimedia data from the computer (server) of the sender and displays the contents specified in the VIP. The data retrieved and retrieved is discarded.

Referring to one embodiment, Figure 5 is a diagram showing a hyper-presentation, <prs1> constituting a news scenario is a presentation consisting of the announcement of the news anchor and the background music, <prs2> for the election of the Parliamentary elections It is a press. <Prs3> and <prs5> contain speeches of two members A and B. The user can simultaneously view two speech scenes that appear on the screen and select one of them to obtain detailed information about the candidate.

In addition, 〈prs4〉 and 〈prs6〉 are files containing detailed introductions to candidates A and B, respectively, and 〈pre7〉 is a presentation composed of the weather caster's progress, background music, and screens, and 〈prs8〉 is each Regional Weather, prs9, is a presentation introducing the weather at sea. Presentations composed of the above prs1 to prs9 are hyperlinked by connecting with a hyperlink and a cue.

The program for conveniently creating a hyperpresentation constituting the above scenario is a VIP. Each presentation constituting the hyper-presentation is composed of several objects, and icons representing each object constituting the presentation are in VIP. As shown in Fig. 6, the icon in the VIP is connected according to the scenario, and only a few additional settings such as time setting are presented.

In other words, using icons makes it very easy to maintain consistency and can be implemented by people who do not know the programming language.

As shown in FIG. 6, the presentation is configured for a scenario, and then a hyperpresentation window is generated on the initial screen of the VIP for scenario setting. When the hyperpresentation window is generated, all necessary presentations are registered in the hyperpresentation window by pressing the Register Presentation button on the toolbar. The names and lines of the presentations registered in the hyperpresentation window can be seen in FIG. 7.

Presentations in the form of bars registered in the hyperpresentation window of FIG. 7 are in synchronization with each presentation consisting of the icons shown in FIG. 6.

The cue and hyperlink may be set in the hyperpresentation window.

First, in order to set up the queue, consider the flow of the entire scenario, and connect the announcer's prepre, pre2, pre7, and prs9 to the "before" queues in turn, and then prepre and pre5. Connects to the "after" queue. To connect a cue, you can connect the presentations you want using the connect button on the toolbar, or set the cue by pressing the cue button on the toolbar.

Next, to set a hyperlink, clicking the hyperlink button on the toolbar generates a hyperlink setting window as shown in FIG.

Referring to FIG. 8, when linking a <pre3> presentation to a <pre5> presentation to a <pre2> presentation, select <pre2> from a combo box (Current Presentation) displayed at the top of the hyperlink setting window. In order to specify the hyperlink and location, press the Play button to execute the current <pre2> and then press the New HyperLink button at the desired position to set the hyperlink position at the <prs2>. You can also enter the LTS value (eg 256) directly in the Location group box if you want to modify the location of the hyperlink. At this time, the hyperlink should be executed at the set time, so the LTS value is entered in at. Then, you can see that a triangular hyperlink pointer is created on the line of <pre2> currently selected. Then select <pre3> in the Play combo box of the Action group box to set the action of this hyperlink, and select Active in the Condition group box to set the condition.

Next, when connecting <pre5> to the same position as <pre3> according to the scenario, connecting <pre5> in such a manner as to connect <prs3>, the lower Multi-Link group box is activated. Therefore, <pre3> and <pre5> must be executed at the same time, so select Parallel in the Multi-Link group box and set the condition to Active.

To set a hyperlink to another presentation, switch to the corresponding presentation in the current presentation and set the hyperlink for each presentation according to the scenario. FIG. 9 illustrates a hyperpresentation in which a plurality of presentations are connected by setting of a hopper link and a queue described so far.

If you click the hyperlink button on the toolbar again, you can modify the set hyperlink. After completing all the settings, run Hyper Presentation to create a User Interaction window, which allows you to control the presentations.

The production program created during the production of the production program described above is stored as a file by the VIP program. The mail is then sent to the intended recipient as an attachment using mail through a communication such as the Internet. At this time, only the directing program created by the VIP is transmitted, but the actual large amount of data used for the directing is not transmitted. Therefore, since the mail transmitted through the communication is a small program produced by the VIP, it can be transmitted quickly and accurately without problems even in communication such as a low speed Internet.

In addition, if the recipient has a presentation mail attached to the mail transmitted through the communication, such as the Internet, it can be stored or reproduced by "OPEN". The transmitted directing program is reproduced using the VIP program player 32 shown in FIG. That is, when the "OPEN" attached presentation file is viewed, the VIP program as shown in FIG. 95 can be viewed, and when it is "PLAY", the VIP program player 32 brings the necessary multimedia data from the sender's computer through the communication network. Will play. The VIP program player 32 interprets the icon program of the presentation constituting the hyperpresentation made of the VIP, constructs the presentation according to the mechanism provided by the MUX 34, and calls the API 33.

In more detail, in order to separate the actual multimedia data constituting the presentation mail from the control program, the actual multimedia data existing in the remote computer (server) must be transmitted in real time.

However, initial delay, disconnection, delay in entering the link, delay in returning the link, etc. according to the state of the communication network occur. As a solution to this problem, if the speed of the communication network is greatly increased, the VIP program player 32 on the receiver side can bring data in real time for a desired time. However, such a high speed network environment is still a long way off, so such a solution is impossible in a low speed network such as the Internet. The other method is that you already have a VIP program to play and multimedia data is stored, so the initial delay may be caused by adjusting the memory buffer and player threads of the receiver's computer, but there may be a way to play in real time. . The present invention solves this problem and proposes a real-time rendering technique of a presentation mail including hyperpresentation.

In other words, prefetching and scaling techniques using buffers are the first rendering techniques for real-time playback of presentation mail on the Internet.

The basic principle of the prefetch technique is that data is transmitted in advance by preventing data from being interrupted by receiving the data to the execution computer in advance according to the state of the communication network before it is executed in real time. Has the disadvantage that occurs.

As such, there have been various studies on the real-time presentation of multimedia. However, the control is limited to simple multimedia streams, and it is necessary to execute hyperpresentations or presentations that require strict time control and flow control including hyperlinks. It did not include a way to Therefore, a new real-time rendering technique for presentation mail with hyperpresentation is needed.

4 is a diagram illustrating a real-time rendering operation of the presentation mail on the receiving side. Actual multimedia data 51 is executed on the display unit 42 by the real-time rendering technique 52 through a network. In 42, the directing program 42 written in VIP is displayed.

Therefore, the most basic method of controlling the hyperlink for the real time rendering technique 52 is the existing prefetch method. Prefetch is intended for the execution of natural continuous media regardless of the state of the network by bringing data to my computer before execution. At this time, a lot of research has been conducted to prefetch in a more efficient manner rather than random data prefetching, and this study also proposed a real-time rendering technique using hyperlinks appropriate for the characteristics of the presentation mail.

The basic question is when and how far in advance to bring data from one presentation to another that is hyperlinked with him. This is because, if there is no data to be played in advance, it takes a long time to move to the presentation linked to the hyperlink, which causes unnatural playback, and jitters and delays occur in low-speed networks such as the Internet, making it impossible to play smoothly. Also, the method of importing MIDI data is also a problem because the multimedia data is so large that the memory capacity of the receiver is not sufficient to bring the entire data in advance. Therefore, in consideration of the presentation speed and transmission speed, the present invention proposes a new buffer size, the amount of data to be prefetched, and a method of prefetching during playback in order to achieve playback that satisfies the user's requirements.

If the attribute of the hyperlink is "USER INTERACTION", "ACTIVE", "INACTIVE", etc., and is "ACTIVE", the presentation linked to the hyperlink is always performed, but in other cases, "EVENT" or This is done only with input from the user. Therefore, by mixing the static prefetch method and the dynamic prefetch method with the general prefetch method, the switching and control of the multimedia streams using the characteristics of the hyperlink is suitable for performing the complex presentation and the hyperpresentation.

The static prefetch method means that the point of time of prefetch occurs before the presentation mail is played, which causes an initial delay before the presentation mail is executed, but the delay in switching the flow along the hyperlink. By eliminating the interruption of the flow ensures a natural presentation that satisfies the user's QOS. Here, the presentation that is the basis of the hyperlink corresponds to this and includes streams that are executed at the start point therein. That is, streams that are not dynamic prefetchable.

The dynamic prefetch method means that the starting point of the prefetch is performed while the presentation mail is being executed. This is a presentation or presentation connected to a hyperlink by using a complicated flow transition between presentation and hyperpresentation. This includes streams that start later in time with other streams.

That is, streams starting from the middle of the presentation or streams linked by hyperlinks are included.

For example, when the receiver plays the presentation mail as shown in FIG. 10, there is a presentation mail as shown in FIG. 10, and each presentation constituting the presentation mail is shown in FIGS. 11, 12, and 13. Is shown.

10 means that the mail to be executed is composed of three presentations Prs1, Prs2, and Prs3, each of which start_time and end_time are shown on the time axis at the bottom. This hyperpresentation runs Prs2 along the hyperlink after Prs1 runs for 30 seconds, Prs2 runs for 20 seconds from 30 to 50 seconds, and 50 seconds from 50 to 100 seconds along the hyperlink. It can be seen that after performing back to Prs1 to Prs2. Here, FIG. 11 shows that the presentation Prs1 is composed of two streams, stream S1 is executed from 0 to 30, and then stream S2 is performed up to 70.

When the mail as shown in FIG. 10 is played, Prs2 and Prs3 connected to the high link are started after a long time after the mail is executed. In this case, it is intuitive to know that Prs1.S2 can be dynamically transmitted while the stream Prs1.S1 constituting the presentation Prs1 is executed, and Prs3.S2 can be dynamically transmitted while the Prs3.S1 is executed. In this way, a dynamic prefetch method is applied to streams that can start prefetching while the presentation is being executed. On the contrary, of the streams constituting Prs1 at the start of execution, S1 at the start is a stream that starts as soon as the mail is executed. In this case, since S1 cannot be dynamic prefetched, it can be seen that static prefetching should be performed before the presentation mail starts. Static prefetch is also applied to Prs2.S1, Prs2.S2, and Prs3.S1.

In addition, as shown in FIG. 10, the presentations are hyperlinked so that Prs1.S1 in Prs1, Prs2.S1 and Prs2.S2 in Prs2, and Prs3.S1 in Prs3 cannot be dynamically prefetched. If the parent presentation exists, then dynamic prefetching is enabled while executing the parent presentation. In other words, you want to dynamically prefetch Prs2.S1 and Prs2.S2 while the presentation Prs1 is running, and dynamically prefetch Prs3.S1 while Prs2 is running. As a result, it can be seen that only Prs1.S1 at the start of the presentation Prs1 at the start of the entire presentation mail cannot perform dynamic prefetch. Therefore, S1 of Prs1 must be sent before the presentation mail is executed through the static prefetch method.

There are three hyperlinks of the hyperpresentation constituting the presentation mail: Active hyperlink, Inactive hyperlink, and User Interaction hyperlink. The active hyperlink branches unconditionally at the time of linking. If a link is encountered during execution, the running presentation stops and flows along the link, and when the linked presentation ends, it returns to its parent presentation itself.Inactive hyperlinks do not execute as unconditionally ignored links as opposed to active Link Finally, the User Interaction hyperlink is a form of hypertext in a web browser, where control is passed along the link when the user's interaction is given. In the case of Inactive hyperlink, it is not executed, so it is not prefetched. In case of Active hyperlink, it is prefetched by the dynamic-static mixing technique shown below.

The data to be prefetched to play a presentation mail can be obtained as follows in relation to the transmission speed of the communication network, the data consumption rate for the playback, and the entire presentation time.

First, the method of determining the amount of data to prefetch is determined as follows.

Pfrefetch_data (a, b) = n (a-b) ........ Expression (1)

a: amount of data played per second (bytes per sec)

b: amount of data transmitted over the network per second (bytes per sec)

n: Execution time specified in presentation (sec)

Here, when the data amount of x is prefetched, the change in the amount of data retained by time is shown in the following table.

Time (sec) One 2 3 . . . N Amount of data (byte) x-a + b x-2a + 2b x-3a + 3b . . . x-na + nb

[Table 1] Table of Changes in Retention Data

In Table 1, after n seconds, execution ends and the amount of data retained is zero. Therefore, the value of the data amount x to be prefetched that satisfies the condition x-na + nb = 0 is n (a-b).

By analyzing the VIP program of the presentation mail, the values n, a, and b required for prefectch (a, b) calculation can be calculated in advance, so this method calculates the amount of data to be imported before the presentation is performed. Can be used. The problem with this approach, however, is that the transmission speed of the network changes over time. Therefore, there is also a need for a method for determining the amount of adaptive network prefetch data that adjusts the data to be prefetched by recalculating the transmission speed and requirements of the network at regular time intervals.

Secondly, the amount of data to be prefetched to reproduce the adaptive presentation p is determined by the following equation.

prefetch_data (p) = (ti-ti-1) (transfer_data (ti)-play_data (ti)) --- Equation (2)

ti: time interval to recalculate,

t0: start time,

pt is the end of presentation p

play_data (t): amount of data to play per second at time t

transfer_data (t): The amount of data to be transferred through the network per second at time t

presentation_time (p): The execution time (sec) for which the presentation p is assigned to the presentation program.

The above method is difficult to utilize before the presentation starts, and may be used as a means of reflecting the state of the communication network when data is consumed at the same time when actual presentation starts and data is newly acquired from a remote location. In general, play_data (ti) required to calculate prefetch_data (p) does not change much, but transfer_data (ti) is severely affected by the load of the network. There are many ways to calculate this, but it is most meaningful to measure the transmission rate by using a method such as ping to suit the actual situation.

Thirdly, the time t to start prefetch to get the data in advance before starting the presentation is determined as follows.

t = start_time-x / b -------------- expression (3)

start_time: Execution start time of the stream (sec)

x: amount of data to prefetch (byte)

b: amount of data transmitted over the network per second (byte per sec)

The t value changes according to the execution start time and execution time of the presentation. If the value is less than 0, the prefetch is performed before executing by the static method. When the value is greater than 0, the prefetch is executed during the dynamic method. Is done.

The amount of data a to be reproduced per second of the presentation mail shown in Equation (1) is 14,000 bytes, and in the case of a modem of 56 Kbps, the amount of data b transmitted per second is 7,000 bytes, and Prs1 of FIG. 10 is performed from 0 to 30 seconds. Suppose we have stream 1 and stream 2 performed from 10 to 30 seconds, and stream 3 performed from 40 to 60 seconds, the next prefetch time point using the basic principles equations (1) and (3) (t) can be determined.

The prefetch data amount (x) of stream 1 is 30 * (14,000-7,000) = 210,000 bytes by equation (1) x = n (a-b), and the prefetch time point (t) is expressed by equation (3) t = start_time-0-(210,000 // 7,000) = -30 by x / b In this manner, a prefetch list is obtained by obtaining the prefetch points of the streams of the presentations of FIGS. 10, 11, and 12, and the configuration is as shown in FIG.

At this time, information about the prefetch start time t can be seen in the prefetch list. When the value is less than 0, it can be seen that the prefetch cannot be performed after the presentation is executed. So you need to prefetch it from your parent presentation.

In FIG. 14, the first list 10 in Prs3 needs to be moved to its upper presentation Prs2, and when it is considered as the prefetch list of Pre2, the prefetch start time value is recalculated as follows.

When to Link (50)-Start of Parent Presentation (30) + Prefetch Time (-10)

Therefore, adding the prefetch time point 10 to the prefetch list of Prs2 with 50-30 + (-10) gives the same structure as in Figure 15, and recalculating 50 and 30 of Prs2 gives 30-0 + (-50) = 20 And 30-0 + (-30) = 0. Moving these to the prefetch list of Prs1 forms a dynamic list as shown in FIG.

The parent presentation no longer exists. In this case, a list with a negative value of the highest presentation Prs1 cannot be dynamically prefetched at run time. Therefore, a static prefetch method should be applied. Therefore, write the list to be prefetched before execution in Static_List as follows.

As described above, one hyperpresentation is composed of presentations, and a static list, which is a static prefetch list, and a dynamic list that must be prefetched during execution can be obtained by the above method. Therefore, there is an initial delay because the data of the stream in static_list must be obtained before execution. Generalizing the above method, we can write

First, a method of combining with a hyperlinked parent presentation assumes that a prefetch list of each presentation is determined as an input as shown in FIG. 14, and searches for a hyperlink set between the presentations and prefetches itself during execution. This is to support the dynamic prefetch method by recalculating the missing data, that is, prefetch_time (t) of prefetch_object whose prefetch_time (t) is less than 0 and moving it to its parent presentation.

The first step takes the next hyper_link in the hyper link list and terminates if it does not exist. The second step retrieves the next prefetch object from the prefetch_list of the sub_prs of the hyper_link, and performs the eighth step if the prefetch object does not exist. In the third step, if the prefetch time of the prefetch object is less than zero, the execution continues. If the prefetch time is greater than zero, the seventh step is performed. In the fourth step, the prefetch time of the prefetch object is recalculated as the prefetch time of the prefetch object-the link time of the base prs-the start time of the base prs. In the fifth step, the prefetch objects are inserted into the prefetch list of the base prs in order of decreasing prefetch time. Step 6 deletes the prefetch object from the prefetch list of the sub prs. The seventh step is to perform the second step, and the eighth step is to determine whether there is a higher presentation of base_prs. That is, the base_prs of the hyper-link same as the base_prs are obtained in the sub_prs of the hyper_linke. In the ninth step, if there is a higher level presentation in the eighth step, the second step is performed again. In the tenth step, the process returns to the first step, and the eleventh step ends.

Through this method, there is a prefetch_object having a prefetch_time (t) smaller than 0 only in the top level presentation, and dynamic prefetching is impossible for them. So move them into the static-list to apply the static prefetch method.

Also, in the method of finding a static list for a static method, step 20 obtains a presentation object from the presentation list, and ends if none. In the second step, the prefetch object is fetched from the prefetch list of the presentation object. In the third step, if the prefetch time of the prefetch object is less than zero, the third step continues. If the prefetch time is greater than zero, the third step is performed. In the fourth step, prefetch objects are inserted in the static list in the order of the smallest pretch time. In the fifth step, the prefetch object is deleted from the prefetch list. In the sixth step, the process returns to the first step, and the seventh step ends.

In addition, when the user interaction hyperlink is described, it can be seen that the user may or may not click on the user interaction link that flows when the user clicks. At this point, it is not efficient to prefetch all presentations linked to hyperlinks that the user does not click. Therefore, the focus is on the fact that users do not click all hyperlinks, as they do not click all the hypertext on the real web, and links that are likely to be clicked to predict whether or not a hyperlink linked to a presentation is clicked. We need to add technical elements so that only prefetching data is available.

Therefore, after determining whether to prefetch the link by first counting the number of clicks by the user in the control program, the initial count value of the link prefetch may be assigned by the mail producer.

Each presentation has a count, and the mail producer assigns an initial count value according to the data characteristics or production intention of the presentation. This is to reflect the intention of the mail producer in the real time presentation technique. When the presentation mail is applied to the advertisement mail, the presentation on the User Interaction hyperlink, which is frequently clicked by the subscribers who receive the mail, must be prefetched and not prefetched for links that are rarely clicked. While reflecting the intention of the system, the overhead of unnecessary prefetching is reduced. First, the cost effective function will be described, and the cost effective function is shown in equation (4).

cef (w, t) = w * t ----------------- Equation (4)

w: weight

t: prefetch delay time

Important in the above formula (4) are w and t. Since this variable can also change, we set the frequency and criteria for the user to determine whether or not to prefetch it. How to adjust the weight according to the number of uses is as follows.

If (max_user_rate> = pivot_rate)

then weight = user_rate

else weight = init_rate

user_rate: Percentage of clicks over all mail subscribers

max_user_rate: Maximum percentage at present

init_rate: Usage rate given by the initial creator (%)

pivot_rate: The reference value is 50%.

Then, set threadhold as follows to determine whether to prefetch as follows:

if (cef (w, t)> = threshold)

then prefetch

else not prefetch

threshold: cef (pivot_rate, pivot_delay_time)

pivot_delay_time: A delay that the user can tolerate (eg 10 seconds).

In the case of a User Interaction link by searching for a hyperlink, the cost effective function of Equation (4) above determines whether to prefetch the link. This weights the user's click probability for the User Interaction link at the prefetch delay time of the linked presentation. The weight value is the result of more than half of the subscribers checking the mail when the maximum value (max_user_rate) of the percentage of clicks for all subscribers exceeds pivot_rate. Therefore, since the value of user_rate is accurate, if max_user_rate exceeds pivot_rate, the value of user_rate becomes weight. Otherwise, the accuracy of user_rate is inferior because most of the subscribers have not checked the mail yet. Therefore, in this case, the value of init_rate becomes weight according to the intention of the producer. If the pivot_rate is set to 50%, but the network condition is bad, the higher the criterion can be used to reduce the overhead for prefetching. In the method of determining prefetching of the user interaction link, step 31 brings a next hyper link from a hyper link list, continues execution if a hyper link exists, and performs step 37 if a hyper link does not exist. Step 32 continues if the attribute of the hyper_link is User Interaction, and performs step 36 if the other attribute is different. Step 33 is weight = user_rate if the user_max_rate of the hyperlink is larger than the pivot rate, and weight = init rate if the hyperlink is smaller than the pivot rate. In step 34, the threshold is calculated by cef (pivot_rate, pivot delay time). In step 35, if cef (weight, prs_delay_time) is smaller than the threshold value, the prefetch is not executed by deleting from the prefetch list. Step 36 returns to step 31, and step 37 ends.

The presentation for links not to be prefetched by the prefetch determination method is removed from the prefetch list. This is to gain the benefit of the network by giving up the presentation with the lowest probability that the user clicks for the purpose of reducing the infinite initial delay due to prefetching of all presentations in the low speed network.

The prefetch point of time for presentations linked to hyperlinks was solved with dynamic prefetching as much as possible, and static prefetching was used for data that could not be resolved in real time. In this way, the dynamic prefetch method and the static prefetch method are mixed to implement a hyperlink control method for presentation and hyperpresentation in which data flow control is complicated.

As can be seen from the above description, the present invention can provide a multi-media service in one middle-ware in an ultra high-speed information network environment, and also provide an integrated environment that makes it easy to develop an application service desired by a user. It will play a big role in the activation of high-speed information communication network, and it can be applied to on-demand advertisements using multimedia presentation mail using video, audio, and graphic. In addition, an advertisement production company produces an advertisement presentation at the request of an advertiser, and sends an advertisement presentation mail to a client subscribed to a mail advertisement service. At this time, the client receives only the control program of the presentation and the actual multimedia data exists in the distributed environment. When the subscriber executes the presentation mail, the directing server operates and transmits and directs the actual data, thereby providing a convenient effect.

Claims (7)

A first step of displaying a hyperpresentation window on an initial screen of BIP so as to create a scenario desired by the user; A second step of registering a presentation desired by a user by pressing a register presentation button of a toolbar in the hyperpresentation window displayed in the first step; In the second step, after registering a plurality of presentations in the hyperpresentation window, a queue and a hyperlink are set in each presentation so that all the presentations registered in the hyperpresentation window can be produced in the scenario desired by the user. Step 3; And a fourth step of transmitting the presentation mail, which is the configuration information registered in the hyperpresentation window, after the third step. The method of claim 1, In the second step, the presentation registered in the hyperpresentation window may include: an icon setting step of setting an icon representing a stored file while storing image data or text data as an arbitrary file; A stream creation step of creating a stream by selecting an icon corresponding to data desired by a user from the image data or text data; And stream data created by a synchronization setting step of setting and synchronizing an operation time to each icon constituting each stream created in the stream creation step. The method of claim 1, In the presentation mail transmitted in the fourth step, configuration information, which is a presentation in which a queue and a hyperlink are set, is transmitted to a hyperpresentation window, and actual data, which is multimedia data such as a video, sound, and graphics, is stored in a server. To create and send a multimedia presentation mail. The recipient saves or opens the presentation mail and plays the presentation mail. When the presentation mail is played, the actual data corresponding to the presentation mail stored in the remote server is stored in real time by the static prefetch method and the dynamic prefetch method. How to launch the presentation mail to be sent to. The method of claim 4, wherein The static prefetch method is a method of executing a presentation mail, characterized in that the point of time of prefetch is made before the reproduction of the presentation mail is executed, and a part of the actual data is transmitted to my computer. The method of claim 4, wherein The dynamic prefetch method is a method of executing a presentation mail, characterized in that the start time of the prefetching is performed while the presentation mail is executed, and a part of the actual data is transmitted to my computer. A plurality of fishes, which have a combination station environment where cameras, monitors, microphones and speakers are connected through an A / V board, are connected through a network, and each fish is provided with a BIP and a mux program, and each fish is a mux. Apparatus for transmitting and executing a multimedia presentation mail each connected by a network connected via a server.