CN1972439A - Wireless video on-demand system, method and AVI file analysis, fluidizing method - Google Patents
Wireless video on-demand system, method and AVI file analysis, fluidizing method Download PDFInfo
- Publication number
- CN1972439A CN1972439A CNA2006101574475A CN200610157447A CN1972439A CN 1972439 A CN1972439 A CN 1972439A CN A2006101574475 A CNA2006101574475 A CN A2006101574475A CN 200610157447 A CN200610157447 A CN 200610157447A CN 1972439 A CN1972439 A CN 1972439A
- Authority
- CN
- China
- Prior art keywords
- client
- server
- video
- rtsp
- stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000004891 communication Methods 0.000 claims abstract description 12
- 238000004806 packaging method and process Methods 0.000 claims description 6
- 238000005538 encapsulation Methods 0.000 claims description 5
- 230000006835 compression Effects 0.000 claims description 4
- 238000007906 compression Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 abstract description 4
- 230000000007 visual effect Effects 0.000 abstract description 3
- 230000006870 function Effects 0.000 description 13
- 238000005516 engineering process Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013496 data integrity verification Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 238000012108 two-stage analysis Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
This invention relates to visual frequency play system and method based on wireless local network, which comprises interface wireless local network flow media servo and at least customer end by use of RTP, RTCP and RTSP agreement communication, wherein, the servo adopts single wire process servo; the customer end adopts PDA with each composed of one task manager through its task manager transfer to fulfill customer end RTP data receive and RTCP report receive and send.
Description
Technical Field
The invention relates to a system and a method for providing information service, which realize a set of video on demand system under the environment of wireless heterogeneous local area network and provide a plurality of methods for optimizing the streaming media playing effect under the condition of the wireless heterogeneous local area network.
Background
With the development of computer multimedia technology and network technology, streaming media playing technology has been widely used. The technology allows the audience to watch the multimedia program on line, thereby realizing a series of functions of video on demand, video conference and the like. In open source code software for a video Server, a Helix Server of RealNetworks company and a Darwin Stream Server of Apple company have the advantages of wide use, high stability and excellent performance, but large code amount, complex structure, unsuitability for improvement on the structure and relatively poor expandability; the live communication Media adopting the LGPL protocol open source code provides support for various streaming Media and video compression formats and RTP/RTCP protocol, has stronger stability and practicability, is packaged into a library, has clear structure and is suitable for building a server on the basis of the library. Com Streaming Media is also available to clients.
On the other hand, wireless communication technology has been rapidly developed in recent years. Mobile phones have gained popularity in a few years, and palmtop computers (including Pocket PCs and Palm) have also entered thousands of households. The Pocket PC2003 operating system does not support DirectX, so that multimedia development libraries such as DirectShow, DirectDraw, DirectSound and the like cannot be used when a player is developed on a PDA; the Pocket PC itself provides a set of open source players, Pocket MVPs, which can be used for development.
Wireless lans are generally lower in bandwidth and data transmission rate than comparable wireline networks, and may impose certain limitations when transmitting data with high bandwidth requirements, such as multimedia streams. Neither the host frequency nor the memory of Pocket PCs are comparable to desktop computers.
Disclosure of Invention
The invention aims to provide a video-on-demand system based on a wireless heterogeneous local area network, which combines video-on-demand and wireless communication in a streaming media technology, can enable a PDA to play streaming media data through a wireless network, and has high system efficiency.
In order to achieve the above purpose, the video on demand system based on the wireless heterogeneous local area network of the invention comprises a streaming media server and at least one client which are accessed into the wireless local area network, wherein the streaming media server and each client adopt RTP, RTCP and RTSP protocols for communication; the streaming media server adopts a single-thread concurrent server and comprises an RTSP server and a task manager, wherein the task manager is used for monitoring a connection port of an RTSP protocol and is responsible for scheduling each path of media stream; the client side adopts PDA, each client side comprises a task manager, and each client side completes the receiving of RTP datagram and the receiving and sending of RTCP report of the client side through the scheduling of the task manager.
The on-demand method of the video on-demand system comprises the following steps:
the streaming server creates an instance of an RTSP server and initializes it,
the stream media server establishes a task manager instance for monitoring a connection port of an RTSP protocol and is responsible for scheduling each path of media stream;
the client sends a connection request to the streaming media server through the wireless local area network,
after receiving the client connection request, the RTSP server creates an RTSP clientsession object, which makes a session specified by the RTSP protocol with the client, acquires stream information from the MediaSession and MediaSession class object instances, and calls the GroupSock class object instance to send the acquired stream information to the client.
The RTSP session between the RTSP clientsession object and the client at least includes:
after the streaming media server receives the SETUP command,
establishing a FramedSource class object example, reading media data from a file into a FramedBuffer buffer area,
establishing an RTPSink object example, performing RTP encapsulation on the media data in the FramedBuffer buffer area and transmitting the media data,
establishing MediaSession and mediasub session class object examples, and describing a session and a media stream; and the number of the first and second groups,
after receiving the PLAY instruction, the streaming media server registers the media stream to be played in its task manager.
The AVI file analyzing and streaming method of the video-on-demand system comprises the following steps:
analyzing the AVI file, and dividing the AVI file into two paths of audio stream and video stream;
analyzing the video stream, extracting a video frame, packaging the video frame into a format of an RTP datagram and then sending the video frame to a client; at the same time, the user can select the desired position,
and analyzing the audio stream, extracting an audio block, packaging the audio block into a format of an RTP datagram, and sending the RTP datagram to the client.
Before encapsulating the video frame into an RTP datagram, the method may further include a step of performing transcoding on the video frame, where the transcoding is performed in at least one of the following three manners: the compression ratio is improved, a coding method with a simpler decoding algorithm is adopted, and the video resolution is reduced.
The invention combines the video on demand and the wireless communication in the streaming media technology, so that the PDA can play the streaming media data through the wireless network, and the invention has wide commercial, military and civil values. The streaming media server adopts a single thread model, is controlled by a timer, and is responsible for all the work of connecting a client, performing RTSP conversation, reading a streaming media file, sending RTP and RTCP packets and the like by one thread, thereby thoroughly avoiding the defect that a large amount of system resources are consumed when the multithread is repeatedly switched.
The Streaming Media server is realized by adopting live.
Before the streaming media server packages the video frames into RTP datagram, the streaming media server also optimizes the video frames such as code conversion, code rate control and the like to reduce the data volume transmitted through the wireless network and the decoding operation volume on the PDA, thereby leading the PDA to restore smooth video pictures under the conditions of low bandwidth and data transmission rate of the wireless local area network, low PDA dominant frequency and internal memory.
Drawings
FIG. 1 is an architectural diagram of a single-threaded concurrency model employed by a streaming media server in the present invention;
fig. 2 is a diagram illustrating an internal structure of an RTSP server;
fig. 3 is a diagram of a RTSP client session with an RTSP server for a typical RTSP session;
FIG. 4 is a diagram of the processing of an AVI formatted media stream by a streaming server;
fig. 5 is a schematic diagram of the overall architecture of the network side of the player to perform the transceiving operation of the audio, video reception and RTCP control report.
Detailed Description
In this embodiment, a streaming server on a desktop PC is implemented to provide a video-on-demand service to a streaming player on a Pocket PC. The aim is to complete the basic server and expand the platform, and the PDA can complete transmission by using a symmetric coding technology after video acquisition; and simultaneously, functions of code rate control, Transcoding (Transcoding), application layer multicast and the like are allowed to be added to the server, and the proxy server is completed. The communication between the server and the player adopts a communication protocol based on RTP, RTCP and RTSP; wherein, the RTSP protocol transmits the format information of the streaming media through the SDP protocol. The set of video-on-demand system is compatible with a RealPlayer of a streaming media player, namely, a user can use the RealPlayer on a common IBM PC compatible machine to communicate with a streaming media server. To this end, the server operates following the communication protocol between Real series products.
In the video-on-demand system of the embodiment, the streaming media server and the client are connected by the wireless local area network of the 802.11b protocol, the theoretical bandwidth is 11Mbps, the coverage requirement is small, and the streaming media server and the client are limited within a few APs.
The streaming media server adopts a desktop PC, and is configured as follows:
hardware configuration: pentium 41.8 GHz CPU, 128 Mb sdam, IDE hard disk;
operating the system: windows 2000 or Windows XP;
the server software was developed with Microsoft Visual C + + 6.0.
The client adopts an HP iPAQ Pocket PC h2210 palm computer, and is configured as follows:
hardware configuration: a 400MHz Intel XScale processor, a 64Mb memory (56Mb main memory), a CF 802.11 wireless network card;
operating the system: microsoft Pocket PC 2003;
the player of the client is developed by Microsoft Embedded Visual C + + 4.0.
The following takes streaming AVI files as an example, and with reference to the accompanying drawings, a description is given of the workflow and design implementation of a streaming media server.
Fig. 1 illustrates a single thread model adopted by the streaming media video server in the present invention, and one thread is responsible for the tasks of connecting clients, performing RTSP sessions, reading streaming media files, sending RTP and RTCP packets, etc. through timer control. When the server is started, an instance of the RTSP server is created and initialized, and a task manager (task scheduler) instance is created to monitor the connection port of the RTSP protocol and is responsible for scheduling each path of media stream.
Fig. 2 depicts an internal structure of the RTSP server. When receiving the client connection request, the RTSP server (RTSP server) creates a RTSP client session object to perform the session specified by the RTSP protocol with the client, and obtains the stream information from the MediaSession and MediaSession class object instances. The network part is encapsulated in a Groupsock class and its related classes.
Fig. 3 depicts a process in which a client and RTSPClientSession conduct a typical RTSP session. After receiving the SETUP instruction, the streaming media server establishes a FramedSource class object instance for reading in media data from a file, and the FramedBuffer buffer area and the RTPSink class object instance are used for carrying out RTP encapsulation on the media data and sending the media data; MediaSession and MediaSession class object instances are created to describe sessions and media streams. After receiving the PLAY instruction, the server registers the media stream to be played in a task manager (task scheduler), so that the task scheduler calls a function of a mediasession class at regular intervals, reads the file into a buffer area, and sends an RTP datagram.
Fig. 4 describes the processing procedure of the AVI format media stream by the server. AVI format audio and video are packaged together, and two streams are separated by a server through an AVIDemux class and an AVIProgramSTREAmServer class before streaming. And then extracting data of the video frame and the audio block through AVIVideoStreamFramer and AVIVideoStreamFramer which process the video stream, AVIAudioStreamFramer and AVIAudioStreamServer which process the audio stream and the like, sending the data to VideoRTPSink and AudioRTPSink, packaging the data into a format of RTP datagram and sending the data to the client.
To make the server compatible with RealPlayer, RTP and RTSP must be used to communicate with realonelayer, and the details of the RealNetworks company's own communication protocol must be complied with, but the details are not disclosed. When the server responds to the DESCRIBE command for the AVI file, the information of the AVI file header (especially the information of the encoding mode) is not directly sent to the client, but is encrypted and sent to the player in the form of "opaque data". The encryption and decryption algorithms are not disclosed. The specific method of the server is as follows: through a program and Real Server analog connection, the 'OpaquData' is intercepted and stored as a file for the streaming media Server to use.
When the AVI file is analyzed, two-stage analysis is adopted. Firstly, resolving an AVI file into two paths of streams, namely one path of audio and one path of video; and then the two streams are respectively analyzed, decomposed into audio blocks and video frames, and then respectively packaged into datagrams to be sent out.
During streaming transmission, an RTP encapsulation format of RealNetworks series products is adopted, an additional head of 8 bytes is added to a video frame, and the position of the datagram in one data frame is marked.
When the fast forward and fast backward in the VCR operation are realized, the server receives two instructions- "PAUSE" and "PLAY" continuously sent by the player through the RTSP connection. After receiving the PAUSE command, the server stops sending the RTP datagram and simultaneously stops reading the media stream from the file; after receiving the 'PLAY' instruction, reading the media stream from the head, calculating the number of frames and bytes needing to be skipped according to the position to be skipped, then skipping to the response position to read the data, reading the buffer area, and restarting the encapsulation and sending the RTP datagram by the network part at the same time.
In order to restore a smooth video frame on the PDA, the streaming server performs transcoding on the video frame before encapsulating the video frame into RTP datagram, which may specifically adopt the following method: the compression ratio can be improved, and the bandwidth occupation during communication with the client is reduced; or a coding method with a simpler decoding algorithm is adopted, so that the decoding pressure of the client is relieved; or aiming at the handheld device, namely converting the original video with higher resolution into the low-resolution video according to the characteristic that the screen resolution of the handheld device is smaller, so as to save network bandwidth and decoding resources.
The details of the implementation of the player will be described below by taking AVI format files as an example and referring to the drawings.
The network side of the player is similar to the server structure, and a task manager (task scheduler) mechanism is used for scheduling to complete the receiving of audio and video and the transceiving of RTCP control reports, as shown in fig. 5.
The player is developed on the basis of a Pocket PC self open source player, namely Pocket MVP.
The PocketMVP has detailed modular packaging, and the following modules are adopted for playing the AVI format file: the PocketMVP.exe is a main program, and calls each module to establish a playing thread and complete a playing function; playlist is a program that sets a playlist; dll is used to read AVI streams from the middle layer buffer; dll is the decoder of Divx; the GetFileName.dll is responsible for popping up a dialog box to obtain a file or URL requested to be played by a user; dll is used for initialization; reading the content of the media stream from the file by InputMediaBuffering.dll and storing the content into a buffer zone; InputMediaHTTP.dll downloads files through an HTTP protocol and stores the files into a buffer zone; InputMediaRTSP.dll is connected with a streaming media server through an RTSP protocol, receives an RTP streaming media datagram and stores the RTP streaming media datagram into a buffer area; mp12libce.dll is a decoder for mp1, mp 2; dll 3libce.dll is a decoder for mp 3.
The PocketPC workflow is scheduled by using a TaskSchedule, reads media data from a Source, and delivers the media data to a Sink for processing after processing.
Reading media data from a file and storing the media data in a buffer in PocketPC is a separate project, and a separate DLL file is generated, so that a buffer for reading data from a network is reestablished and the original DLL file is replaced. To this end, the following related classes are employed or created: a Framed RTPSource class inherits from the RTPSource class, a member function network ReadHandler reads RTP datagram from the network, the RTP datagram is stored into a buffer area after correct verification, sorting and assembling, and then a member function DoGetNextFrame obtains a video frame or an audio block after data integrity verification and datagram additional header processing; an AVIAudioRTPSource class inheriting from a MultiFramed RTPSource class, storing RTP audio data received from a network into a buffer zone in a specific format, wherein a main member function is a processSpecialHeader; the AVIVideoRTPSource class inherits from the MultiFramed RTPSource class, and stores RTP video data received from a network into a buffer zone in a specific format, wherein a main member function is a processSpecialHeader; a buffer packet class, describing a buffer zone, wherein the RTP datagram received on the network is directly stored in the buffer zone, the member function filinData calls a handleRead member function of the RTPInterface class to complete the operation of network reading and storing the network reading into the buffer zone, and the member function use copies the data in the buffer zone into another buffer zone to complete the sequencing and combination of the datagram; the Reordering class is a buffer area at the middle layer of a client, allocates a block buffer area, receives RTP datagrams downwards, sorts, assembles and caches the RTP datagrams, provides a single, complete and assembled video frame or audio block upwards, assembles the received RTP datagrams according to a certain sequence and position by a member function storePacket, and caches the RTP datagrams together, returns an assembled video frame or audio block by a member function getNextCompletedpacket, and waits for a period of time according to a time domain value or returns an incomplete frame if the RTP datagrams forming the frame do not arrive completely.
Claims (6)
1. Video-on-demand system based on wireless heterogeneous local area network, its characterized in that: the system comprises a streaming media server and at least one client which are accessed to a wireless local area network, wherein the streaming media server and each client adopt RTP, RTCP and RTSP protocols for communication; wherein,
the streaming media server adopts a single-thread concurrent server and comprises an RTSP server and a task manager, wherein the task manager is used for monitoring a connection port of an RTSP protocol and is responsible for scheduling each path of media stream;
the client side adopts PDA, each client side comprises a task manager, and each client side completes the receiving of RTP datagram and the receiving and sending of RTCP report of the client side through the scheduling of the task manager.
2. The wireless heterogeneous local area network-based video-on-demand system according to claim 1, wherein: the Streaming Media server is realized by adopting live.
3. A video-on-demand method based on the video-on-demand system of claim 1, comprising the steps of:
the streaming server creates an instance of an RTSP server and initializes it,
the stream media server establishes a task manager instance for monitoring a connection port of an RTSP protocol and is responsible for scheduling each path of media stream;
the client sends a connection request to the streaming media server through the wireless local area network,
after receiving the client connection request, the RTSP server creates an RTSP clientsession object, which makes a session specified by the RTSP protocol with the client, acquires stream information from the MediaSession and MediaSession class object instances, and calls the GroupSock class object instance to send the acquired stream information to the client.
4. The on-demand method according to claim 3, wherein: the RTSP clientsession object makes an RTSP session with the client that includes at least,
after the streaming media server receives the SETUP command,
establishing a FramedSource class object example, reading media data from a file into a FramedBuffer buffer area,
establishing an RTPSink object example, performing RTP encapsulation on the media data in the FramedBuffer buffer area and transmitting the media data,
establishing MediaSession and mediasub session class object examples, and describing a session and a media stream; and the number of the first and second groups,
after receiving the PLAY instruction, the streaming media server registers the media stream to be played in its task manager.
5. The AVI file parsing and streaming method of the vod system according to claim 1, further comprising the steps of:
analyzing the AVI file, and dividing the AVI file into two paths of audio stream and video stream;
analyzing the video stream, extracting a video frame, packaging the video frame into a format of an RTP datagram and then sending the video frame to a client; at the same time, the user can select the desired position,
and analyzing the audio stream, extracting an audio block, packaging the audio block into a format of an RTP datagram, and sending the RTP datagram to the client.
6. The AVI file parsing and streaming method of claim 5, wherein: before encapsulating the video frame into an RTP datagram, the method further comprises a step of performing transcoding on the video frame, wherein the transcoding mode adopts at least one of the following three modes: the compression ratio is improved, a coding method with a simpler decoding algorithm is adopted, and the video resolution is reduced.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006101574475A CN1972439A (en) | 2006-12-08 | 2006-12-08 | Wireless video on-demand system, method and AVI file analysis, fluidizing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006101574475A CN1972439A (en) | 2006-12-08 | 2006-12-08 | Wireless video on-demand system, method and AVI file analysis, fluidizing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1972439A true CN1972439A (en) | 2007-05-30 |
Family
ID=38112981
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2006101574475A Pending CN1972439A (en) | 2006-12-08 | 2006-12-08 | Wireless video on-demand system, method and AVI file analysis, fluidizing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1972439A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101342543B (en) * | 2008-08-18 | 2010-06-16 | 中冶陕压重工设备有限公司 | Fourteen-rollers strip mill |
| CN101312531B (en) * | 2007-11-02 | 2010-11-17 | 北京创毅视讯科技有限公司 | Stream service transmission method in broadcast system and stream media frame encapsulation device |
| CN103430505A (en) * | 2011-01-14 | 2013-12-04 | 捷讯研究有限公司 | Mobile media content delivery |
| US9680896B2 (en) | 2011-01-14 | 2017-06-13 | Blackberry Limited | Mobile media content delivery |
| CN113504886A (en) * | 2021-05-08 | 2021-10-15 | 辛巴网络科技(南京)有限公司 | Multimedia session framework-based multi-audio aggregation vehicle-mounted multimedia method |
-
2006
- 2006-12-08 CN CNA2006101574475A patent/CN1972439A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101312531B (en) * | 2007-11-02 | 2010-11-17 | 北京创毅视讯科技有限公司 | Stream service transmission method in broadcast system and stream media frame encapsulation device |
| CN101342543B (en) * | 2008-08-18 | 2010-06-16 | 中冶陕压重工设备有限公司 | Fourteen-rollers strip mill |
| CN103430505A (en) * | 2011-01-14 | 2013-12-04 | 捷讯研究有限公司 | Mobile media content delivery |
| US9680896B2 (en) | 2011-01-14 | 2017-06-13 | Blackberry Limited | Mobile media content delivery |
| US10616300B2 (en) | 2011-01-14 | 2020-04-07 | Blackberry Limited | Mobile media content delivery |
| CN113504886A (en) * | 2021-05-08 | 2021-10-15 | 辛巴网络科技(南京)有限公司 | Multimedia session framework-based multi-audio aggregation vehicle-mounted multimedia method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4433287B2 (en) | Receiving apparatus and method, and program | |
| EP1438673B1 (en) | System and method for communicating media signals | |
| EP2091207B1 (en) | Adaptive multimedia system for providing multimedia contents and codec to user terminal and method thereof | |
| US8332486B2 (en) | Apparatus and method for multimedia file streaming in portable terminal | |
| CN105025327B (en) | A kind of method and system of mobile terminal live broadcast | |
| CN103414751B (en) | A kind of PC screen content sharing/interaction control method | |
| CN101505365B (en) | Real-time video monitoring system implementing method based on network television set-top box | |
| JP2009512279A (en) | Media data processing using different elements for streaming and control processing | |
| US20080037573A1 (en) | Method and apparatus for encoding and distributing media data | |
| WO2016049987A1 (en) | Data processing method and apparatus, and related servers | |
| US20240205469A1 (en) | Apparatus and method for processing cloud streaming low latency playback | |
| CN1972439A (en) | Wireless video on-demand system, method and AVI file analysis, fluidizing method | |
| JP2005051299A (en) | Packet transmission device, packet reception device, packet transmission method and packet reception method | |
| US9838463B2 (en) | System and method for encoding control commands | |
| Bailey | Live video streaming from android-enabled devices to web browsers | |
| JP4433286B2 (en) | Transmission device and method, reception device and method, recording medium, and program | |
| JP2006295601A (en) | COMMUNICATION SYSTEM, TRANSMISSION DEVICE AND METHOD, RECEPTION DEVICE AND METHOD, AND PROGRAM | |
| Papadaki et al. | Mobistream: Live multimedia streaming in mobile devices | |
| Corcoran et al. | Rapid prototyping of networked A/V CE appliances | |
| Fan et al. | The design and implementation of a wireless real-time video transmission system over WLAN | |
| CN115712469A (en) | Data sharing method and device | |
| Pańka et al. | Visualization of multidimensional data on distributed mobile devices using interactive video streaming techniques | |
| Patilkulkarni et al. | Programmable Delay and Variable Bit Rate Enabled Video Streaming using C++ | |
| Delgado et al. | Integrating video streaming from heterogeneous sources in mobile devices | |
| Xu | Experimental Research on Tactile Media Art Development Platform Based on HCI Technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20070530 |