CN101507209A - System and method for a high reliability base layer trunk - Google Patents
System and method for a high reliability base layer trunk Download PDFInfo
- Publication number
- CN101507209A CN101507209A CNA200680033682XA CN200680033682A CN101507209A CN 101507209 A CN101507209 A CN 101507209A CN A200680033682X A CNA200680033682X A CN A200680033682XA CN 200680033682 A CN200680033682 A CN 200680033682A CN 101507209 A CN101507209 A CN 101507209A
- Authority
- CN
- China
- Prior art keywords
- high reliability
- connects
- data
- network
- transmission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000004891 communication Methods 0.000 claims abstract description 27
- 230000005540 biological transmission Effects 0.000 claims description 35
- 230000004044 response Effects 0.000 claims description 4
- 230000001105 regulatory effect Effects 0.000 claims description 3
- 238000012546 transfer Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 abstract description 13
- 238000013461 design Methods 0.000 description 4
- 230000014509 gene expression Effects 0.000 description 3
- 230000011664 signaling Effects 0.000 description 3
- 101100048435 Caenorhabditis elegans unc-18 gene Proteins 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 239000012634 fragment Substances 0.000 description 2
- 230000008929 regeneration Effects 0.000 description 2
- 238000011069 regeneration method Methods 0.000 description 2
- 230000003252 repetitive effect Effects 0.000 description 2
- 230000003466 anti-cipated effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000005253 cladding Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 125000004122 cyclic group Chemical group 0.000 description 1
- 230000007850 degeneration Effects 0.000 description 1
- 231100000826 degradation of vision Toxicity 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000010561 standard procedure Methods 0.000 description 1
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
A method for transport of high-priority, loss-sensitive data and other less loss-sensitive data between parties in a conference or communication session on an electronic communications network includes establishing a high-reliability connection between two points in the network using a connection technology or transport method that is different than that used for otherwise transmitting conference or communication session data between the two points and transmitting the high-priority, loss-sensitive data over the established high-reliability connection.
Description
The cross reference of related application
The application requires to be filed in the U.S. Provisional Patent Application S/N.60/701 on July 20th, 2005, and No. 111, be filed in the S/N.60/714 on September 7th, 2005, No. 600 and the S/N.60/723 that is filed on October 4th, 2005, No. 347 priority.In addition, the u.s. patent application serial number of this application and common application [
The SVC system], [
SVC] and [
Shake] relevant.All above-mentioned priority and related application all are included in this by quoting in full.
Technical field
The present invention relates to multimedia and telecommunication technology.Especially, the present invention relates to be used for audio and videoconference between the end points on the electronic communication network, based on the system and method for the Signal Compression of using scalable video and audio coding technology.
Background technology
The permission of ges forschung technology is encoded data-signal (for example, audio frequency and/or video data signal) with multilevel scheme and is compressed to transmit.The information content of subject data signal is distributed in the middle of its encoded a plurality of layers.In these a plurality of layers each or the combination of several layers can send in bit stream separately.By design, " basic unit " bit stream enough is used for the information of required minimum or basic quality level reconstruction when being carried in original audio and/or vision signal decoding.Other " enhancement layer " bit stream portability additional information can be to their decodings to be used for making improvement on the basis of the basic horizontal mass reconstruction of original audio and/or vision signal or resolution.Through the sandwich construction of ges forschung make to the information of decoding request in base layer bitstreams of particular enhancement layer bit stream can with and possibly the additional information in other lower enhanced layer bit can use.
Should be noted that other method that is used to create enhancement layer also comprises: a) under not with reference to the situation of base layer information to the complete representation of high-quality signal, the method for a kind of being also referred to as " radio hookup "; Perhaps b) the close but two or more expressions of correlation minimum of same quality of signals, wherein in these expressions one independently subclass will be considered " basic unit " and all the other expressions will be considered enhancing.Back one method is also referred to as " multiple description coded ".For brevity, all these methods all are called as basic unit and enhancement layer coding at this.
Use scalable audio coding (SAC) and scalable video coding (SVC) in the audio frequency that can on electronic communication network, realize and/or the video conferencing system.The common U.S. Patent application S/N[that submits to
The SVC system] and [
SVC] described be used for exemplary audio and/system and method for the scalable Voice ﹠ Video coding of video conference application.The patent of being quoted has been described the specific I P multipoint control unit (MCU) that is called as scalable video Conference server (SVCS) and scalable audio conference server (SACS) that is designed to the transmission of SAC and SVC layer bit stream between the coordination committee end points.
For the conference applications of exchange audio between conferencing endpoints and video pictures, can allow losing of enhanced layer information between transmission period or bit stream.Yet losing of any base layer information or bit stream do not allowed between transmission period.Losing of data or information can cause receiving the audio frequency rebuild on the end points and/or the required basic or minimum quality serious degradation of vision signal in the base layer bitstreams.Required this degeneration basic or that minimum quality is rebuild can cause unsafty conference applications performance.Therefore, the intimate nothing of base layer bitstreams is lost on the communication network, and to send for any application based on scalable or layered codecs all be important.
On (best-effort) network (for example, Internet protocol (IP) network) of doing the best, sending of base layer bitstreams can occur on the insecure channel that wherein uses available transport-layer techniques to realize reliable delivery.The transport-layer techniques that can be used for this purposes comprises, for example, standard technique (for example, forward error correction (FEC) and automatic repetitive requests (ARQ)) and be entitled as " Method of and Apparatus for the Transmission of High andLow Priority Segments of a Video Bitstream over Packet Networks (method and apparatus that is used for the transmission of the high priority of video bit stream on the packet network and low priority fragment) ", United States Patent (USP) 5,481, the technology of describing in No. 312, this technology can be used to improve the Restoration Mechanism of the bag transmission that is used to lose and the influence that alleviates packet loss.In some cases, as at the United States Patent (USP) 5 that is entitled as " Video Bitstream Regeneration Using PreviouslyAgreed to High Priority Segments (using the high priority fragment of prearrange to carry out video bit stream regeneration) ", 510, describe in No. 844, can be before real-time Data Transmission off-line transmission basic unit reliably.
Allowing on high reliability connects, to transmit basic unit on difference service (DiffServ) Internet protocol (IP) network.Yet in fact, for example when the conference session of a lot of different short-terms is arranged, for base layer data transmission or the distribution of the conference in the network high reliability channel that mails to each end points may be comparatively difficult.On the IP network that can distinguish service or other network, reserve and provide high reliability channel to relate to extra signaling and/or manual configuration procedures.Signaling that these are extra and/or manual configuration procedures may be burdensome, particularly when having to these extra signalings of repetition and/or manual configuration procedures for the conference session that may require the different short-term of the difference setting of high reliability channel connection between conferencing endpoints and/or the bridge service device (for example, MCU, SVCS and SAC).
Consider now in order between conferencing endpoints, to set up high reliability network communication channels with the replaceability of transmitting responsive base layer bitstreams or through improved method.
Summary of the invention
The system and method that is used for setting up permanent or semipermanent high reliability channel (HRC) between the end points of electronic communication network and bridge circuit is provided.The HRC bandwidth can be reserved and be used for the reliable transmission of high priority or sensitive data (for example, adopt in the data-signal conference applications of scalable audio frequency and/or video coding base layer data bit stream) and send.
System and method of the present invention relates in electronic communication network sets up the high reliability connection to be used for from first end points or past second end points of server or Server Transport real time data with bandwidth reserved.In one embodiment of the invention, this high reliability connects a kind of technology that is different from the routine data transmission technology between first end points in the electronic communication network/server and the second end points/server that is based on.Correspondingly, can be advantageously setting up high reliability at the single communication that is independent of main memory on this network between these end points/servers or conference session connects.
In another exemplary embodiment of the present invention, be multiplexed into single bag so that to be designed to guarantee that the reliable transmission of data transmits on being connected with the mode of sending from the high priority and the sensitive data of two or more servers or end points.This connection can be permanent connection set up dividually with conference session or stop semipermanently be connected or be connected in response to the semipermanent of bandwidth of regulating in operation the estimation of the network traffic between first server and the second server.
Description of drawings
Figure 1A and 1B show and are used to set up the block diagram of sending the feature of the example system that the high reliability of sensitive data is connected with protected mode according to principle of the present invention.
In the accompanying drawing, unless otherwise stated, otherwise same numeral and character are used to indicate similar features, key element, assembly or the part of illustrated embodiment in the whole text.In addition, though specifically describe the present invention with reference to the accompanying drawings, this realizes explicitly with illustrated embodiment.
Embodiment
The invention provides the permanent or semipermanent high reliability that is used between the nexus transmit and be connected (HRC) with sending high priority or sensitive data.High priority or sensitive data for example, can be the base layer data through ges forschung that is used in the point-to-point or multipoint conference application of adopting scalable audio frequency and/or video coding.Should be noted that other method that is used to create basic unit also comprises radio hookup and multiple description coded, and we are called basic unit and enhancement layer coding at this with these methods for brevity.
Figure 1A and 1B show the realization of HRC140 in exemplary electronic communications network (for example, IP network 100).Exemplary communication network 100, of course, for example, cross over two long-range campus A and B, wherein each is by providing the local area network (LAN) of service to serve to the local user (for example, operating LAN1 and the LAN2 that is used for local user 110a and 110b among campus A and the B respectively).MCU 120a and MCU 120b are arranged in respectively among LAN1 and the LAN2.Local user 120a in each campus (for example, user 1,2...k) and 120b (for example, user 1,2...m) can any suitable network topology (for example, star like arrangement) be connected to MCU unit separately.In addition, MCU 120a and 120b can have any suitable network bridge device design, for example comprise conventional MCU, scalable video coding server (SVCS) and scalable audio coding server (SACS) design.Exemplary SVCS and SACS are at the common U.S. Patent application No. that submits to
SVCSIn be described.Figure 1B shows wherein, and MCU 120a and 120b are the example of SACS equipment.
For communicating by letter between the campus on the communication network 100, MCU 120a and MCU 120b can be by link or arterial highway 130 are connected as possible.
According to the present invention, MCU 120a and MCU 120b are also by being connected to each other with parallel second communication link or arterial highway (that is, HRC 140), arterial highway as possible 130.HRC 140 can for good and all be based upon between two MCU so that provide minimum reliability services for audio conferencing, video conference and other delay-sensitive application.For example, the sensitive base layer bitstreams of losing that can specify HRC 140 to carry between two MCU is used to be used for scalable video between the campus/audio conferencing.Transmission on the arterial highway 130 as possible of conventional IP network technology can used for losing the lower bit stream of susceptibility (for example, enhanced layer bit).
Can with IP network 100 in be used for setting up as possible the routine of the arterial highway 130 different technology of delivery technique of doing the best and realize or dispose HRC140.For example, use conventional delivery technique as possible, one in the IP network 100 shared circuit and be can be used as the arterial highway 130 as possible of sending enhancement data.On the contrary, HRC 140 has the special circuit of reserving or specifying the bandwidth that is used to transmit base layer data.
HRC 140 can be that permanent trunk is installed.In suitable IP network, HRC 140 can be configured to almost permanent or semipermanent installation yet in an alternate embodiment of the invention.For example, IP network 100 can be the network with Differentiated Services (DiffServ) ability.In this network, can advantageously excavate the DiffServ ability and be used in predetermined set time section, setting up or specifying a high reliability to connect as HRC 140.A fixing or variable time period be regulated and be reserved to the bandwidth that is used as this high reliability connection of HRC can according to network condition.
If when not being fully reliable, can use automatic repetitive requests (ARQ) or forward error correction technique (FEC) at the HRC 140 that is not used in other method of setting up HRC 140 or set up.For example, end points (for example, user 1,2 etc.) or its bridge circuit (for example, MCU 120a or MCU 120b) message transmission that can repeat earlier with sending out or send on the HRC 140 repeatedly.This number of times that repeats to transmit automatically can depend on the channel error of prediction or loss condition and can suitably be chosen to the anticipated loss in the transmission is carried out compensating perspectively.Perhaps, end points or MCU can retransmit so that information is compensated in response to actual loss retrospective ground.For example, information transmitted and only retransmit specific on the cacheable HRC 140 of the end points of MCU by the information of high-speed cache based on the request that receives end points or MCU.Can detect apace in the situation of losing with report information at reception end points or MCU, this process is suitable for.
Depend on the available characteristic of channel and network condition, the method for the above-mentioned HRC 140 that is used for setting up bandwidth reserved can be individually or with any suitable applied in any combination to the end points of electronic communication network to MCU, MCU to end points or MCU connect to MCU.In addition, as previously mentioned, MCU can be the transmission that conventional design maybe can be designed to scalable video and/or audio coding.
The important benefits that use has the arterial highway of HRC is that in multi-hop connected, any protocol operation relevant with reliability (for example, retransmitting) was limited between two direct-connected end points.This feasible influence to end-to-end delay minimizes.On the contrary, will have to be equaled the delay of whole end-to-end delay based on end-to-end operated system.
Others of the present invention relate to the Bandwidth Management of HRC 140.On HRC 140, have in the situation of too much available bandwidth, (that is, when be not that HRC 140 all bandwidth reserveds are when all being used to transmit base layer bitstreams), one or more lower enhanced layer bit of susceptibility of losing also can be transmitted on HRC 140.Can the use standard cladding realize base layer bitstreams with technology (for example, tcpip stack technology) and multiplexed on this high reliability channel of the enhanced layer bit that allowed.
In another exemplary embodiment of the present invention, from some users' base layer video, audio frequency and At All Other Times the responsive type packet can be combined or be blended in the bag with big payload to reduce the bag header overhead.The hybrid packet payload has the bandwidth requirement and the transmission on HRC 140 high reliability connect of reduction.
In addition, when having used scalable audio frequency and/or video coding function, the packet size in the audio and video streams may have cyclic variation.In this case, MCU 120a and 120b (for example, SVCS or SACS) thus can be configured to transmit control signal to relax or the transfer of data that staggers avoids gathering bigger bag from different end points simultaneously in transmission on HRC 140 to sending end points.This configuration can and improve the arterial highway utilance with even out bandwidth demand surges.
Though described the embodiment that is considered to the preferred embodiments of the present invention, but person of skill in the art will appreciate that and to make other and further change and distortion and can not deviate from spirit of the present invention it, and the present invention is intended to cover all these variations and the distortion that drops in the true scope of the present invention.For example, HRC of the present invention this be described to the multi-endpoint meeting arrange in second communication link or arterial highway between two MCU.Yet, be understood that easily, can be advantageously between other network configuration and any two network elements (for example, between network endpoint or terminal, network or in the network point, bridge equipment or server), realize this HRC.For example, can between the user, set up HRC or arterial highway to be used for the communication of direct endpoint by between two users, inserting to end points through the MCU (for example, MCU 120a or MCU 120b) of suitably configuration.As another example, can merge or integrate the HRC/ arterial highway that has started from this end points self to provide with end points itself through the MCU of suitably configuration.
It will also be understood that,, can use the combination of suitable hardware and software to realize HRC according to the present invention.The software that can be provided for realizing on computer-readable medium and operate above-mentioned HRC (promptly, instruction), these media can include, but are not limited to, firmware, memory, memory device, microcontroller, microprocessor, integrated circuit, ASICS, online Downloadable medium and other usable medium.
Claims (29)
- One kind be used for meeting on the electronic communication network or communication session in many ways between transmission high priority loss sensitive data and other lose the method for the lower data of susceptibility, described method comprises:Being independent of described meeting or communication session ground uses and sets up high reliability connection between described 2 at the used different interconnection technique of transmitting conference or communication session data between 2 of described network or transmission method originally; AndThe loss sensitive data of the described high priority of transmission on the high reliability of being set up connects.
- 2. the method for claim 1, it is characterized in that, described high priority loss sensitive data is the base layer data through the video and/or audio data-signal of ges forschung, and wherein sets up high reliability and connect and to comprise that reserving its bandwidth is used to transmit base layer data.
- 3. the method for claim 1 is characterized in that, described 2 at least one will be received from the packet of described number side in many ways multiplexed and on described high reliability connects transmission described through multiplexed packet.
- 4. the method for claim 1 is characterized in that, is multiplexed in the single bag under the public header so that transmission on described high reliability connects from least two sides' high priority loss sensitive data.
- 5. the method for claim 1 is characterized in that, the described high reliability of setting up connects and to set up permanent high reliability between described 2 that are included in the described network and connect.
- 6. the method for claim 1, it is characterized in that, described electronic communication network is the IP network with Differentiated Services ability, and the wherein said high reliability of setting up connects and to comprise and use described Differentiated Services ability that the connection between described 2 is reserved a time period to be used to transmit described high priority loss sensitive data.
- 7. the method for claim 1, it is characterized in that, the described high reliability of setting up connects the independent physical connection comprise between using at described 2 and transmits described high priority loss sensitive data, and wherein said independent physical connection is the connection that originally is used for except that described network in the connection of transmitting data between described 2.
- 8. the method for claim 1 is characterized in that, described high reliability connects by described 2 uses transport-layer techniques to set up.
- 9. the method for claim 1 is characterized in that, described 2 any one that comprise in point between network endpoint, network, the interior point of network and the combination in any thereof.
- 10. the method for claim 1 is characterized in that, the described high reliability of setting up connects at least one that comprises in transmission one packet at least twice and the interpolation FEC information.
- 11. the method for claim 1 is characterized in that, the described high reliability of setting up connects semipermanent connection that comprises that foundation is set up dividually or stopped with described conference session.
- 12. the method for claim 1 is characterized in that, the described high reliability of setting up connects and also to comprise in response to the bandwidth that described high reliability connects is regulated in the estimation of the data traffic between described 2.
- 13. the method for claim 1 is characterized in that, described set up high reliability connect also comprise to each transmit leg send instructions with stagger transfer of data in case avoid in described 2 any place gather will transmission on described high reliability connects data.
- 14. the method for claim 1, it is characterized in that the described high reliability of setting up connects and is connected the described high priority loss sensitive data of transmission in the high reliability of being set up and also comprises and make described high reliability the bandwidth of usefulness can be for the transmission use of other data in connecting.
- 15. one kind be used for meeting on the electronic communication network or communication session in many ways between transmission high priority loss sensitive data and other lose the system of the lower data of susceptibility, described system comprises:High reliability in the described network between 2 connects, described connection be independent of described meeting or use conversationally with script described 2 in described network between used different interconnection techniques or the transmission method of transmitting conference or communication session data set up; And wherein said high reliability connects the designated described high priority loss sensitive data of transmission between described 2 that is used for.
- 16. system as claimed in claim 15, it is characterized in that, described high priority loss sensitive data is the base layer data through the video and/or audio data-signal of ges forschung, and the bandwidth that wherein said high reliability connects is reserved for transmit described high priority loss sensitive data use between two intermediate points.
- 17. system as claimed in claim 15 is characterized in that, at least one in described 2 be configured to the packet that is received from described number side in many ways multiplexed and on described high reliability connects transmission described through multiplexed packet.
- 18. system as claimed in claim 15, it is characterized in that the high priority loss sensitive data that at least one in described 2 is configured to be received from least two sides is multiplexed in the single bag under the public header so that transmission on described high reliability connects.
- 19. system as claimed in claim 15 is characterized in that, it is that the permanent high reliability between 2 connects described in the described network that described high reliability connects.
- 20. system as claimed in claim 15, it is characterized in that, described electronic communication network is the IP network with Differentiated Services ability, and wherein is to use described Differentiated Services ability to set up described high reliability to connect so that the connection between described 2 is reserved a set time section to be used to transmit described high priority loss sensitive data.
- 21. system as claimed in claim 15, it is characterized in that, described high reliability connection is the independent physical connection between described 2, and described independent physical connection is the connection that originally is used in described network the connection of transmission data between described 2.
- 22. system as claimed in claim 15 is characterized in that, described high reliability connects by described 2 uses transport-layer techniques to set up.
- 23. system as claimed in claim 15 is characterized in that, described 2 any one that comprise in point between network endpoint, network, the interior point of network and the combination in any thereof.
- 24. system as claimed in claim 15 is characterized in that, described high reliability connects and comprises the connection of transmitting a packet at least twice thereon.
- 25. system as claimed in claim 15 is characterized in that, it is semipermanent connection that described high reliability connects.
- 26. system as claimed in claim 15 is characterized in that, the adjustable connection of estimation of the data traffic that it is its bandwidth response between to described 2 that described high reliability connects.
- 27. system as claimed in claim 15 is characterized in that, be stagger by sending instructions each transfer of data in case avoid in described 2 any place gather will transmission on described high reliability connects data set up described high reliability and connect.
- 28. system as claimed in claim 15 is characterized in that, described system is configured to make described high reliability, and the bandwidth of usefulness can be for the transmission use of other data in connecting.
- 29. comprise the computer-readable medium that requires the instruction set of at least one described step among the 1-14 in order to enforcement of rights.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US71460005P | 2005-09-07 | 2005-09-07 | |
| US60/714,600 | 2005-09-07 | ||
| US60/723,347 | 2005-10-04 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101507209A true CN101507209A (en) | 2009-08-12 |
Family
ID=40977840
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA200680033682XA Pending CN101507209A (en) | 2005-09-07 | 2006-07-21 | System and method for a high reliability base layer trunk |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101507209A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103650502A (en) * | 2011-07-13 | 2014-03-19 | 瑞典爱立信有限公司 | Encoder, decoder and methods thereof for reference picture management |
-
2006
- 2006-07-21 CN CNA200680033682XA patent/CN101507209A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103650502A (en) * | 2011-07-13 | 2014-03-19 | 瑞典爱立信有限公司 | Encoder, decoder and methods thereof for reference picture management |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2006330074B2 (en) | System and method for a high reliability base layer trunk | |
| US8502858B2 (en) | System and method for multipoint conferencing with scalable video coding servers and multicast | |
| US7984174B2 (en) | Multicast videoconferencing | |
| JP5265383B2 (en) | System and method for conference server architecture for low latency and distributed conferencing applications | |
| US20030009578A1 (en) | Method and system for delivering streaming media to fixed clients or mobile clients with multiple description bitstreams | |
| Singh et al. | Comparison of multiple-description coding and layered coding based on network simulations | |
| US20080159180A1 (en) | System and method for a high reliability base layer trunk | |
| CN101502109B (en) | Systems and methods for conference server architecture for low-latency and distributed conferencing applications | |
| Meggers et al. | Providing video conferencing for the mobile user | |
| CN101507209A (en) | System and method for a high reliability base layer trunk | |
| Handley | Applying real-time multimedia conferencing techniques to the Web | |
| Shacham et al. | HMC: A system for Heterogeneous Multicast over ATM | |
| Christianson et al. | Hierarchical audio encoder for network traffic adaptation | |
| Yin et al. | A videoconference system on the campus networks based on H. 323 protocol | |
| Sernec et al. | Two-way video transmission trial over SHDSL | |
| AU2012258352A1 (en) | System and method for multipoint conferencing with scalable video coding servers and multicast |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20090812 |