US20170310413A1 - Virtual line cards in a disaggregated optical transport network switching system - Google Patents
Virtual line cards in a disaggregated optical transport network switching system Download PDFInfo
- Publication number
- US20170310413A1 US20170310413A1 US15/419,569 US201715419569A US2017310413A1 US 20170310413 A1 US20170310413 A1 US 20170310413A1 US 201715419569 A US201715419569 A US 201715419569A US 2017310413 A1 US2017310413 A1 US 2017310413A1
- Authority
- US
- United States
- Prior art keywords
- ethernet
- piu
- ports
- ethernet switch
- fabric
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/40—Bus networks
- H04L12/407—Bus networks with decentralised control
- H04L12/413—Bus networks with decentralised control with random access, e.g. carrier-sense multiple-access with collision detection [CSMA-CD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/03—Arrangements for fault recovery
- H04B10/032—Arrangements for fault recovery using working and protection systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J3/00—Time-division multiplex systems
- H04J3/16—Time-division multiplex systems in which the time allocation to individual channels within a transmission cycle is variable, e.g. to accommodate varying complexity of signals, to vary number of channels transmitted
- H04J3/1605—Fixed allocated frame structures
- H04J3/1652—Optical Transport Network [OTN]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/40—Bus networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0659—Management of faults, events, alarms or notifications using network fault recovery by isolating or reconfiguring faulty entities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0677—Localisation of faults
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/74—Address processing for routing
- H04L45/745—Address table lookup; Address filtering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/35—Switches specially adapted for specific applications
- H04L49/351—Switches specially adapted for specific applications for local area network [LAN], e.g. Ethernet switches
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/70—Virtual switches
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/50—Address allocation
- H04L61/5038—Address allocation for local use, e.g. in LAN or USB networks, or in a controller area network [CAN]
-
- H04L61/6022—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q11/00—Selecting arrangements for multiplex systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q11/00—Selecting arrangements for multiplex systems
- H04Q11/0001—Selecting arrangements for multiplex systems using optical switching
- H04Q11/0005—Switch and router aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q11/00—Selecting arrangements for multiplex systems
- H04Q11/0001—Selecting arrangements for multiplex systems using optical switching
- H04Q11/0062—Network aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J2203/00—Aspects of optical multiplex systems other than those covered by H04J14/05 and H04J14/07
- H04J2203/0001—Provisions for broadband connections in integrated services digital network using frames of the Optical Transport Network [OTN] or using synchronous transfer mode [STM], e.g. SONET, SDH
- H04J2203/0003—Switching fabrics, e.g. transport network, control network
- H04J2203/0012—Switching modules and their interconnections
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J2203/00—Aspects of optical multiplex systems other than those covered by H04J14/05 and H04J14/07
- H04J2203/0001—Provisions for broadband connections in integrated services digital network using frames of the Optical Transport Network [OTN] or using synchronous transfer mode [STM], e.g. SONET, SDH
- H04J2203/0003—Switching fabrics, e.g. transport network, control network
- H04J2203/0026—Physical details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J2203/00—Aspects of optical multiplex systems other than those covered by H04J14/05 and H04J14/07
- H04J2203/0001—Provisions for broadband connections in integrated services digital network using frames of the Optical Transport Network [OTN] or using synchronous transfer mode [STM], e.g. SONET, SDH
- H04J2203/0073—Services, e.g. multimedia, GOS, QOS
- H04J2203/0082—Interaction of SDH with non-ATM protocols
- H04J2203/0085—Support of Ethernet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L2101/00—Indexing scheme associated with group H04L61/00
- H04L2101/60—Types of network addresses
- H04L2101/618—Details of network addresses
- H04L2101/622—Layer-2 addresses, e.g. medium access control [MAC] addresses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0895—Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/74—Address processing for routing
- H04L45/745—Address table lookup; Address filtering
- H04L45/7452—Multiple parallel or consecutive lookup operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q11/00—Selecting arrangements for multiplex systems
- H04Q11/0001—Selecting arrangements for multiplex systems using optical switching
- H04Q11/0062—Network aspects
- H04Q11/0066—Provisions for optical burst or packet networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q11/00—Selecting arrangements for multiplex systems
- H04Q11/0001—Selecting arrangements for multiplex systems using optical switching
- H04Q11/0062—Network aspects
- H04Q2011/0073—Provisions for forwarding or routing, e.g. lookup tables
Definitions
- the present disclosure relates generally to optical communication networks and, more particularly, to a disaggregated optical transport network switching system that utilizes virtual line cards of a switching fabric.
- OTN optical transport networks
- information is conveyed in the form of optical signals through optical fibers, where multiple sub-channels may be carried within an optical signal.
- OTNs may also include various network elements, such as amplifiers, dispersion compensators, multiplexer/demultiplexer filters, wavelength selective switches, optical switches, couplers, etc. configured to perform various operations within the network.
- OTNs may be reconfigured to transmit different individual channels using, for example, optical add-drop multiplexers (OADMs).
- OADMs optical add-drop multiplexers
- individual channels e.g., wavelengths
- an optical transport network (OTN) switch is used to centrally perform electrical switching of the sub-channels carried within an optical signal to different destinations.
- FIG. 1 is a block diagram of selected elements of an embodiment of an optical transport network
- FIG. 2 is a block diagram of selected elements of an embodiment of a disaggregated OTN switching system
- FIGS. 3 and 4 are block diagrams of selected elements of an embodiment of an SDN controller
- FIG. 5 is a block diagram of selected elements of an embodiment of a plug-in universal chassis
- FIGS. 6A, 6B and 6C are block diagrams of selected elements of embodiments of PIU modules
- FIGS. 7A and 7B are a block diagrams of selected elements of an embodiment of local OTN switching functionality
- FIG. 8 is a block diagram of selected elements of an embodiment of an interconnection between plug-in universal modules and Ethernet switches
- FIG. 9 is a block diagram of an embodiment of a virtual switch fabric with high density connectors.
- FIG. 10 is an embodiment of a method for connecting Ethernet fabrics for optical transport networking switching.
- a disclosed optical transport networking (OTN) switching system may include an Ethernet fabric that switches optical data units through an Ethernet fabric using plug-in universal (PIU) modules and a virtual switch fabric associated with the PIU modules.
- the Ethernet fabric may include a number M of Ethernet switches, each of the M Ethernet switches having a number N of Ethernet switch ports, each of the N Ethernet switch ports having a number P of Ethernet switch sub-ports, where a variable i having a value ranging from 1 to M denotes the ith Ethernet switch corresponding to one of the M Ethernet switches, a variable j having a value ranging from 1 to N denotes the jth Ethernet switch port corresponding to one of the N Ethernet switch ports, and a variable k having a value ranging from 1 to P denotes the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, and wherein N, M and P are greater than one.
- the OTN switching system may also include a PIU module having M PIU ports, where the ith PIU port of the MPIU ports corresponds to the ith Ethernet switch.
- the OTN switching system may switch optical data units through the Ethernet fabric using the PIU modules and a virtual switch fabric associated with the PIU modules.
- the virtual switch fabric may include virtual line cards.
- a virtual line card may include a logical aggregation of the kth Ethernet switch sub-port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches.
- the virtual line card may be associated with a virtual address that is unique to the virtual line card in the virtual switch fabric.
- Each of the PIU modules may be associated with a media access control (MAC) address, and at least a portion of the MAC address may include the virtual address of the virtual line card connected to the PIU module.
- a virtual line card may include a logical aggregation of a plurality of consecutive Ethernet switch sub-ports beginning with the kth Ethernet switch port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches.
- a disclosed Ethernet fabric for optical transport networking switching may include a number M of Ethernet switches, each of the M Ethernet switches having a number N of Ethernet switch ports, each of the N Ethernet switch ports having a number P of Ethernet switch sub-ports, where a variable i having a value ranging from 1 to M denotes the ith Ethernet switch corresponding to one of the M Ethernet switches, a variable j having a value ranging from 1 to N denotes the jth Ethernet switch port corresponding to one of the N Ethernet switch ports, and a variable k having a value ranging from 1 to P denotes the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, and where N, M, and P are greater than one.
- the Ethernet fabric may be exclusively coupled to multiple PIU modules, each having M PIU ports including a first PIU module, where an ith PIU port of the first PIU module corresponds to the ith Ethernet switch.
- the Ethernet fabric may be used to switch optical data units using the PIU modules and a virtual switch fabric associated with the PIU modules.
- the virtual switch fabric may include virtual line cards.
- a virtual line card may include a logical aggregation of the kth Ethernet switch sub-port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches.
- the virtual line card may be associated with a virtual address that is unique to the virtual line card in the virtual switch fabric.
- Each of the PIU modules may be associated with a MAC address, and at least a portion of the MAC address may include the virtual address of the virtual line card connected to the PIU module.
- the virtual line card may include a logical aggregation of a plurality of consecutive Ethernet switch sub-ports beginning with the kth Ethernet switch port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches.
- a disclosed method for connecting Ethernet fabrics for optical transport networking switching may include, in an Ethernet fabric including a number M of Ethernet switches, each of the M Ethernet switches having a number N of Ethernet switch ports, each of the N Ethernet switch ports having a number P of Ethernet switch sub-ports, assigning a variable i having a value ranging from 1 to M to denote the ith Ethernet switch corresponding to one of the M Ethernet switches, where M is greater than one.
- the method may also include assigning a variable j having a value ranging from 1 to N to denote the jth Ethernet switch port corresponding to one of the N Ethernet switch ports, and where N is greater than one.
- the method may further include assigning a variable k having a value ranging from 1 to P to denote the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, where P is greater than one.
- the method may also include connecting the Ethernet fabric exclusively to multiple PIU modules each having M PIU ports including a first PIU module, where an ith PIU port of the first PIU module is connected to the ith Ethernet switch, and switching optical data units through the Ethernet fabric using the PIU modules and a virtual switch fabric associated with the PIU modules.
- the virtual switch fabric may include virtual line cards.
- the method may further include defining a virtual line card comprising a logical aggregation of the kth Ethernet switch sub-port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches and switching the optical data units using the virtual line card.
- the method may also include associating the virtual line card with a virtual address that is unique to the virtual line card in the virtual switch fabric.
- the method may further include associating the first PIU modules with a MAC address, where at least a portion of the MAC address may include the virtual address of the virtual line card connected to the first PIU module.
- the method may also include defining a virtual line card comprising a logical aggregation of a plurality of consecutive Ethernet switch sub-ports beginning with the kth Ethernet switch port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches and switching the optical data units using the virtual line card.
- a hyphenated form of a reference numeral refers to a specific instance of an element and the un-hyphenated form of the reference numeral refers to the element generically or collectively.
- device “12-1” refers to an instance of a device class, which may be referred to collectively as devices “12” and any one of which may be referred to generically as a device “12”.
- like numerals are intended to represent like elements.
- FIG. 1 illustrates an example embodiment of an optical transport network 101 , which may represent an optical communication system.
- Optical transport network 101 may include one or more optical fibers 106 configured to transport one or more optical signals communicated by components of optical transport network 101 .
- the network elements of optical transport network 101 coupled together by fibers 106 , may comprise one or more transmitters 102 , one or more multiplexers (MUX) 104 , one or more optical amplifiers 108 , one or more optical add/drop multiplexers (OADM) 110 , one or more demultiplexers (DEMUX) 105 , and one or more receivers 112 .
- MUX multiplexers
- OADM optical add/drop multiplexers
- DEMUX demultiplexers
- Optical transport network 101 may comprise a point-to-point optical network with terminal nodes, a ring optical network, a mesh optical network, or any other suitable optical network or combination of optical networks.
- Optical fibers 106 comprise thin strands of glass capable of communicating the signals over long distances with very low loss.
- Optical fibers 106 may comprise a suitable type of fiber selected from a variety of different fibers for optical transmission.
- Optical transport network 101 may include devices configured to transmit optical signals over optical fibers 106 .
- Information may be transmitted and received through optical transport network 101 by modulation of one or more wavelengths of light to encode the information on the wavelength.
- a wavelength of light may also be referred to as a channel.
- Each channel may be configured to carry a certain amount of information through optical transport network 101 .
- WDM wavelength division multiplexing
- Coarse wavelength division multiplexing refers to the multiplexing of wavelengths that are widely spaced having low number of channels, usually greater than 20 nm and less than sixteen wavelengths
- dense wavelength division multiplexing refers to the multiplexing of wavelengths that are closely spaced having large number of channels, usually less than 0.8 nm spacing and greater than forty wavelengths, into a fiber.
- WDM or other multi-wavelength multiplexing transmission techniques are employed in optical networks to increase the aggregate bandwidth per optical fiber.
- Optical transport network 101 may be configured to transmit disparate channels using WDM or some other suitable multi-channel multiplexing technique, and to amplify the multi-channel signal.
- Optical transport network 101 may include one or more optical transmitters (Tx) 102 configured to transmit optical signals through optical transport network 101 in specific wavelengths or channels.
- Transmitters 102 may comprise a system, apparatus or device configured to convert an electrical signal into an optical signal and transmit the optical signal.
- transmitters 102 may each comprise a laser and a modulator to receive electrical signals and modulate the information contained in the electrical signals onto a beam of light produced by the laser at a particular wavelength, and transmit the beam for carrying the signal throughout optical transport network 101 .
- Multiplexer 104 may be coupled to transmitters 102 and may be a system, apparatus or device configured to combine the signals transmitted by transmitters 102 , e.g., at respective individual wavelengths, into a WDM signal.
- Optical amplifiers 108 may amplify the multi-channeled signals within optical transport network 101 .
- Optical amplifiers 108 may be positioned before and after certain lengths of fiber 106 .
- Optical amplifiers 108 may comprise a system, apparatus, or device configured to amplify optical signals.
- optical amplifiers 108 may comprise an optical repeater that amplifies the optical signal. This amplification may be performed with opto-electrical (O-E) or electro-optical (E-O) conversion.
- optical amplifiers 108 may comprise an optical fiber doped with a rare-earth element to form a doped fiber amplification element.
- optical amplifiers 108 may comprise an erbium-doped fiber amplifier (EDFA).
- EDFA erbium-doped fiber amplifier
- OADMs 110 may be coupled to optical transport network 101 via fibers 106 .
- OADMs 110 comprise an add/drop module, which may include a system, apparatus or device configured to add or drop optical signals (i.e., at individual wavelengths) from fibers 106 . After passing through an OADM 110 , an optical signal may travel along fibers 106 directly to a destination, or the signal may be passed through one or more additional OADMs 110 and optical amplifiers 108 before reaching a destination.
- OADM 110 may represent a reconfigurable OADM (ROADM) that is capable of adding or dropping individual or multiple wavelengths of a WDM signal.
- the individual or multiple wavelengths may be added or dropped in the optical domain, for example, using a wavelength selective switch (WSS) (not shown) that may be included in a ROADM.
- WSS wavelength selective switch
- optical transport network 101 may also include one or more demultiplexers 105 at one or more destinations of network 101 .
- Demultiplexer 105 may comprise a system apparatus or device that acts as a demultiplexer by splitting a single composite WDM signal into individual channels at respective wavelengths.
- optical transport network 101 may transmit and carry a forty ( 40 ) channel DWDM signal.
- Demultiplexer 105 may divide the single, forty channel DWDM signal into forty separate signals according to the forty different channels.
- optical transport network 101 may also include receivers 112 coupled to demultiplexer 105 .
- Each receiver 112 may be configured to receive optical signals transmitted at a particular wavelength or channel, and may process the optical signals to obtain (e.g., demodulate) the information (i.e., data) that the optical signals contain.
- network 101 may include at least one receiver 112 for every channel of the network.
- Optical networks may employ modulation techniques to convey information in the optical signals over the optical fibers.
- modulation schemes may include phase-shift keying (PSK), frequency-shift keying (FSK), amplitude-shift keying (ASK), and quadrature amplitude modulation (QAM), among other examples of modulation techniques.
- PSK phase-shift keying
- FSK frequency-shift keying
- ASK amplitude-shift keying
- QAM quadrature amplitude modulation
- the information carried by the optical signal may be conveyed by modulating the phase of a reference signal, also known as a carrier wave, or simply, a carrier.
- the information may be conveyed by modulating the phase of the signal itself using two-level or binary phase-shift keying (BPSK), four-level or quadrature phase-shift keying (QPSK), multi-level phase-shift keying (M-PSK) and differential phase-shift keying (DPSK).
- BPSK binary phase-shift keying
- QPSK quadrature phase-shift keying
- M-PSK multi-level phase-shift keying
- DPSK differential phase-shift keying
- the information carried by the optical signal may be conveyed by modulating both the amplitude and phase of the carrier wave.
- PSK may be considered a subset of QAM, wherein the amplitude of the carrier waves is maintained as a constant.
- polarization division multiplexing (PDM) technology may enable achieving a greater bit rate for information transmission.
- PDM transmission comprises modulating information onto various polarization components of an optical signal associated with a channel.
- the polarization of an optical signal may refer to the direction of the oscillations of the optical signal.
- the term “polarization” may generally refer to the path traced out by the tip of the electric field vector at a point in space, which is perpendicular to the propagation direction of the optical signal.
- optical network such as optical transport network 101 in FIG. 1
- a central management host may reside in the management plane and may configure and supervise the components of the control plane.
- the management plane includes ultimate control over all transport plane and control plane entities (e.g., network elements).
- the management plane may consist of a central processing center (e.g., the central management host), including one or more processing resources, data storage components, etc.
- the management plane may be in electrical communication with the elements of the control plane and may also be in electrical communication with one or more network elements of the transport plane.
- the management plane may perform management functions for an overall system and provide coordination between network elements, the control plane, and the transport plane.
- the management plane may include an element management system (EMS), which handles one or more network elements from the perspective of the elements, a network management system (NMS), which handles many devices from the perspective of the network, and an operational support system (OSS), which handles network-wide operations.
- EMS element management system
- NMS network management system
- OSS operational support system
- optical transport network 101 may include more or fewer elements than those depicted in FIG. 1 .
- optical transport network 101 may comprise any suitable network topology for transmitting optical signals such as a ring, a mesh, or a hierarchical network topology.
- the amount of information that may be transmitted over an optical network may vary with the number of optical channels coded with information and multiplexed into one signal. Accordingly, an optical fiber employing a WDM signal may carry more information than an optical fiber that carries information over a single channel. Besides the number of channels and number of polarization components carried, another factor that affects how much information can be transmitted over an optical network may be the bit rate of transmission. The higher the bit rate, the greater the transmitted information capacity. Achieving higher bit rates may be limited by the availability of wide bandwidth electrical driver technology, digital signal processor technology and increase in the required OSNR for transmission over optical transport network 101 .
- optical transport network 101 may employ a digital wrapper technology to encapsulate existing frames of data, which may originate in a variety of native protocols, and may add packetized overhead for addressing, management, and quality assurance purposes.
- the resulting optical signal in the form of optical data units (ODUs) may then be transported using individual optical wavelengths by optical transport network 101 .
- the packetized overhead may be used to monitor and control the optical signals being transported using any of a variety of different protocols.
- optical transport network 101 is performed according to optical transport networking (OTN) standards or recommendations promulgated by the International Telecommunications Union (ITU), such as ITU-T G.709—“Interfaces for the Optical Transport Network” and ITU-T G.872—“Architecture of the Optical Transport Network”, among others.
- ITU International Telecommunications Union
- the optical wavelengths in OTN may rely on a hierarchical implementation of time-division multiplexing (TDM) to optimize carrier wavelength efficiency.
- TDM time-division multiplexing
- OTN switching may be performed at different sub-wavelength bit rates along optical transport network 101 .
- OTN switching refers to switching ODU paths of different bit rates with the ODU being the atomic unit of switching.
- IP Internet protocol
- IP router refers to switching of network signals where an individual IP packet is the atomic unit of switching.
- OTN switching such as in optical transport network 101 , an ODU remains in the optical domain outside of an OTN switch from network ingress to network egress.
- an ODU may be accessed as an electrical domain object and OTN switching may include electrical switching technology.
- OTN may be formally referred to as layer 0 technologies (in The Basic Reference Model for Open Systems Interconnection, also referred to as the OSI Reference Model).
- OTN may be described as a layerl technology in the OSI Reference Model, which may operate independently of the optical wavelength domain (DWDM).
- an OTN switch may theoretically operate over dark fiber, galvanic conductors (such as copper), or over a wireless medium (such as a millimeter-scale wave, or radio frequencies).
- the term “distributed” may refer to multiple nodes, or network elements (NEs), interconnected by a network and a set of collaborating nodes (or NEs).
- the term “disaggregated” may refer to a NE in a distributed network that is further reorganized into a set of disaggregated sub-components in a physical sense, as compared to an aggregated physical structure, while maintaining the functionality of an integrated NE in a logical sense.
- the disaggregated sub-components may be made openly accessible, in contrast to the aggregated physical structure.
- a disaggregated OTN switching system In contrast to the centralized and embedded nature of an OTN switch, which is a unitary device at a single central location, a disaggregated OTN switching system is disclosed herein.
- the disaggregated OTN switching system disclosed herein may enable disaggregation of the core switching functionality with the network interface functionality.
- the disaggregated OTN switching system disclosed herein may enable OTN switching by relying on an internal Ethernet switching core (also referred to herein as an “Ethernet fabric”).
- the disaggregated OTN switching system disclosed herein may accordingly enable rapid customized configuration of a particular switching functionality at a particular location or at different remote locations.
- the disaggregated OTN switching system disclosed herein may enable much lower cost OTN switching than by using an OTN switch.
- the disaggregated OTN switching system disclosed herein may enable a much greater scalability as compared to the fixed switching capacity that is inherent in an OTN switch, because the Ethernet fabric employed may be external network infrastructure, such as data center switching systems, that can be expanded to a desired capacity.
- the disaggregated OTN switching system disclosed herein may be implemented using a plurality of plug-in universal (PIU) modules that provide interfacing and transceiving functionality between various OTN signals and Ethernet signals.
- PIU plug-in universal
- the disaggregated OTN switching system disclosed herein may be further implemented using PIU blade chassis that have interface slots populated by a number of PIU modules, which are interconnected, powered, and controlled using the PIU blade chassis. Certain ones of PIU modules disclosed herein may enable localized direct OTN switching functionality by interconnecting two or more PIU modules in a loop-back configuration, without the use of a core Ethernet fabric.
- Disaggregated OTN switching system 200 in FIG. 2 may be implemented for external switching of optical signals associated with optical transport network 101 (see FIG. 1 ) and is a schematic diagram for descriptive purposes and is not drawn to scale or perspective. It is noted that within disaggregated OTN switching system 200 , sub-wavelength scale electrical paths may be internally switched to externally switch the optical signals.
- disaggregated OTN switching system 200 is configured to function as an OTN switch 202 , in which optical signals connected to PIU modules 204 may be interconnected and logically switched among the PIU modules 204 .
- an Ethernet fabric 206 At the core of disaggregated OTN switching system 200 is an Ethernet fabric 206 .
- Each of the PIU modules 204 may function as a transceiver, with OTN inputs and outputs 208 (shown as cylindrical ports) being respectively converted to Ethernet packets that are then switchable by one or more Ethernet switches 210 .
- Ethernet fabric 206 may employ Ethernet switches 210 in any kind of Ethernet switching architecture or Ethernet switching domain.
- Ethernet fabric 206 may be implemented as a hierarchical spine-leaf architecture, which has become commonplace in many data center rack domains.
- each rack may have a so-called top-of-rack (TOR) leaf switch that operates at a relative low data throughput capacity, while the TOR leaf switches are then interconnected using a spine switch that operates at a relatively high data throughput capacity.
- TOR top-of-rack
- Ethernet fabric 206 may be hierarchically implemented using different numbers of TOR leaf switches and spine switches for any given network switching application, including aggregation into very large throughput Ethernet fabrics that may have data throughput capacity of several dozens of terabytes, or even greater.
- the interconnections between PIU modules 204 and Ethernet fabric 206 may be copper cabled connections, such as 1000BASE-CX, 1000BASE-KX, 1000BASE-T, and 1000BASE-TX for 1 GB Ethernet; such as 10GBASE-CX4, small form factor pluggable+(SFP+), 10GBASE-T, and 10GBASE-KX 4 for 10 GB Ethernet; and such as 100GBASE-CR10, 100GBASE-CR4, 100GBASE-KR4, and 100GBASE-KP4 for 100 GB Ethernet, among other potential types of copper-cable based ports.
- the interconnections between PIU modules 204 and Ethernet fabric 206 may be optical fiber Ethernet connections that are supported according to a variety of Ethernet standards for optical Ethernet ports.
- the interconnections may be any one or more of 100GBASE-SR10, 100GBASE-SR4, 100GBASE-LR4, 100GBASE-ER4, 100GBASE-CWDM4, 100GBASE-PSM4, 100GBASE-ZR, 100GBASE-KR4, and 100GBASE-KP4.
- the interconnections may be any one or more of 400GBASE-SR16, 400GBASE-DR4, 400GBASE-FR8, and 400GBASE-LR8.
- interconnections to Ethernet fabric 206 may utilize FlexEthernet (FlexE) in order to mix different transmission rates across Ethernet fabric 206 .
- FlexE FlexEthernet
- quad small form-factor pluggable QFSP
- C form-factor pluggable CFP 2
- SFP+ SFP+
- CFP 2 ports supporting analog coherent optics ACO
- ACO analog coherent optics
- Each PIU module 204 in disaggregated OTN switching system 200 is further equipped with an OTN over Ethernet (OTNoE) module 212 , which may be an application specific integrated circuit (ASIC), an ASSP (application specific standard product), or a field-programmable gate array (FPGA) that is customized for a particular purpose.
- OTN over Ethernet (OTNoE) module 212 in PIU module 204 may provide specific functionality to enable overall operation of disaggregated OTN switching system 200 as an OTN switch.
- OTNoE module 212 may be enabled to implement, in the context of disaggregated OTN switching system 200 , various types of OTN functionality over Ethernet fabric 206 .
- OTNoE module 212 may support or enable functionality for OTN path redundancy and path protection switching using Ethernet fabric 206 .
- OTNoE module 212 may support or enable functionality for concatenation of OTN path protection domains. OTNoE module 212 may support or enable functionality for distribution of OTN network paths and ODUs associated with the network paths over a 1 :N Ethernet fabric connections, where one Ethernet switch is used to protect N other working Ethernet switches in case any one of the N working Ethernet switches has a failure or indicates performance of a maintenance operation that may result in an offline state. Furthermore, both 1 :N and 0 :N protection schemes may be supported. Given the nature of very high speed switching for both OTN applications and for Ethernet fabrics, as well as the cost and complexity of using external memory with OTNoE module 212 , a latency delay variation may be experienced among Ethernet switches 210 .
- the latency delay variation (or jitter) by Ethernet fabric 206 may be an important factor to consider when choosing a ODU path distribution scheme and a particular Ethernet fabric when a protection scheme is used.
- OTNoE module 212 may support or enable functionality for ensuring ODU path and data integrity over the Ethernet fabric, even when jitter occurs over Ethernet fabric 206 .
- OTNoE module 212 may support or enable functionality for switching higher level ODUs over Ethernet fabric 206 , even when the data throughput for the higher level ODUs is larger than the underlying Ethernet ports in Ethernet fabric 206 .
- OTNoE module 212 may support or enable functionality for compressing OTN traffic to provide more efficient connections to the Ethernet fabric, while compensating for jitter and bit error rate (BER) losses that may occur over the Ethernet fabric, in order to enable using Ethernet fabric 206 for OTN switching.
- BER bit error rate
- a software-defined networking (SDN) controller 214 (see also FIGS. 3 and 4 ) is shown that coordinates operation of PIU blade chassis 214 , PIU modules 204 , and Ethernet fabric 206 .
- SDN controller 214 may be used to communicate with PIU chassis 214 and Ethernet fabric 206 for OTN switching operations.
- SDN controller 214 may accordingly configure switching paths and switching configurations, using software commands and/or application programming interfaces (APIs), to enable operation of disaggregated OTN switching system 200 as an OTN switch.
- APIs application programming interfaces
- SDN controller 214 may communicate with one or more of Ethernet switches 210 to configure one or more management information bases (MIBs) that may be utilized in configuring switching paths and/or switching configurations.
- MIBs management information bases
- SDN controller 214 may communicate with one or more of Ethernet switches 210 via a simple network management protocol (SNMP) to provide information (e.g., one or more configurations, etc.) to one or more of Ethernet switches 210 and/or to retrieve information (e.g., switch status, port status, packet collision accounting(s), packet drop accounting(s), etc.) from one or more Ethernet switches 210 .
- SNMP simple network management protocol
- SDN controller 300 in FIG. 3 may be implemented to control disaggregated OTN switching system 200 (see FIG. 2 ) and is a schematic diagram for descriptive purposes.
- SDN controller 300 is represented as a computer system including physical and logical components for implementing disaggregated OTN switching system 200 , as described herein, and may accordingly include a processor 301 , a memory 310 , and a network interface 322 .
- Processor 301 may represent one or more individual processing units and may execute program instructions, interpret data, process data stored by memory 310 or SDN controller 300 .
- SDN controller 300 may be implemented in different embodiments.
- SDN controller 300 may be implemented using a network element.
- memory 310 may represent a software controller 320 executing on processor 301 .
- memory 310 may be communicatively coupled to processor 301 and may comprise a system, device, or apparatus suitable to retain program instructions or data for a period of time (e.g., computer-readable media).
- Memory 310 may include various types of components and devices, such as random access memory (RAM), electrically erasable programmable read-only memory (EEPROM), a PCMCIA card, flash memory, solid state disks, hard disk drives, magnetic tape libraries, optical disk drives, magneto-optical disk drives, compact disk drives, compact disk arrays, disk array controllers, or any suitable selection or array of volatile or non-volatile memory.
- RAM random access memory
- EEPROM electrically erasable programmable read-only memory
- PCMCIA card such as compact memory (RAM), electrically erasable programmable read-only memory (EEPROM), a PCMCIA card, flash memory, solid state disks, hard disk drives, magnetic tape libraries, optical disk drives, magneto-optical disk drives, compact disk drives, compact disk arrays, disk array controller
- memory 310 may include different numbers of physical storage devices, in various embodiments. As shown in FIG. 3 , memory 310 may include software controller 320 , among other applications or programs available for execution. In one or more embodiments, SDN controller 214 (see FIG. 2 ) may include one or more functionalities and/or one or more structures described with reference to SDN controller 300 .
- FIG. 4 a block diagram of selected elements of an embodiment of a SDN controller 400 is illustrated.
- FIG. 4 shows further details of software controller 320 for performing SDN operations related to disaggregated OTN switching system 200 , as described above.
- abstraction model 412 may include a service abstraction model that may model configuration and state data for network services used with optical transport network 101 .
- Abstraction model 412 may include a network abstraction model that may model configuration and state data for network connections used with optical transport network 101 .
- Abstraction model 412 may include a device abstraction model that may model configuration and state data for network devices 420 used in optical transport network 101 .
- Control functions 410 may represent various control functions for network services, network connections, and network devices 420 .
- API 408 may enable control logic 406 to access control functions 410 for network services, network connections, and network devices 420 .
- API 414 may enable communication between control logic 406 , as well as external applications 416 .
- external applications 416 include orchestrators (NCX, Anuta Networks, Inc., Milpitas, Calif., USA; Exanova Service Intelligence, CENX, Ottawa, Canada), workflow managers (Salesforce Service Cloud, salesforce.com, Inc., San Franciso, Calif., USA; TrackVia, TrackVia, Inc., Denver, Colo., USA; Integrify, Integrify Inc., Chicago, Ill., USA); and analytics applications (Cloud Analytics Engine, Juniper Networks, Inc., Sunnyvale, Calif., USA; Nuage Networks Virtualized Services Directory (VSD), Nokia Solutions and Networks Oy, Espoo, Finland).
- orchestrators NCX, Anuta Networks, Inc., Milpitas, Calif., USA; Exanova Service Intelligence, CENX, Ottawa, Canada
- workflow managers Saalesforce Service Cloud, salesforce.com, Inc., San Franciso, Calif., USA; TrackVi
- control logic 406 may comprise internal control logic that remains proprietary, internal, or administratively protected within software controller 320 .
- Non-limiting examples of internal or protected portions of control logic 406 may include complex proprietary algorithms, such as for path computation, and private business logic, such as billing algorithms of the network operator.
- control logic 406 may include functionality for communicating with the PIU chassis and the Ethernet fabric, as described above.
- software controller 320 may interact with various network devices 420 using different network protocols.
- software controller 320 may interact with network device 420 using software protocol 422 that is a NETCONF protocol, a command line interface (CLI), or a simple network management protocol (SNMP).
- Network devices 420 may represents routers, switches, or network elements that are included in optical transport network 101 .
- network abstraction models 412 may be repositories, such as databases with representations of functions supported by software controller 320 , while the actual implementation of the functions is performed by control functions 410 . Accordingly, control functions 410 may utilize the different network protocols 422 to access network devices 420 .
- network devices 420 and software protocols 422 are shown in a logical view in FIG. 4 not a physical view.
- the actual physical connections between network devices 420 and software controller 220 may be different in different embodiments, such as using one or more network connections.
- SDN controller 214 (see FIG. 2 ) may include one or more functionalities and/or one or more structures described with reference to SDN controller 400 .
- PIU chassis 500 may be a rack-mounted enclosure having an internal bus and an internal processor. PIU chassis 500 may receive PIU modules via individual slots that connect a PIU module to the internal bus. The internal bus may provide power and coordination among PIU modules.
- PIU chassis 500 includes a network connection for direct communication to SDN controller 214 (see FIG. 2 ). As shown PIU chassis 500 has four slots that may be populated with individual PIU modules. It is noted that in different embodiments, PIU chassis 500 may be implemented with different numbers of slots and may be implemented in different form factors. It is noted that the PIU modules may have front side network connections for access while the PIU modules populates a slot in PIU chassis 500 .
- FIG. 6A a block diagram of selected elements of an embodiment of a coherent PIU module 601 is illustrated.
- FIG. 6A is a schematic illustration.
- Coherent PIU module 601 may populate one slot in PIU chassis 500 .
- coherent PIU module 601 is implemented with two analog coherent optical (ACO) transceivers 610 , for example, that support 100 G or 200 G OTN lines and 100 G Ethernet.
- Coherent PIU module 601 may further include a DSP 612 - 1 and an OTN framer+switch 614 - 1 , along with an OTNoE module 616 - 1 on the 100 G Ethernet side, as described above.
- Coherent PIU module 601 may include various connector ports 618 for optical or copper wire based connections, as described above.
- FIG. 6B a block diagram of selected elements of an embodiment of a client PIU module 602 is illustrated.
- FIG. 6B is a schematic illustration.
- Client PIU module 602 may populate one slot in PIU chassis 500 .
- client PIU module 602 is implemented with 16 ⁇ 10 G Ethernet/4 ⁇ 40 G Ethernet and 100 G Ethernet.
- Client PIU module 602 may further include an OTN framer+switch 614 - 2 , along with an OTNoE module 616 - 2 on the 100 G Ethernet side, as described above.
- Client PIU module 602 may include various connector ports 618 for optical or copper wire based connections, as described above.
- FIG. 6C a block diagram of selected elements of an embodiment of a high density PIU module 603 is illustrated.
- FIG. 6C is a schematic illustration.
- High density PIU module 603 may populate two slots in PIU chassis 500 .
- high density PIU module 603 is implemented with two submodules that may be similar to coherent PIU module 601 , but where each submodule may support 2 ⁇ 100 G OTN lines.
- High density PIU module 603 may further include 1 ⁇ 40 G Ethernet/10 ⁇ 10 G Ethernet client ports, 16 ⁇ 10 G Ethernet ports, four coherent ACO transceivers 610 - 3 to 610 - 6 , two DSPs 612 - 3 and 612 - 4 , and two OTN framer+switches 614 - 3 and 614 - 4 , along with two OTNoE modules 616 - 3 and 616 - 4 on the 100 G Ethernet side, as described above.
- High density PIU module 603 may include various OTN inputs and outputs 208 - 5 to 208 - 12 (shown as cylindrical ports).
- High density PIU module 603 may also include various connector ports 618 - 9 to 618 - 16 for breaking out various optical or copper wire based connections, as described above.
- FIG. 7A a block diagram of selected elements of an embodiment of local switching configurations using two directly interconnected PIU modules without a core Ethernet fabric are shown.
- PIU modules 701 - 1 and 702 - 1 are connected, and PIU modules 701 - 3 and 701 - 4 are connected.
- PIU modules 701 - 1 , 701 - 3 , and 701 - 4 may each include two coherent ACO transceivers 610 , DSPs 712 , OTN framer+switches 714 , and OTNoE 716 .
- PIU module 702 - 1 may include OTN framer+switch 714 and OTNoE 716 .
- FIG. 7A a block diagram of selected elements of an embodiment of local switching configurations using two directly interconnected PIU modules without a core Ethernet fabric are shown.
- PIU modules 701 - 1 and 702 - 1 are connected, and PIU modules 701 - 3 and 701 - 4 are connected.
- OTN framer+switches 714 may perform OTN switching, along with OTNoE modules 716 among the connected modules.
- FIG. 7A certain direct connections are shown in FIG. 7A , it will be understood that local switching configurations using PIU modules may utilize internal connections as well as mesh connection configurations, in which three or four PIU modules are directly interconnected to enable cross-connections for all participants in the mesh.
- FIG. 7B illustrates a block diagram of selected elements of an embodiment of local switching using four directly interconnected PIU modules 702 - 2 to 702 - 5 without a core Ethernet fabric.
- PIU modules 702 - 2 to 702 - 5 may each include OTN framer+switch 714 and OTNoE 716 . In this manner, certain local OTN bi-directional switching functionality using multiple switching nodes may be realized with low complexity and cost.
- FIG. 8 a block diagram of selected elements of an embodiment of an interconnection 800 between PIU modules 804 and Ethernet switches 810 is illustrated. It is noted that FIG. 8 is a schematic diagram for descriptive purposes and is not drawn to scale or perspective.
- PIU modules 804 may each include various OTN inputs and outputs 208 (shown as cylindrical ports), an OTNoE 816 , and ports P 1 -P 4 818 . As shown in FIG. 8 , ports 818 of a PIU module 804 are connected to respective port 820 of Ethernet switches 810 . In one example, ports P 1 -P 4 818 of PIU module 804 - 1 are connected to port SP 1 820 of Ethernet switches 810 . In another example, ports P 1 -P 4 818 of PIU module 804 - 3 are connected to port SP 3 of Ethernet switches 810 .
- each of ports 818 may include a quad small form-factor pluggable (QSFP) transceiver.
- the QSFP transceiver may be a QSFP28 transceiver.
- the QSFP28 transceiver may support and/or enable a 100 GE (one hundred gigabit Ethernet) connection with Ethernet switch 810 .
- ports 820 of respective Ethernet switches 810 may form a virtual line card 822 .
- ports SP 1 820 of respective Ethernet switches 810
- Other virtual line cards 822 may include other Ethernet switch ports 820 , of respective Ethernet switches 810 .
- Ethernet switch ports SP 3 820 of respective Ethernet switches 810 , may form a virtual line card 822 - 2 .
- a virtual switch fabric may include multiple virtual line cards 822 .
- virtual line card 822 - 1 may be associated with a virtual address that is unique to the virtual line card 822 - 1 in the virtual switch fabric.
- virtual line card 822 - 2 may be associated with a different virtual address that is also unique to the virtual line card 822 - 2 in the virtual switch fabric.
- each of PIU modules 804 may be associated with a unique MAC address, where at least a portion of the MAC address may include the virtual address of the virtual line card 822 that is connected to the PIU module 804 , where the portion of the MAC address aligns with the virtual address of the virtual line card 822 .
- the least significant eleven bits of the MAC address of PIU module 804 may include the virtual address of the virtual line card 822 connected to PIU module 804 .
- the least significant eleven bits of the MAC address of PIU module 804 - 1 may include “00000000001” which is the virtual address of virtual line card 822 - 1 connected to PIU module 804 - 1 for reference purposes.
- the least significant eleven bits of the MAC address of PIU module 804 - 3 may be “00000001001” which is the virtual address of virtual line card 822 - 2 connected to PIU module 804 - 3 for reference purposes.
- an Ethernet fabric may include a number M of Ethernet switches 810 , each of the M Ethernet switches 810 having a number N of Ethernet switch ports 820 , each of the N Ethernet switch ports 820 having a number P of Ethernet switch sub-ports, where a variable i having a value ranging from 1 to M denotes the ith Ethernet switch 810 corresponding to one of the M Ethernet switches 810 , a variable j having a value ranging from 1 to N denotes the jth Ethernet switch port 820 corresponding to one of the N Ethernet switch ports 820 , and a variable k having a value ranging from 1 to P denotes the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, and where N, M, and P are greater than one.
- a PIU module 804 may have M PIU ports 818 , where the ith PIU port 818 of the M PIU ports 818 corresponds to the ith Ethernet switch 810 .
- Ethernet switch sub-ports are described in further detail with reference to FIG. 9 .
- a virtual line card 822 may include a logical aggregation of the jth Ethernet switch port 818 of each of the M Ethernet switches 810 .
- an Ethernet fabric for optical transport networking switching may include a number M of Ethernet switches 810 , each of the M Ethernet switches 810 having a number N of Ethernet switch ports 820 , each of the N Ethernet switch ports 820 having a number P of Ethernet switch sub-ports, where a variable i having a value ranging from 1 to M denotes the ith Ethernet switch 810 corresponding to one of the M Ethernet switches 810 , a variable j having a value ranging from 1 to N denotes the jth Ethernet switch port 820 corresponding to one of the N Ethernet switch ports 820 , and a variable k having a value ranging from 1 to P denotes the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, and where N, M and P are greater than one.
- the Ethernet fabric may be exclusively coupled to multiple PIU modules 804 each having M PIU ports 818 including a first PIU module 804 , where an ith PIU port 818 of the first PIU module 804 corresponds to the ith Ethernet switch 810 .
- the Ethernet fabric may be used to switch optical data units using the PIU modules 804 and a virtual switch fabric associated with the PIU modules 804 .
- one or more PIU modules 804 may be configured with one or more small form-factor (SFP) transceivers.
- SFP transceivers may be a SFP28 transceiver that may support or enable one or more 25 GE (twenty-five gigabit Ethernet) connections with Ethernet switch 810 .
- a QSFP28 port of Ethernet switch 810 may be divided into four 25 GE Ethernet switch sub-ports. Utilization of the Ethernet switch sub-ports may enable other virtual line cards 822 as described further with reference to FIG. 9 .
- FIG. 9 a block diagram of an embodiment of a virtual switch fabric with high density connectors 900 is illustrated. It is noted that FIG. 9 is a schematic diagram for descriptive purposes and is not drawn to scale or perspective. As shown, port 820 of Ethernet switch 810 may be divided into four Ethernet switch sub-ports 920 . For example, SFP28 transceivers 920 may divide 100 GE port 820 of Ethernet switch 810 into four 25 GE individual connections.
- ports 818 of PIU module 804 are connected to a corresponding Ethernet switch sub-port 920 of Ethernet switches 810 .
- ports 818 of PIU module 804 - 1 are connected to Ethernet switch sub-ports S 1 -S 4 920 of Ethernet switches 810 .
- ports 818 of PIU module 804 - 2 are connected to Ethernet switch sub-port S 8 920 of Ethernet switches 810 .
- Ethernet switch sub-ports S 1 -S 4 and S 8 920 may be SFP28 transceivers that may, for instance, support and/or enable respective connections with Ethernet switches 810 .
- Ethernet switch sub-ports 920 of respective Ethernet switches 810 may form a virtual line card 922 .
- Ethernet switch sub-ports Si 920 of respective Ethernet switches 810 may form a virtual line card 922 - 1 .
- Other virtual line cards 922 may include other Ethernet switch sub-ports 920 of respective Ethernet switches 810 .
- Ethernet switch sub-ports S 8 920 of respective Ethernet switches 810 may form a virtual line card 922 - 2 .
- a virtual switch fabric 924 may include multiple virtual line cards 922 , according to one or more embodiments.
- virtual line card 922 - 1 may be associated with a virtual address that is unique to virtual line card 922 - 1 in the virtual switch fabric.
- virtual line card 922 - 2 may be associated with a different virtual address that is also unique to virtual line card 922 - 2 in the virtual switch fabric.
- each of PIU modules 804 may be associated with a unique MAC address, as above, where at least a portion of the MAC address may include the virtual address of the virtual line card 922 that is connected to the PIU module 804 , where the portion of the MAC address aligns with the virtual address of the virtual line card 922 , according to one or more embodiments.
- the least significant eleven bits of the MAC address of PIU module 804 may include the virtual address of the virtual line card 922 connected to PIU module 804 .
- the least significant eleven bits of the MAC address of PIU module 804 - 1 may include “00000000001” which is the virtual address of virtual line card 922 - 1 connected to PIU module 804 - 1 for reference purposes.
- the least significant eleven bits of the MAC address of PIU module 804 - 2 may include “00000001000” which is the virtual address of virtual line card 922 - 2 connected to PIU module 804 - 2 for reference purposes.
- a virtual line card 922 may include a logical aggregation of multiple consecutive Ethernet switch sub-ports 920 of each of the corresponding Ethernet switch ports 820 of each of the M Ethernet switches 810 beginning with a kth Ethernet switch sub-port 920 of each of the corresponding Ethernet switch ports 820 of each of the M Ethernet switches 810 .
- a virtual line card 922 - 3 may include a logical aggregation of multiple consecutive Ethernet switch sub-ports 920 S 125 through S 128 of each of the corresponding Ethernet switch ports 820 of each of the M Ethernet switches 810 .
- virtual line card 922 - 3 may utilize an entire Ethernet switch port 820 C 32 of Ethernet switch ports 820 C 1 through C 32 on each of Ethernet switches 810 , as illustrated.
- virtual line card 922 - 3 may be one of multiple virtual line cards 922 of virtual switch fabric 924 , according to one or more embodiments.
- virtual line card 922 - 3 may be associated with a virtual address that is unique to the virtual line card 922 - 3 in the virtual switch fabric 924 .
- PIU 804 - 3 may be associated with a unique MAC address, as above, where at least a portion of the MAC address may include the virtual address of the virtual line card 922 - 3 that is connected to the PIU module 804 - 3 , where the portion of the MAC address aligns with the virtual address of the virtual line card 922 - 3 .
- the least significant eleven bits of the MAC address of PIU module 804 - 3 may include “00001111101” which is the virtual address of virtual line card 922 - 3 connected to PIU module 804 - 3 for reference purposes 922 - 3 .
- a PIU blade chassis may include or store information associated with PIU slot identifications, a virtual line card width, and a virtual line card address, among others.
- PIU blade chassis 214 - 1 may include or store information in exemplary Table 1, below.
- PIU blade chassis 214 - 2 may include or store information in exemplary Table 2, below.
- a controller may maintain a database that associates PIU modules 204 and blades with virtual slots.
- SDN controller 300 may maintain a database, stored in memory 310 (see FIG. 3 ), that associates PIU modules 204 (see FIG. 2 ) and blades 214 (see FIG. 2 ) with virtual line cards.
- the database maintained by SDN controller 300 may include or store information in exemplary Table 3, below.
- information of the maintained database may be provided to the chassis blades and the PIU modules 204 during a system boot up or configuration. In another example, information of the maintained database may be provided to the chassis blades and the PIU modules during a system restart or reconfiguration.
- FIG. 10 an embodiment of a method 1000 for connecting
- Ethernet fabrics for optical transport networking switching is illustrated.
- step 1002 in an Ethernet fabric including a number M of Ethernet switches, each of the M Ethernet switches having a number N of Ethernet switch ports, each of the N Ethernet switch ports having a number P of Ethernet switch ports, a variable i having a value ranging from 1 to M to denote the ith Ethernet switch corresponding to one of the M Ethernet switches, where M is greater than one, may be assigned.
- a variable j having a value ranging from 1 to N to denote the jth Ethernet switch port corresponding to one of the N Ethernet switch ports, and where N is greater than one, may be assigned.
- a variable k having a value ranging from 1 to P to denote the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, and where P is greater than one, may be assigned.
- the Ethernet fabric may be connected exclusively to multiple PIU modules, each having M PIU ports including a first PIU module, where an ith PIU port of the first PIU module is connected to the ith Ethernet switch.
- optical data units may be switched through the Ethernet fabric using the PIU modules and a virtual switch fabric associated with the PIU modules.
- methods and systems for a disaggregated OTN switching system include using PIU modules for OTN to Ethernet transceiving and an Ethernet fabric as a switching core.
- a customized OTN over Ethernet module in the PIU modules enables various OTN functionality to be realized using the Ethernet fabric.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Small-Scale Networks (AREA)
- Time-Division Multiplex Systems (AREA)
Abstract
Description
- This application claims priority from U.S. Provisional Application No. 62/325,723 filed Apr. 21, 2016, entitled “DISAGGREGATED OPTICAL TRANSPORT NETWORK SWITCHING SYSTEM”.
- The present disclosure relates generally to optical communication networks and, more particularly, to a disaggregated optical transport network switching system that utilizes virtual line cards of a switching fabric.
- Telecommunication, cable television and data communication systems use optical transport networks (OTN) to rapidly convey large amounts of information between remote points. In an OTN, information is conveyed in the form of optical signals through optical fibers, where multiple sub-channels may be carried within an optical signal. OTNs may also include various network elements, such as amplifiers, dispersion compensators, multiplexer/demultiplexer filters, wavelength selective switches, optical switches, couplers, etc. configured to perform various operations within the network.
- In particular, OTNs may be reconfigured to transmit different individual channels using, for example, optical add-drop multiplexers (OADMs). In this manner, individual channels (e.g., wavelengths) may be added or dropped at various points along an optical network, enabling a variety of network configurations and topologies.
- Furthermore, typically, an optical transport network (OTN) switch is used to centrally perform electrical switching of the sub-channels carried within an optical signal to different destinations.
- For a more complete understanding of the present invention and its features and advantages, reference is now made to the following description, taken in conjunction with the accompanying drawings, in which:
-
FIG. 1 is a block diagram of selected elements of an embodiment of an optical transport network; -
FIG. 2 is a block diagram of selected elements of an embodiment of a disaggregated OTN switching system; -
FIGS. 3 and 4 are block diagrams of selected elements of an embodiment of an SDN controller; -
FIG. 5 is a block diagram of selected elements of an embodiment of a plug-in universal chassis; -
FIGS. 6A, 6B and 6C are block diagrams of selected elements of embodiments of PIU modules; -
FIGS. 7A and 7B are a block diagrams of selected elements of an embodiment of local OTN switching functionality; -
FIG. 8 is a block diagram of selected elements of an embodiment of an interconnection between plug-in universal modules and Ethernet switches; -
FIG. 9 is a block diagram of an embodiment of a virtual switch fabric with high density connectors; and -
FIG. 10 is an embodiment of a method for connecting Ethernet fabrics for optical transport networking switching. - In one aspect, a disclosed optical transport networking (OTN) switching system may include an Ethernet fabric that switches optical data units through an Ethernet fabric using plug-in universal (PIU) modules and a virtual switch fabric associated with the PIU modules. The Ethernet fabric may include a number M of Ethernet switches, each of the M Ethernet switches having a number N of Ethernet switch ports, each of the N Ethernet switch ports having a number P of Ethernet switch sub-ports, where a variable i having a value ranging from 1 to M denotes the ith Ethernet switch corresponding to one of the M Ethernet switches, a variable j having a value ranging from 1 to N denotes the jth Ethernet switch port corresponding to one of the N Ethernet switch ports, and a variable k having a value ranging from 1 to P denotes the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, and wherein N, M and P are greater than one. The OTN switching system may also include a PIU module having M PIU ports, where the ith PIU port of the MPIU ports corresponds to the ith Ethernet switch. The OTN switching system may switch optical data units through the Ethernet fabric using the PIU modules and a virtual switch fabric associated with the PIU modules. The virtual switch fabric may include virtual line cards. A virtual line card may include a logical aggregation of the kth Ethernet switch sub-port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches. The virtual line card may be associated with a virtual address that is unique to the virtual line card in the virtual switch fabric. Each of the PIU modules may be associated with a media access control (MAC) address, and at least a portion of the MAC address may include the virtual address of the virtual line card connected to the PIU module. A virtual line card may include a logical aggregation of a plurality of consecutive Ethernet switch sub-ports beginning with the kth Ethernet switch port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches.
- In another aspect, a disclosed Ethernet fabric for optical transport networking switching may include a number M of Ethernet switches, each of the M Ethernet switches having a number N of Ethernet switch ports, each of the N Ethernet switch ports having a number P of Ethernet switch sub-ports, where a variable i having a value ranging from 1 to M denotes the ith Ethernet switch corresponding to one of the M Ethernet switches, a variable j having a value ranging from 1 to N denotes the jth Ethernet switch port corresponding to one of the N Ethernet switch ports, and a variable k having a value ranging from 1 to P denotes the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, and where N, M, and P are greater than one. The Ethernet fabric may be exclusively coupled to multiple PIU modules, each having M PIU ports including a first PIU module, where an ith PIU port of the first PIU module corresponds to the ith Ethernet switch. The Ethernet fabric may be used to switch optical data units using the PIU modules and a virtual switch fabric associated with the PIU modules. The virtual switch fabric may include virtual line cards. A virtual line card may include a logical aggregation of the kth Ethernet switch sub-port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches. The virtual line card may be associated with a virtual address that is unique to the virtual line card in the virtual switch fabric. Each of the PIU modules may be associated with a MAC address, and at least a portion of the MAC address may include the virtual address of the virtual line card connected to the PIU module. The virtual line card may include a logical aggregation of a plurality of consecutive Ethernet switch sub-ports beginning with the kth Ethernet switch port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches.
- In yet a further aspect, a disclosed method for connecting Ethernet fabrics for optical transport networking switching may include, in an Ethernet fabric including a number M of Ethernet switches, each of the M Ethernet switches having a number N of Ethernet switch ports, each of the N Ethernet switch ports having a number P of Ethernet switch sub-ports, assigning a variable i having a value ranging from 1 to M to denote the ith Ethernet switch corresponding to one of the M Ethernet switches, where M is greater than one. The method may also include assigning a variable j having a value ranging from 1 to N to denote the jth Ethernet switch port corresponding to one of the N Ethernet switch ports, and where N is greater than one. The method may further include assigning a variable k having a value ranging from 1 to P to denote the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, where P is greater than one. The method may also include connecting the Ethernet fabric exclusively to multiple PIU modules each having M PIU ports including a first PIU module, where an ith PIU port of the first PIU module is connected to the ith Ethernet switch, and switching optical data units through the Ethernet fabric using the PIU modules and a virtual switch fabric associated with the PIU modules. The virtual switch fabric may include virtual line cards. The method may further include defining a virtual line card comprising a logical aggregation of the kth Ethernet switch sub-port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches and switching the optical data units using the virtual line card. The method may also include associating the virtual line card with a virtual address that is unique to the virtual line card in the virtual switch fabric. The method may further include associating the first PIU modules with a MAC address, where at least a portion of the MAC address may include the virtual address of the virtual line card connected to the first PIU module. The method may also include defining a virtual line card comprising a logical aggregation of a plurality of consecutive Ethernet switch sub-ports beginning with the kth Ethernet switch port of each of the corresponding Ethernet switch ports of each of the M Ethernet switches and switching the optical data units using the virtual line card.
- In the following description, details are set forth by way of example to facilitate discussion of the disclosed subject matter. It should be apparent to a person of ordinary skill in the field, however, that the disclosed embodiments are exemplary and not exhaustive of all possible embodiments.
- Throughout this disclosure, a hyphenated form of a reference numeral refers to a specific instance of an element and the un-hyphenated form of the reference numeral refers to the element generically or collectively. Thus, as an example (not shown in the drawings), device “12-1” refers to an instance of a device class, which may be referred to collectively as devices “12” and any one of which may be referred to generically as a device “12”. In the figures and the description, like numerals are intended to represent like elements.
- Turning now to the drawings,
FIG. 1 illustrates an example embodiment of anoptical transport network 101, which may represent an optical communication system.Optical transport network 101 may include one or moreoptical fibers 106 configured to transport one or more optical signals communicated by components ofoptical transport network 101. The network elements ofoptical transport network 101, coupled together byfibers 106, may comprise one ormore transmitters 102, one or more multiplexers (MUX) 104, one or moreoptical amplifiers 108, one or more optical add/drop multiplexers (OADM) 110, one or more demultiplexers (DEMUX) 105, and one ormore receivers 112. -
Optical transport network 101 may comprise a point-to-point optical network with terminal nodes, a ring optical network, a mesh optical network, or any other suitable optical network or combination of optical networks.Optical fibers 106 comprise thin strands of glass capable of communicating the signals over long distances with very low loss.Optical fibers 106 may comprise a suitable type of fiber selected from a variety of different fibers for optical transmission. -
Optical transport network 101 may include devices configured to transmit optical signals overoptical fibers 106. Information may be transmitted and received throughoptical transport network 101 by modulation of one or more wavelengths of light to encode the information on the wavelength. In optical networking, a wavelength of light may also be referred to as a channel. Each channel may be configured to carry a certain amount of information throughoptical transport network 101. - To increase the information capacity and transport capabilities of
optical transport network 101, multiple signals transmitted at multiple channels may be combined into a single wideband optical signal. The process of communicating information at multiple channels is referred to in optics as wavelength division multiplexing (WDM). Coarse wavelength division multiplexing (CWDM) refers to the multiplexing of wavelengths that are widely spaced having low number of channels, usually greater than 20 nm and less than sixteen wavelengths, and dense wavelength division multiplexing (DWDM) refers to the multiplexing of wavelengths that are closely spaced having large number of channels, usually less than 0.8 nm spacing and greater than forty wavelengths, into a fiber. WDM or other multi-wavelength multiplexing transmission techniques are employed in optical networks to increase the aggregate bandwidth per optical fiber. Without WDM, the bandwidth in optical networks may be limited to the bit-rate of solely one wavelength. With more bandwidth, optical networks are capable of transmitting greater amounts of information.Optical transport network 101 may be configured to transmit disparate channels using WDM or some other suitable multi-channel multiplexing technique, and to amplify the multi-channel signal. -
Optical transport network 101 may include one or more optical transmitters (Tx) 102 configured to transmit optical signals throughoptical transport network 101 in specific wavelengths or channels.Transmitters 102 may comprise a system, apparatus or device configured to convert an electrical signal into an optical signal and transmit the optical signal. For example,transmitters 102 may each comprise a laser and a modulator to receive electrical signals and modulate the information contained in the electrical signals onto a beam of light produced by the laser at a particular wavelength, and transmit the beam for carrying the signal throughoutoptical transport network 101. -
Multiplexer 104 may be coupled totransmitters 102 and may be a system, apparatus or device configured to combine the signals transmitted bytransmitters 102, e.g., at respective individual wavelengths, into a WDM signal. -
Optical amplifiers 108 may amplify the multi-channeled signals withinoptical transport network 101.Optical amplifiers 108 may be positioned before and after certain lengths offiber 106.Optical amplifiers 108 may comprise a system, apparatus, or device configured to amplify optical signals. For example,optical amplifiers 108 may comprise an optical repeater that amplifies the optical signal. This amplification may be performed with opto-electrical (O-E) or electro-optical (E-O) conversion. In some embodiments,optical amplifiers 108 may comprise an optical fiber doped with a rare-earth element to form a doped fiber amplification element. When a signal passes through the fiber, external energy may be applied in the form of a pump signal to excite the atoms of the doped portion of the optical fiber, which increases the intensity of the optical signal. As an example,optical amplifiers 108 may comprise an erbium-doped fiber amplifier (EDFA). -
OADMs 110 may be coupled tooptical transport network 101 viafibers 106.OADMs 110 comprise an add/drop module, which may include a system, apparatus or device configured to add or drop optical signals (i.e., at individual wavelengths) fromfibers 106. After passing through anOADM 110, an optical signal may travel alongfibers 106 directly to a destination, or the signal may be passed through one or moreadditional OADMs 110 andoptical amplifiers 108 before reaching a destination. - In certain embodiments of
optical transport network 101,OADM 110 may represent a reconfigurable OADM (ROADM) that is capable of adding or dropping individual or multiple wavelengths of a WDM signal. The individual or multiple wavelengths may be added or dropped in the optical domain, for example, using a wavelength selective switch (WSS) (not shown) that may be included in a ROADM. - As shown in
FIG. 1 ,optical transport network 101 may also include one ormore demultiplexers 105 at one or more destinations ofnetwork 101.Demultiplexer 105 may comprise a system apparatus or device that acts as a demultiplexer by splitting a single composite WDM signal into individual channels at respective wavelengths. For example,optical transport network 101 may transmit and carry a forty (40) channel DWDM signal.Demultiplexer 105 may divide the single, forty channel DWDM signal into forty separate signals according to the forty different channels. - In
FIG. 1 ,optical transport network 101 may also includereceivers 112 coupled todemultiplexer 105. Eachreceiver 112 may be configured to receive optical signals transmitted at a particular wavelength or channel, and may process the optical signals to obtain (e.g., demodulate) the information (i.e., data) that the optical signals contain. Accordingly,network 101 may include at least onereceiver 112 for every channel of the network. - Optical networks, such as
optical transport network 101 inFIG. 1 , may employ modulation techniques to convey information in the optical signals over the optical fibers. Such modulation schemes may include phase-shift keying (PSK), frequency-shift keying (FSK), amplitude-shift keying (ASK), and quadrature amplitude modulation (QAM), among other examples of modulation techniques. In PSK, the information carried by the optical signal may be conveyed by modulating the phase of a reference signal, also known as a carrier wave, or simply, a carrier. The information may be conveyed by modulating the phase of the signal itself using two-level or binary phase-shift keying (BPSK), four-level or quadrature phase-shift keying (QPSK), multi-level phase-shift keying (M-PSK) and differential phase-shift keying (DPSK). In QAM, the information carried by the optical signal may be conveyed by modulating both the amplitude and phase of the carrier wave. PSK may be considered a subset of QAM, wherein the amplitude of the carrier waves is maintained as a constant. Additionally, polarization division multiplexing (PDM) technology may enable achieving a greater bit rate for information transmission. PDM transmission comprises modulating information onto various polarization components of an optical signal associated with a channel. The polarization of an optical signal may refer to the direction of the oscillations of the optical signal. The term “polarization” may generally refer to the path traced out by the tip of the electric field vector at a point in space, which is perpendicular to the propagation direction of the optical signal. - In an optical network, such as
optical transport network 101 inFIG. 1 , it is typical to refer to a management plane, a control plane, and a transport plane (sometimes called the physical layer). A central management host (not shown) may reside in the management plane and may configure and supervise the components of the control plane. The management plane includes ultimate control over all transport plane and control plane entities (e.g., network elements). As an example, the management plane may consist of a central processing center (e.g., the central management host), including one or more processing resources, data storage components, etc. The management plane may be in electrical communication with the elements of the control plane and may also be in electrical communication with one or more network elements of the transport plane. The management plane may perform management functions for an overall system and provide coordination between network elements, the control plane, and the transport plane. As examples, the management plane may include an element management system (EMS), which handles one or more network elements from the perspective of the elements, a network management system (NMS), which handles many devices from the perspective of the network, and an operational support system (OSS), which handles network-wide operations. - Modifications, additions or omissions may be made to
optical transport network 101 without departing from the scope of the disclosure. For example,optical transport network 101 may include more or fewer elements than those depicted inFIG. 1 . Also, as mentioned above, although depicted as a point-to-point network,optical transport network 101 may comprise any suitable network topology for transmitting optical signals such as a ring, a mesh, or a hierarchical network topology. - As discussed above, the amount of information that may be transmitted over an optical network may vary with the number of optical channels coded with information and multiplexed into one signal. Accordingly, an optical fiber employing a WDM signal may carry more information than an optical fiber that carries information over a single channel. Besides the number of channels and number of polarization components carried, another factor that affects how much information can be transmitted over an optical network may be the bit rate of transmission. The higher the bit rate, the greater the transmitted information capacity. Achieving higher bit rates may be limited by the availability of wide bandwidth electrical driver technology, digital signal processor technology and increase in the required OSNR for transmission over
optical transport network 101. - As shown in
FIG. 1 ,optical transport network 101 may employ a digital wrapper technology to encapsulate existing frames of data, which may originate in a variety of native protocols, and may add packetized overhead for addressing, management, and quality assurance purposes. The resulting optical signal, in the form of optical data units (ODUs) may then be transported using individual optical wavelengths byoptical transport network 101. The packetized overhead may be used to monitor and control the optical signals being transported using any of a variety of different protocols. In particular embodiments, operation ofoptical transport network 101 is performed according to optical transport networking (OTN) standards or recommendations promulgated by the International Telecommunications Union (ITU), such as ITU-T G.709—“Interfaces for the Optical Transport Network” and ITU-T G.872—“Architecture of the Optical Transport Network”, among others. The optical wavelengths in OTN may rely on a hierarchical implementation of time-division multiplexing (TDM) to optimize carrier wavelength efficiency. - As a result of the hierarchical TDM arrangement of the optical signals in OTN, OTN switching may be performed at different sub-wavelength bit rates along
optical transport network 101. As used herein, OTN switching refers to switching ODU paths of different bit rates with the ODU being the atomic unit of switching. In contrast, Internet protocol (IP) switching, such as by an IP router, refers to switching of network signals where an individual IP packet is the atomic unit of switching. In OTN switching, such as inoptical transport network 101, an ODU remains in the optical domain outside of an OTN switch from network ingress to network egress. Within the OTN switch, an ODU may be accessed as an electrical domain object and OTN switching may include electrical switching technology. - It is noted that while OTN switching does generally take place in the DWDM domain, ROADMs and DWDM may be formally referred to as layer0 technologies (in The Basic Reference Model for Open Systems Interconnection, also referred to as the OSI Reference Model). In contrast, OTN may be described as a layerl technology in the OSI Reference Model, which may operate independently of the optical wavelength domain (DWDM). For example, an OTN switch may theoretically operate over dark fiber, galvanic conductors (such as copper), or over a wireless medium (such as a millimeter-scale wave, or radio frequencies).
- In general, the term “distributed” may refer to multiple nodes, or network elements (NEs), interconnected by a network and a set of collaborating nodes (or NEs). As used herein, the term “disaggregated” may refer to a NE in a distributed network that is further reorganized into a set of disaggregated sub-components in a physical sense, as compared to an aggregated physical structure, while maintaining the functionality of an integrated NE in a logical sense. In some embodiments, the disaggregated sub-components may be made openly accessible, in contrast to the aggregated physical structure.
- In contrast to the centralized and embedded nature of an OTN switch, which is a unitary device at a single central location, a disaggregated OTN switching system is disclosed herein. The disaggregated OTN switching system disclosed herein may enable disaggregation of the core switching functionality with the network interface functionality. The disaggregated OTN switching system disclosed herein may enable OTN switching by relying on an internal Ethernet switching core (also referred to herein as an “Ethernet fabric”). The disaggregated OTN switching system disclosed herein may accordingly enable rapid customized configuration of a particular switching functionality at a particular location or at different remote locations. The disaggregated OTN switching system disclosed herein may enable much lower cost OTN switching than by using an OTN switch. The disaggregated OTN switching system disclosed herein may enable a much greater scalability as compared to the fixed switching capacity that is inherent in an OTN switch, because the Ethernet fabric employed may be external network infrastructure, such as data center switching systems, that can be expanded to a desired capacity. The disaggregated OTN switching system disclosed herein may be implemented using a plurality of plug-in universal (PIU) modules that provide interfacing and transceiving functionality between various OTN signals and Ethernet signals. The disaggregated OTN switching system disclosed herein may be further implemented using PIU blade chassis that have interface slots populated by a number of PIU modules, which are interconnected, powered, and controlled using the PIU blade chassis. Certain ones of PIU modules disclosed herein may enable localized direct OTN switching functionality by interconnecting two or more PIU modules in a loop-back configuration, without the use of a core Ethernet fabric.
- Referring now to
FIG. 2 , a block diagram of selected elements of an embodiment of a disaggregatedOTN switching system 200 is illustrated. DisaggregatedOTN switching system 200 inFIG. 2 may be implemented for external switching of optical signals associated with optical transport network 101 (seeFIG. 1 ) and is a schematic diagram for descriptive purposes and is not drawn to scale or perspective. It is noted that within disaggregatedOTN switching system 200, sub-wavelength scale electrical paths may be internally switched to externally switch the optical signals. - As shown in
FIG. 2 , disaggregatedOTN switching system 200 is configured to function as anOTN switch 202, in which optical signals connected to PIU modules 204 may be interconnected and logically switched among the PIU modules 204. At the core of disaggregatedOTN switching system 200 is anEthernet fabric 206. Each of the PIU modules 204 may function as a transceiver, with OTN inputs and outputs 208 (shown as cylindrical ports) being respectively converted to Ethernet packets that are then switchable by one or more Ethernet switches 210.Ethernet fabric 206 may employ Ethernet switches 210 in any kind of Ethernet switching architecture or Ethernet switching domain. In various embodiments,Ethernet fabric 206 may be implemented as a hierarchical spine-leaf architecture, which has become commonplace in many data center rack domains. Thus, each rack may have a so-called top-of-rack (TOR) leaf switch that operates at a relative low data throughput capacity, while the TOR leaf switches are then interconnected using a spine switch that operates at a relatively high data throughput capacity. In this manner,Ethernet fabric 206 may be hierarchically implemented using different numbers of TOR leaf switches and spine switches for any given network switching application, including aggregation into very large throughput Ethernet fabrics that may have data throughput capacity of several dozens of terabytes, or even greater. - The interconnections between PIU modules 204 and
Ethernet fabric 206 may be copper cabled connections, such as 1000BASE-CX, 1000BASE-KX, 1000BASE-T, and 1000BASE-TX for 1 GB Ethernet; such as 10GBASE-CX4, small form factor pluggable+(SFP+), 10GBASE-T, and 10GBASE-KX4 for 10 GB Ethernet; and such as 100GBASE-CR10, 100GBASE-CR4, 100GBASE-KR4, and 100GBASE-KP4 for 100 GB Ethernet, among other potential types of copper-cable based ports. In some embodiments, the interconnections between PIU modules 204 andEthernet fabric 206 may be optical fiber Ethernet connections that are supported according to a variety of Ethernet standards for optical Ethernet ports. For example, for 100 GB Ethernet interconnections toEthernet fabric 206, the interconnections may be any one or more of 100GBASE-SR10, 100GBASE-SR4, 100GBASE-LR4, 100GBASE-ER4, 100GBASE-CWDM4, 100GBASE-PSM4, 100GBASE-ZR, 100GBASE-KR4, and 100GBASE-KP4. For example, for up to 400 GB Ethernet interconnections to the Ethernet fabric, the interconnections may be any one or more of 400GBASE-SR16, 400GBASE-DR4, 400GBASE-FR8, and 400GBASE-LR8. Furthermore, in certain embodiments, interconnections toEthernet fabric 206 may utilize FlexEthernet (FlexE) in order to mix different transmission rates acrossEthernet fabric 206. - Among the form factors for ports used in PIU modules 204 are quad small form-factor pluggable (QFSP), C form-factor pluggable (CFP, CFP2), and SFP+. For example, on the OTN line side, CFP2 ports supporting analog coherent optics (ACO) may be used in PIU modules 204, such as for 100 gigabit (100 G) or 200 gigabit (200 G) coherent OTN connections.
- Each PIU module 204 in disaggregated
OTN switching system 200 is further equipped with an OTN over Ethernet (OTNoE) module 212, which may be an application specific integrated circuit (ASIC), an ASSP (application specific standard product), or a field-programmable gate array (FPGA) that is customized for a particular purpose. OTNoE module 212 in PIU module 204 may provide specific functionality to enable overall operation of disaggregatedOTN switching system 200 as an OTN switch. OTNoE module 212 may be enabled to implement, in the context of disaggregatedOTN switching system 200, various types of OTN functionality overEthernet fabric 206. OTNoE module 212 may support or enable functionality for OTN path redundancy and path protection switching usingEthernet fabric 206. OTNoE module 212 may support or enable functionality for concatenation of OTN path protection domains. OTNoE module 212 may support or enable functionality for distribution of OTN network paths and ODUs associated with the network paths over a 1:N Ethernet fabric connections, where one Ethernet switch is used to protect N other working Ethernet switches in case any one of the N working Ethernet switches has a failure or indicates performance of a maintenance operation that may result in an offline state. Furthermore, both 1:N and 0:N protection schemes may be supported. Given the nature of very high speed switching for both OTN applications and for Ethernet fabrics, as well as the cost and complexity of using external memory with OTNoE module 212, a latency delay variation may be experienced among Ethernet switches 210. The latency delay variation (or jitter) byEthernet fabric 206 may be an important factor to consider when choosing a ODU path distribution scheme and a particular Ethernet fabric when a protection scheme is used. OTNoE module 212 may support or enable functionality for ensuring ODU path and data integrity over the Ethernet fabric, even when jitter occurs overEthernet fabric 206. OTNoE module 212 may support or enable functionality for switching higher level ODUs overEthernet fabric 206, even when the data throughput for the higher level ODUs is larger than the underlying Ethernet ports inEthernet fabric 206. OTNoE module 212 may support or enable functionality for compressing OTN traffic to provide more efficient connections to the Ethernet fabric, while compensating for jitter and bit error rate (BER) losses that may occur over the Ethernet fabric, in order to enable usingEthernet fabric 206 for OTN switching. - Finally, in
FIG. 2 , a software-defined networking (SDN) controller 214 (see alsoFIGS. 3 and 4 ) is shown that coordinates operation ofPIU blade chassis 214, PIU modules 204, andEthernet fabric 206. Specifically, functionality inSDN controller 214 may be used to communicate withPIU chassis 214 andEthernet fabric 206 for OTN switching operations. For example,SDN controller 214 may accordingly configure switching paths and switching configurations, using software commands and/or application programming interfaces (APIs), to enable operation of disaggregatedOTN switching system 200 as an OTN switch. For instance,SDN controller 214 may communicate with one or more of Ethernet switches 210 to configure one or more management information bases (MIBs) that may be utilized in configuring switching paths and/or switching configurations. In one or more embodiments,SDN controller 214 may communicate with one or more of Ethernet switches 210 via a simple network management protocol (SNMP) to provide information (e.g., one or more configurations, etc.) to one or more of Ethernet switches 210 and/or to retrieve information (e.g., switch status, port status, packet collision accounting(s), packet drop accounting(s), etc.) from one or more Ethernet switches 210. - Referring now to
FIG. 3 , a block diagram of selected elements of an embodiment ofSDN controller 300 is illustrated.SDN controller 300 inFIG. 3 may be implemented to control disaggregated OTN switching system 200 (seeFIG. 2 ) and is a schematic diagram for descriptive purposes. - In
FIG. 3 ,SDN controller 300 is represented as a computer system including physical and logical components for implementing disaggregatedOTN switching system 200, as described herein, and may accordingly include aprocessor 301, amemory 310, and anetwork interface 322.Processor 301 may represent one or more individual processing units and may execute program instructions, interpret data, process data stored bymemory 310 orSDN controller 300. It is noted thatSDN controller 300 may be implemented in different embodiments. For example, in some embodiments,SDN controller 300 may be implemented using a network element. In particular embodiments,memory 310 may represent asoftware controller 320 executing onprocessor 301. - In
FIG. 3 ,memory 310 may be communicatively coupled toprocessor 301 and may comprise a system, device, or apparatus suitable to retain program instructions or data for a period of time (e.g., computer-readable media).Memory 310 may include various types of components and devices, such as random access memory (RAM), electrically erasable programmable read-only memory (EEPROM), a PCMCIA card, flash memory, solid state disks, hard disk drives, magnetic tape libraries, optical disk drives, magneto-optical disk drives, compact disk drives, compact disk arrays, disk array controllers, or any suitable selection or array of volatile or non-volatile memory. Non-volatile memory refers to a memory that retains data after power is turned off. It is noted thatmemory 310 may include different numbers of physical storage devices, in various embodiments. As shown inFIG. 3 ,memory 310 may includesoftware controller 320, among other applications or programs available for execution. In one or more embodiments, SDN controller 214 (seeFIG. 2 ) may include one or more functionalities and/or one or more structures described with reference toSDN controller 300. - Referring now to
FIG. 4 , a block diagram of selected elements of an embodiment of aSDN controller 400 is illustrated.FIG. 4 shows further details ofsoftware controller 320 for performing SDN operations related to disaggregatedOTN switching system 200, as described above. - In
FIG. 4 ,software controller 320 is shown including a repository that may store any of variousdifferent abstraction models 412, selected as examples among other abstraction models for descriptive clarity. In some embodiments,abstractions models 412 are defined using YANG, which is a data modeling language for modeling configuration and state data used to manage network devices through a network configuration protocol (NETCONF). Specifically,abstraction model 412 may include a service abstraction model that may model configuration and state data for network services used withoptical transport network 101.Abstraction model 412 may include a network abstraction model that may model configuration and state data for network connections used withoptical transport network 101.Abstraction model 412 may include a device abstraction model that may model configuration and state data fornetwork devices 420 used inoptical transport network 101. Control functions 410 may represent various control functions for network services, network connections, andnetwork devices 420.API 408 may enablecontrol logic 406 to accesscontrol functions 410 for network services, network connections, andnetwork devices 420. - As shown in
SDN controller 400,API 414 may enable communication betweencontrol logic 406, as well asexternal applications 416. Some non-limiting examples ofexternal applications 416 that may be used withsoftware controller 320 include orchestrators (NCX, Anuta Networks, Inc., Milpitas, Calif., USA; Exanova Service Intelligence, CENX, Ottawa, Canada), workflow managers (Salesforce Service Cloud, salesforce.com, Inc., San Franciso, Calif., USA; TrackVia, TrackVia, Inc., Denver, Colo., USA; Integrify, Integrify Inc., Chicago, Ill., USA); and analytics applications (Cloud Analytics Engine, Juniper Networks, Inc., Sunnyvale, Calif., USA; Nuage Networks Virtualized Services Directory (VSD), Nokia Solutions and Networks Oy, Espoo, Finland). - In implementations of
SDN controller 400,control logic 406 may comprise internal control logic that remains proprietary, internal, or administratively protected withinsoftware controller 320. Non-limiting examples of internal or protected portions ofcontrol logic 406 may include complex proprietary algorithms, such as for path computation, and private business logic, such as billing algorithms of the network operator. In disaggregatedOTN switching system 200,control logic 406 may include functionality for communicating with the PIU chassis and the Ethernet fabric, as described above. - Furthermore,
software controller 320 may interact withvarious network devices 420 using different network protocols. For example,software controller 320 may interact withnetwork device 420 usingsoftware protocol 422 that is a NETCONF protocol, a command line interface (CLI), or a simple network management protocol (SNMP).Network devices 420 may represents routers, switches, or network elements that are included inoptical transport network 101. As noted above,network abstraction models 412 may be repositories, such as databases with representations of functions supported bysoftware controller 320, while the actual implementation of the functions is performed bycontrol functions 410. Accordingly,control functions 410 may utilize thedifferent network protocols 422 to accessnetwork devices 420. - It is noted that
network devices 420 andsoftware protocols 422 are shown in a logical view inFIG. 4 not a physical view. The actual physical connections betweennetwork devices 420 and software controller 220 may be different in different embodiments, such as using one or more network connections. In one or more embodiments, SDN controller 214 (seeFIG. 2 ) may include one or more functionalities and/or one or more structures described with reference toSDN controller 400. - Referring now to
FIG. 5 , a representation of selected elements of an embodiment of aPIU chassis 500 is illustrated.PIU chassis 500 may be a rack-mounted enclosure having an internal bus and an internal processor.PIU chassis 500 may receive PIU modules via individual slots that connect a PIU module to the internal bus. The internal bus may provide power and coordination among PIU modules. In certain embodiments,PIU chassis 500 includes a network connection for direct communication to SDN controller 214 (seeFIG. 2 ). As shownPIU chassis 500 has four slots that may be populated with individual PIU modules. It is noted that in different embodiments,PIU chassis 500 may be implemented with different numbers of slots and may be implemented in different form factors. It is noted that the PIU modules may have front side network connections for access while the PIU modules populates a slot inPIU chassis 500. - Referring now to
FIG. 6A , a block diagram of selected elements of an embodiment of acoherent PIU module 601 is illustrated.FIG. 6A is a schematic illustration.Coherent PIU module 601 may populate one slot inPIU chassis 500. In the exemplary embodiment shown inFIG. 6A ,coherent PIU module 601 is implemented with two analog coherent optical (ACO) transceivers 610, for example, that support 100 G or 200 G OTN lines and 100 G Ethernet.Coherent PIU module 601 may further include a DSP 612-1 and an OTN framer+switch 614-1, along with an OTNoE module 616-1 on the 100G Ethernet side, as described above.Coherent PIU module 601 may include various connector ports 618 for optical or copper wire based connections, as described above. - Referring now to
FIG. 6B , a block diagram of selected elements of an embodiment of aclient PIU module 602 is illustrated.FIG. 6B is a schematic illustration.Client PIU module 602 may populate one slot inPIU chassis 500. In the exemplary embodiment shown inFIG. 6B ,client PIU module 602 is implemented with 16×10 G Ethernet/4×40 G Ethernet and 100 G Ethernet.Client PIU module 602 may further include an OTN framer+switch 614-2, along with an OTNoE module 616-2 on the 100 G Ethernet side, as described above.Client PIU module 602 may include various connector ports 618 for optical or copper wire based connections, as described above. - Referring now to
FIG. 6C , a block diagram of selected elements of an embodiment of a highdensity PIU module 603 is illustrated.FIG. 6C is a schematic illustration. Highdensity PIU module 603 may populate two slots inPIU chassis 500. In the exemplary embodiment shown inFIG. 6C , highdensity PIU module 603 is implemented with two submodules that may be similar tocoherent PIU module 601, but where each submodule may support 2× 100 G OTN lines. Highdensity PIU module 603 may further include 1× 40 G Ethernet/10× 10 G Ethernet client ports, 16× 10 G Ethernet ports, four coherent ACO transceivers 610-3 to 610-6, two DSPs 612-3 and 612-4, and two OTN framer+switches 614-3 and 614-4, along with two OTNoE modules 616-3 and 616-4 on the 100 G Ethernet side, as described above. Highdensity PIU module 603 may include various OTN inputs and outputs 208-5 to 208-12 (shown as cylindrical ports). Highdensity PIU module 603 may also include various connector ports 618-9 to 618-16 for breaking out various optical or copper wire based connections, as described above. - Referring now to
FIG. 7A , a block diagram of selected elements of an embodiment of local switching configurations using two directly interconnected PIU modules without a core Ethernet fabric are shown. As illustrated, PIU modules 701-1 and 702-1 are connected, and PIU modules 701-3 and 701-4 are connected. PIU modules 701-1, 701-3, and 701-4 may each include two coherent ACO transceivers 610, DSPs 712, OTN framer+switches 714, and OTNoE 716. PIU module 702-1 may include OTN framer+switch 714 and OTNoE 716. In the configurations shown inFIG. 7A , OTN framer+switches 714 may perform OTN switching, along with OTNoE modules 716 among the connected modules. Although certain direct connections are shown inFIG. 7A , it will be understood that local switching configurations using PIU modules may utilize internal connections as well as mesh connection configurations, in which three or four PIU modules are directly interconnected to enable cross-connections for all participants in the mesh. For example,FIG. 7B illustrates a block diagram of selected elements of an embodiment of local switching using four directly interconnected PIU modules 702-2 to 702-5 without a core Ethernet fabric. PIU modules 702-2 to 702-5 may each include OTN framer+switch 714 and OTNoE 716. In this manner, certain local OTN bi-directional switching functionality using multiple switching nodes may be realized with low complexity and cost. - Referring now to
FIG. 8 , a block diagram of selected elements of an embodiment of aninterconnection 800 between PIU modules 804 and Ethernet switches 810 is illustrated. It is noted thatFIG. 8 is a schematic diagram for descriptive purposes and is not drawn to scale or perspective. PIU modules 804 may each include various OTN inputs and outputs 208 (shown as cylindrical ports), an OTNoE 816, and ports P1-P4 818. As shown inFIG. 8 , ports 818 of a PIU module 804 are connected torespective port 820 of Ethernet switches 810. In one example, ports P1-P4 818 of PIU module 804-1 are connected to portSP1 820 of Ethernet switches 810. In another example, ports P1-P4 818 of PIU module 804-3 are connected to port SP3 of Ethernet switches 810. - As shown in
FIG. 8 , each of ports 818 may include a quad small form-factor pluggable (QSFP) transceiver. For example, the QSFP transceiver may be a QSFP28 transceiver. For instance, the QSFP28 transceiver may support and/or enable a 100 GE (one hundred gigabit Ethernet) connection with Ethernet switch 810. - As shown in
interconnection 800,ports 820 of respective Ethernet switches 810 may form a virtual line card 822. For example, as illustrated,ports SP1 820, of respective Ethernet switches 810, may form a virtual line card 822-1. Other virtual line cards 822 may include otherEthernet switch ports 820, of respective Ethernet switches 810. For example, Ethernetswitch ports SP3 820, of respective Ethernet switches 810, may form a virtual line card 822-2. - In one or more embodiments, a virtual switch fabric may include multiple virtual line cards 822. In one example, virtual line card 822-1 may be associated with a virtual address that is unique to the virtual line card 822-1 in the virtual switch fabric. In another example, virtual line card 822-2 may be associated with a different virtual address that is also unique to the virtual line card 822-2 in the virtual switch fabric.
- In one or more embodiments, each of PIU modules 804 may be associated with a unique MAC address, where at least a portion of the MAC address may include the virtual address of the virtual line card 822 that is connected to the PIU module 804, where the portion of the MAC address aligns with the virtual address of the virtual line card 822. In one example, the least significant eleven bits of the MAC address of PIU module 804 may include the virtual address of the virtual line card 822 connected to PIU module 804. In one instance, the least significant eleven bits of the MAC address of PIU module 804-1 may include “00000000001” which is the virtual address of virtual line card 822-1 connected to PIU module 804-1 for reference purposes. In another instance, the least significant eleven bits of the MAC address of PIU module 804-3 may be “00000001001” which is the virtual address of virtual line card 822-2 connected to PIU module 804-3 for reference purposes.
- Though
FIG. 8 illustrates specific numbers ofports 820 of Ethernet switches 810, in one or more embodiments, an Ethernet fabric may include a number M of Ethernet switches 810, each of the M Ethernet switches 810 having a number N ofEthernet switch ports 820, each of the NEthernet switch ports 820 having a number P of Ethernet switch sub-ports, where a variable i having a value ranging from 1 to M denotes the ith Ethernet switch 810 corresponding to one of the M Ethernet switches 810, a variable j having a value ranging from 1 to N denotes the jthEthernet switch port 820 corresponding to one of the NEthernet switch ports 820, and a variable k having a value ranging from 1 to P denotes the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, and where N, M, and P are greater than one. Furthermore, a PIU module 804 may have M PIU ports 818, where the ith PIU port 818 of the M PIU ports 818 corresponds to the ith Ethernet switch 810. Ethernet switch sub-ports are described in further detail with reference toFIG. 9 . For example, a virtual line card 822 may include a logical aggregation of the jth Ethernet switch port 818 of each of the M Ethernet switches 810. - Moreover, an Ethernet fabric for optical transport networking switching may include a number M of Ethernet switches 810, each of the M Ethernet switches 810 having a number N of
Ethernet switch ports 820, each of the NEthernet switch ports 820 having a number P of Ethernet switch sub-ports, where a variable i having a value ranging from 1 to M denotes the ith Ethernet switch 810 corresponding to one of the M Ethernet switches 810, a variable j having a value ranging from 1 to N denotes the jthEthernet switch port 820 corresponding to one of the NEthernet switch ports 820, and a variable k having a value ranging from 1 to P denotes the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, and where N, M and P are greater than one. The Ethernet fabric may be exclusively coupled to multiple PIU modules 804 each having M PIU ports 818 including a first PIU module 804, where an ith PIU port 818 of the first PIU module 804 corresponds to the ith Ethernet switch 810. The Ethernet fabric may be used to switch optical data units using the PIU modules 804 and a virtual switch fabric associated with the PIU modules 804. - In one or more embodiments, one or more PIU modules 804 may be configured with one or more small form-factor (SFP) transceivers. For example, each of the SFP transceivers may be a SFP28 transceiver that may support or enable one or more 25 GE (twenty-five gigabit Ethernet) connections with Ethernet switch 810. For instance, a QSFP28 port of Ethernet switch 810 may be divided into four 25 GE Ethernet switch sub-ports. Utilization of the Ethernet switch sub-ports may enable other virtual line cards 822 as described further with reference to
FIG. 9 . - Referring now to
FIG. 9 , a block diagram of an embodiment of a virtual switch fabric withhigh density connectors 900 is illustrated. It is noted thatFIG. 9 is a schematic diagram for descriptive purposes and is not drawn to scale or perspective. As shown,port 820 of Ethernet switch 810 may be divided into fourEthernet switch sub-ports 920. For example,SFP28 transceivers 920 may divide 100GE port 820 of Ethernet switch 810 into four 25 GE individual connections. - In one or more embodiments, ports 818 of PIU module 804 are connected to a corresponding
Ethernet switch sub-port 920 of Ethernet switches 810. In one example, ports 818 of PIU module 804-1 are connected to Ethernet switch sub-ports S1-S4 920 of Ethernet switches 810. In another example, ports 818 of PIU module 804-2 are connected to Ethernet switchsub-port S8 920 of Ethernet switches 810. In the previous two examples, Ethernet switch sub-ports S1-S4 andS8 920 may be SFP28 transceivers that may, for instance, support and/or enable respective connections with Ethernet switches 810. - In one or more embodiments,
Ethernet switch sub-ports 920 of respective Ethernet switches 810 may form a virtual line card 922. For example, as illustrated, Ethernet switchsub-ports Si 920 of respective Ethernet switches 810 may form a virtual line card 922-1. Other virtual line cards 922 may include other Ethernet switchsub-ports 920 of respective Ethernet switches 810. For example, Ethernetswitch sub-ports S8 920 of respective Ethernet switches 810 may form a virtual line card 922-2. - As described above, a
virtual switch fabric 924 may include multiple virtual line cards 922, according to one or more embodiments. In one example, virtual line card 922-1 may be associated with a virtual address that is unique to virtual line card 922-1 in the virtual switch fabric. In another example, virtual line card 922-2 may be associated with a different virtual address that is also unique to virtual line card 922-2 in the virtual switch fabric. - Moreover, each of PIU modules 804 may be associated with a unique MAC address, as above, where at least a portion of the MAC address may include the virtual address of the virtual line card 922 that is connected to the PIU module 804, where the portion of the MAC address aligns with the virtual address of the virtual line card 922, according to one or more embodiments. In one example, the least significant eleven bits of the MAC address of PIU module 804 may include the virtual address of the virtual line card 922 connected to PIU module 804. In one instance with respect to PIU module 804-1, the least significant eleven bits of the MAC address of PIU module 804-1 may include “00000000001” which is the virtual address of virtual line card 922-1 connected to PIU module 804-1 for reference purposes. In one instance with respect to PIU module 804-2, the least significant eleven bits of the MAC address of PIU module 804-2 may include “00000001000” which is the virtual address of virtual line card 922-2 connected to PIU module 804-2 for reference purposes.
- In one or more embodiments, a virtual line card 922 may include a logical aggregation of multiple consecutive
Ethernet switch sub-ports 920 of each of the correspondingEthernet switch ports 820 of each of the M Ethernet switches 810 beginning with a kthEthernet switch sub-port 920 of each of the correspondingEthernet switch ports 820 of each of the M Ethernet switches 810. For example, a virtual line card 922-3 may include a logical aggregation of multiple consecutiveEthernet switch sub-ports 920 S125 through S128 of each of the correspondingEthernet switch ports 820 of each of the M Ethernet switches 810. For instance, virtual line card 922-3 may utilize an entireEthernet switch port 820 C32 ofEthernet switch ports 820 C1 through C32 on each of Ethernet switches 810, as illustrated. - Furthermore, virtual line card 922-3 may be one of multiple virtual line cards 922 of
virtual switch fabric 924, according to one or more embodiments. In one example, virtual line card 922-3 may be associated with a virtual address that is unique to the virtual line card 922-3 in thevirtual switch fabric 924. For instance, PIU 804-3 may be associated with a unique MAC address, as above, where at least a portion of the MAC address may include the virtual address of the virtual line card 922-3 that is connected to the PIU module 804-3, where the portion of the MAC address aligns with the virtual address of the virtual line card 922-3. In one example with respect to PIU module 804-3, the least significant eleven bits of the MAC address of PIU module 804-3 may include “00001111101” which is the virtual address of virtual line card 922-3 connected to PIU module 804-3 for reference purposes 922-3. - A PIU blade chassis may include or store information associated with PIU slot identifications, a virtual line card width, and a virtual line card address, among others. In one example, PIU blade chassis 214-1 (see
FIG. 2 ) may include or store information in exemplary Table 1, below. In another example, PIU blade chassis 214-2 (seeFIG. 2 ) may include or store information in exemplary Table 2, below. -
TABLE 1 PIU Slot Number Virtual Card Width Virtual Card Address 1 4 1 2 4 9 -
TABLE 2 PIU Slot Number Virtual Card Width Virtual Card Address 1 4 1 2 4 9 - A controller may maintain a database that associates PIU modules 204 and blades with virtual slots. For example, SDN controller 300 (see
FIG. 3 ) may maintain a database, stored in memory 310 (seeFIG. 3 ), that associates PIU modules 204 (seeFIG. 2 ) and blades 214 (seeFIG. 2 ) with virtual line cards. For instance, the database maintained by SDN controller 300 (seeFIG. 3 ) may include or store information in exemplary Table 3, below. -
TABLE 3 Virtual Card PIU Module Address Interface Width Location PIU Module Type 1 4 Blade 1,Slot 12 × 100G coherent 2 3 4 5 4 Blade 2,Slot 12 × 100G coherent 6 . . . . . . . . . . . . 127 128 - In one example, information of the maintained database may be provided to the chassis blades and the PIU modules 204 during a system boot up or configuration. In another example, information of the maintained database may be provided to the chassis blades and the PIU modules during a system restart or reconfiguration.
- Referring now to
FIG. 10 , an embodiment of amethod 1000 for connecting - Ethernet fabrics for optical transport networking switching is illustrated. In
step 1002, in an Ethernet fabric including a number M of Ethernet switches, each of the M Ethernet switches having a number N of Ethernet switch ports, each of the N Ethernet switch ports having a number P of Ethernet switch ports, a variable i having a value ranging from 1 to M to denote the ith Ethernet switch corresponding to one of the M Ethernet switches, where M is greater than one, may be assigned. Instep 1004, a variable j having a value ranging from 1 to N to denote the jth Ethernet switch port corresponding to one of the N Ethernet switch ports, and where N is greater than one, may be assigned. Instep 1006, a variable k having a value ranging from 1 to P to denote the kth Ethernet switch sub-port corresponding to one of the P Ethernet switch sub-ports, and where P is greater than one, may be assigned. Instep 1008, the Ethernet fabric may be connected exclusively to multiple PIU modules, each having M PIU ports including a first PIU module, where an ith PIU port of the first PIU module is connected to the ith Ethernet switch. Instep 1010, optical data units may be switched through the Ethernet fabric using the PIU modules and a virtual switch fabric associated with the PIU modules. - As disclosed herein, methods and systems for a disaggregated OTN switching system include using PIU modules for OTN to Ethernet transceiving and an Ethernet fabric as a switching core. A customized OTN over Ethernet module in the PIU modules enables various OTN functionality to be realized using the Ethernet fabric.
- The above disclosed subject matter is to be considered illustrative, and not restrictive, and the appended claims are intended to cover all such modifications, enhancements, and other embodiments which fall within the true spirit and scope of the present disclosure. Thus, to the maximum extent allowed by law, the scope of the present disclosure is to be determined by the broadest permissible interpretation of the following claims and their equivalents, and shall not be restricted or limited by the foregoing detailed description.
Claims (18)
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15/419,569 US10219050B2 (en) | 2016-04-21 | 2017-01-30 | Virtual line cards in a disaggregated optical transport network switching system |
| EP17167550.7A EP3236601A1 (en) | 2016-04-21 | 2017-04-21 | Disaggregated optical transport network switching system |
| JP2017084292A JP2018014706A (en) | 2016-04-21 | 2017-04-21 | Separated optical transmission network switching system |
| EP17167552.3A EP3236602B1 (en) | 2016-04-21 | 2017-04-21 | Disaggregated optical transport network switching system |
| JP2017084290A JP2018011289A (en) | 2016-04-21 | 2017-04-21 | Disaggregated optical transport network switching system |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201662325723P | 2016-04-21 | 2016-04-21 | |
| US15/419,569 US10219050B2 (en) | 2016-04-21 | 2017-01-30 | Virtual line cards in a disaggregated optical transport network switching system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20170310413A1 true US20170310413A1 (en) | 2017-10-26 |
| US10219050B2 US10219050B2 (en) | 2019-02-26 |
Family
ID=60089162
Family Applications (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/419,751 Active US10462543B2 (en) | 2016-04-21 | 2017-01-30 | ODU path protection in a disaggregated OTN switching system |
| US15/419,482 Active US9942633B2 (en) | 2016-04-21 | 2017-01-30 | Disaggregated optical transport network switching system |
| US15/419,649 Active 2037-02-10 US10178453B2 (en) | 2016-04-21 | 2017-01-30 | Ethernet fabric protection in a disaggregated OTN switching system |
| US15/419,569 Active 2037-02-11 US10219050B2 (en) | 2016-04-21 | 2017-01-30 | Virtual line cards in a disaggregated optical transport network switching system |
Family Applications Before (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/419,751 Active US10462543B2 (en) | 2016-04-21 | 2017-01-30 | ODU path protection in a disaggregated OTN switching system |
| US15/419,482 Active US9942633B2 (en) | 2016-04-21 | 2017-01-30 | Disaggregated optical transport network switching system |
| US15/419,649 Active 2037-02-10 US10178453B2 (en) | 2016-04-21 | 2017-01-30 | Ethernet fabric protection in a disaggregated OTN switching system |
Country Status (2)
| Country | Link |
|---|---|
| US (4) | US10462543B2 (en) |
| JP (2) | JP2018011289A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3484074A1 (en) * | 2017-11-10 | 2019-05-15 | Juniper Networks, Inc. | Data center packet optical transport failure protection |
| US10368150B1 (en) * | 2018-09-07 | 2019-07-30 | Fujitsu Limited | Carrying high capacity bit transparent leased line services over internet protocol/multiprotocol label switching networks |
| US20200067784A1 (en) * | 2018-08-23 | 2020-02-27 | Fujitsu Limited | Systems and methods for virtual shelf management of disaggregated network elements |
| US10965496B2 (en) * | 2018-11-26 | 2021-03-30 | Arrcus Inc. | Logical router comprising disaggregated network elements |
| US11329910B2 (en) | 2017-10-16 | 2022-05-10 | Fujitsu Limited | Transmission apparatus including a plurality of switches and output circuits for transmitting data and transmission method |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10469168B2 (en) * | 2017-11-01 | 2019-11-05 | Fujitsu Limited | Disaggregated integrated synchronous optical network and optical transport network switching system |
| US10454610B2 (en) | 2017-11-13 | 2019-10-22 | Fujitsu Limited | 1+1 Ethernet fabric protection in a disaggregated optical transport network switching system |
| CN109802742B (en) * | 2017-11-16 | 2020-05-19 | 华为技术有限公司 | Method, equipment and system for transmitting data |
| EP3767760B1 (en) * | 2018-03-13 | 2024-08-21 | NEC Corporation | Optical relay, optical relay production method, and optical signal relay method |
| US10924324B2 (en) * | 2018-04-23 | 2021-02-16 | Ciena Corporation | Scalable management plane for a modular network element |
| US10461873B1 (en) * | 2018-09-17 | 2019-10-29 | Fujitsu Limited | Disaggregated hybrid optical transport network, internet protocol, and Ethernet switching system |
| US11231764B2 (en) * | 2018-10-17 | 2022-01-25 | Samsung Electronics Co., Ltd. | System and method for supporting chassis level keep alive in NVME-of based system |
| US10764189B1 (en) * | 2019-04-03 | 2020-09-01 | Ciena Corporation | OTN transport over a leaf/spine packet network |
| US11190628B2 (en) * | 2019-04-03 | 2021-11-30 | National Chiao Tung University | High-speed data-plane packet aggregation and disaggregation method |
| US10680737B1 (en) * | 2019-04-09 | 2020-06-09 | Ciena Corporation | Bundling capacity changes in channel holder based optical links |
| US11275705B2 (en) * | 2020-01-28 | 2022-03-15 | Dell Products L.P. | Rack switch coupling system |
| CN113709602B (en) * | 2020-05-20 | 2022-09-09 | 华为技术有限公司 | A chip synchronization method and related equipment |
| CN113825042B (en) * | 2020-06-18 | 2024-09-03 | 深圳市中兴微电子技术有限公司 | Data access method, device, chip and computer storage medium |
| CN112511382B (en) * | 2020-11-24 | 2022-03-29 | 中盈优创资讯科技有限公司 | Method and device for creating flexible Ethernet Flexe channel |
| TWI763470B (en) * | 2021-05-04 | 2022-05-01 | 瑞昱半導體股份有限公司 | Operation method of network device and control chip of network device |
| US12519718B2 (en) | 2021-06-25 | 2026-01-06 | Oracle International Corporation | Routing policies for graphical processing units |
| US11722271B2 (en) * | 2021-07-29 | 2023-08-08 | Fujitsu Limited | Channelized transmission over openZR-extended optical network |
| US11706083B1 (en) * | 2022-02-10 | 2023-07-18 | Opnet Technologies Co., Ltd. | Telco-grad server/ethernet network switch |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110280567A1 (en) * | 2010-05-13 | 2011-11-17 | Fujitsu Network Communications, Inc. | Identifying fault locations in a network |
Family Cites Families (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7580637B2 (en) | 2006-10-13 | 2009-08-25 | Menara Networks, Inc. | Systems and methods for the integration of framing, OAM and P, and forward error correction in pluggable optical transceiver devices |
| US9312951B2 (en) | 2006-10-13 | 2016-04-12 | Menara Networks, Inc. | Virtualized optical transport network systems and methods |
| EP1538765B1 (en) | 2003-12-05 | 2007-08-22 | Alcatel Lucent | Dynamic interlayer protection in optical telecommunication networks |
| CN101051995B (en) | 2006-06-05 | 2012-07-04 | 华为技术有限公司 | Protection switching method based on no connection network |
| US8107821B2 (en) | 2006-10-13 | 2012-01-31 | Menara Networks, Inc. | Systems and methods for Ethernet extension and demarcation |
| US8155520B1 (en) | 2008-04-16 | 2012-04-10 | Cyan, Inc. | Multi-fabric shelf for a transport network |
| US8363670B2 (en) | 2010-04-20 | 2013-01-29 | Vitesse Semiconductor Corporation | Framed flows over packet-switched fabrics |
| US8477619B2 (en) | 2010-09-10 | 2013-07-02 | Fujitsu Limited | Method and system for distributed virtual traffic management |
| EP2719102A1 (en) | 2011-06-09 | 2014-04-16 | Telefonaktiebolaget LM Ericsson (PUBL) | Apparatus and method for optical transport networks |
| JP2013138273A (en) | 2011-12-27 | 2013-07-11 | Fujitsu Ltd | Transmission device |
| US8837936B2 (en) | 2012-06-25 | 2014-09-16 | Fujitsu Limited | Method and system for dynamic selection of transport path with lowest latency |
| US20150222705A1 (en) | 2012-09-06 | 2015-08-06 | Pi-Coral, Inc. | Large-scale data storage and delivery system |
| US9729425B2 (en) | 2012-11-29 | 2017-08-08 | Futurewei Technologies, Inc. | Transformation and unified control of hybrid networks composed of OpenFlow switches and other programmable switches |
| WO2014086007A1 (en) | 2012-12-05 | 2014-06-12 | 华为技术有限公司 | Data processing method, communication single board and device |
| EP2958279B1 (en) | 2013-03-15 | 2017-05-10 | Huawei Technologies Co., Ltd. | Service transfer device and method for optical channel data unit |
| US9240905B2 (en) | 2013-07-22 | 2016-01-19 | Ciena Corporation | Protecting hybrid equipment in a network node |
| WO2015020665A1 (en) | 2013-08-09 | 2015-02-12 | Hewlett-Packard Development Company, L.P. | Switch assembly |
| WO2015135060A1 (en) | 2014-03-10 | 2015-09-17 | Aeponyx Inc. | Optical device with tunable optical wavelength selective circuit |
| US20160226578A1 (en) | 2015-02-04 | 2016-08-04 | Catherine H. Yuan | Management of frame alignment events in optical transport networks |
| US9992102B2 (en) | 2015-08-28 | 2018-06-05 | Ciena Corporation | Methods and systems to select active and standby ports in link aggregation groups |
| US9980021B2 (en) | 2015-10-07 | 2018-05-22 | Ciena Corporation | Scalable switch fabric using optical interconnects |
| US10171358B2 (en) | 2016-02-04 | 2019-01-01 | Ciena Corporation | Port congestion resiliency in a multi-card and multi-switch link aggregation group |
| EP3236601A1 (en) | 2016-04-21 | 2017-10-25 | Fujitsu Limited | Disaggregated optical transport network switching system |
-
2017
- 2017-01-30 US US15/419,751 patent/US10462543B2/en active Active
- 2017-01-30 US US15/419,482 patent/US9942633B2/en active Active
- 2017-01-30 US US15/419,649 patent/US10178453B2/en active Active
- 2017-01-30 US US15/419,569 patent/US10219050B2/en active Active
- 2017-04-21 JP JP2017084290A patent/JP2018011289A/en active Pending
- 2017-04-21 JP JP2017084292A patent/JP2018014706A/en active Pending
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110280567A1 (en) * | 2010-05-13 | 2011-11-17 | Fujitsu Network Communications, Inc. | Identifying fault locations in a network |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11329910B2 (en) | 2017-10-16 | 2022-05-10 | Fujitsu Limited | Transmission apparatus including a plurality of switches and output circuits for transmitting data and transmission method |
| EP3484074A1 (en) * | 2017-11-10 | 2019-05-15 | Juniper Networks, Inc. | Data center packet optical transport failure protection |
| US10469921B2 (en) | 2017-11-10 | 2019-11-05 | Juniper Networks, Inc. | Data center packet optical transport failure protection |
| US20200067784A1 (en) * | 2018-08-23 | 2020-02-27 | Fujitsu Limited | Systems and methods for virtual shelf management of disaggregated network elements |
| US10708141B2 (en) * | 2018-08-23 | 2020-07-07 | Fujitsu Limited | Systems and methods for virtual shelf management of disaggregated network elements |
| US10368150B1 (en) * | 2018-09-07 | 2019-07-30 | Fujitsu Limited | Carrying high capacity bit transparent leased line services over internet protocol/multiprotocol label switching networks |
| US10992497B2 (en) * | 2018-11-26 | 2021-04-27 | Arrcus Inc. | Logical router comprising disaggregated network elements |
| CN113169928A (en) * | 2018-11-26 | 2021-07-23 | 阿尔库斯有限公司 | Logical router including a disaggregated network element |
| US11082261B2 (en) * | 2018-11-26 | 2021-08-03 | Arrcus Inc. | Logical router comprising disaggregated network elements |
| KR20210095888A (en) * | 2018-11-26 | 2021-08-03 | 아르쿠스 인크. | Logic routers with segmented network elements |
| US10965496B2 (en) * | 2018-11-26 | 2021-03-30 | Arrcus Inc. | Logical router comprising disaggregated network elements |
| US11343121B2 (en) * | 2018-11-26 | 2022-05-24 | Arrcus Inc. | Logical router comprising disaggregated network elements |
| US11863351B2 (en) * | 2018-11-26 | 2024-01-02 | Arrcus Inc. | Logical router comprising disaggregated network elements |
| TWI857990B (en) * | 2018-11-26 | 2024-10-11 | 美商阿爾克斯股份有限公司 | Logical routing system comprising disaggregated network elements and method thereof |
| KR102812234B1 (en) * | 2018-11-26 | 2025-05-26 | 아르쿠스 인크. | Logical router containing segmented network elements |
Also Published As
| Publication number | Publication date |
|---|---|
| US20170310538A1 (en) | 2017-10-26 |
| JP2018014706A (en) | 2018-01-25 |
| US10219050B2 (en) | 2019-02-26 |
| JP2018011289A (en) | 2018-01-18 |
| US20170311060A1 (en) | 2017-10-26 |
| US10462543B2 (en) | 2019-10-29 |
| US9942633B2 (en) | 2018-04-10 |
| US20170310387A1 (en) | 2017-10-26 |
| US10178453B2 (en) | 2019-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10219050B2 (en) | Virtual line cards in a disaggregated optical transport network switching system | |
| Xie et al. | Scaling optical interconnects for hyperscale data center networks | |
| US10727973B1 (en) | Apparatus and method for self-learning and predictive DWDM network | |
| US10469168B2 (en) | Disaggregated integrated synchronous optical network and optical transport network switching system | |
| EP3664325B1 (en) | Methods and apparatus for a flattened data center network employing wavelength-agnostic endpoints | |
| US10454610B2 (en) | 1+1 Ethernet fabric protection in a disaggregated optical transport network switching system | |
| US10020907B2 (en) | Transport functions virtualization for wavelength division multiplexing (WDM)-based optical networks | |
| US8644172B2 (en) | Pluggable module with integrated data analysis function | |
| US9793984B2 (en) | Coherent receiver based virtual optical spectrum analyzer | |
| Layec et al. | Rate‐adaptable optical transmission and elastic optical networks | |
| US9699074B2 (en) | Efficient utilization of transceivers for shared restoration in flexible grid optical networks | |
| US10097376B2 (en) | Resilient virtual optical switches over less reliable optical networks | |
| US9712899B2 (en) | Hybrid optical switch for software-defined networking | |
| US10511582B2 (en) | Simplified encryption key generation in optical networks | |
| US10404374B1 (en) | Optical networking with support for unidirectional optical links | |
| JP2017516375A (en) | Architecture of optical label replacement by software definition based on OPEN-FLOW | |
| EP3236602B1 (en) | Disaggregated optical transport network switching system | |
| US10256935B1 (en) | Adaptive flexible grid in an optical network | |
| Deart et al. | Analysis of the functioning of a multi-domain transport software-defined network with controlled optical layer | |
| US10349154B2 (en) | Intra data center optical switching | |
| Haiyi et al. | Considerations on transport networks technologies evolution |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: FUJITSU NETWORK COMMUNICATIONS, INC., TEXAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CAI, BIAODONG;DUNSMORE, RICHARD;NAPHAN, ROD;AND OTHERS;SIGNING DATES FROM 20161209 TO 20170118;REEL/FRAME:041125/0050 |
|
| AS | Assignment |
Owner name: FUJITSU LIMITED, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FUJITSU NETWORK COMMUNICATIONS, INC.;REEL/FRAME:042782/0133 Effective date: 20170501 |
|
| AS | Assignment |
Owner name: FUJITSU NETWORK COMMUNICATIONS, INC., TEXAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MAYBERRY, BRENT;REEL/FRAME:045902/0567 Effective date: 20170228 |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |