Verizon, Ciena and Juniper trial 400 Gigabit Ethernet
Verizon has sent a 400 Gigabit Ethernet signal over its network, carried using a 400-gigabit optical wavelength.
The trial’s goal was to demonstrate multi-vendor interoperability and in particular the interoperability of standardised 400 Gigabit Ethernet (GbE) client signals.
Glenn Wellbrock“[400GbE] Interoperability with the client side has been the long pole in the tent - and continues to be,” says Glenn Wellbrock, director, optical transport network - architecture, design and planning at Verizon. “This was trial equipment, not generally-available equipment.”
It is only the emergence of standardised modules - in this case, an IEEE 400GbE client-side interface specification - that allows multi-vendor interoperability, he says.
By trialing a 400-gigabit lightpath, Verizon also demonstrated the working of a dense wavelength-division multiplexing (DWDM) flexible grid, and a baud rate nearly double the 32-35Gbaud in wide use for 100-gigabit and 200-gigabit wavelengths.
“It shows we can take advantage of the entire system; we don’t have to stick to 50GHz channel spacing anymore,” says Wellbrock.
[400GbE] Interoperability with the client side has been the long pole in the tent - and continues to be
Trial set-up
The trial used Juniper Networks’ PTX5000 packet transport router and Ciena’s 6500 packet-optical platform, equipment already deployed in Verizon’s network.
The Verizon demonstration was not testing optical transmission reach. Indeed the equipment was located in two buildings in Richardson, within the Dallas area. Testing the reach of 400-gigabit wavelengths will come in future trials, says Wellbrock.
The PTX5000 core router has a traffic capacity of up to 24 terabits and supports 10-gigabit, 40-gigabit and 100-gigabit client-side interfaces as well as 100-gigabit coherent interfaces for IP-over-DWDM applications. The PTX5000 uses a mother card on which sits one or more daughter cards hosting the interfaces, what Juniper calls a flexible PIC concentrator (FPC) and physical interface cards (PICs), respectively.
Juniper created a PIC with a 400GbE CFP8 pluggable module implementing the IEEE’s 10km 400GBASE-LR8 standard.
“For us, it was simply creating a demo 400-gigabit pluggable line card to go into the line card Verizon has already deployed,” says Donyel Jones-Williams, director of product marketing management at Juniper Networks.
Donyel Jones-WilliamsThe CFP8 400GbE interface connected the router to Ciena’s 6500 packet-optical platform.
Ciena also used demonstration hardware developed for 400-gigabit trials. “We expect to develop other hardware for general deployment,” says Helen Xenos, senior director, portfolio marketing at Ciena. “We are looking at smaller form-factor pluggables to carry 400 Gigabit Ethernet.”
400-gigabit deployments and trials
Ciena started shipping its WaveLogic Ai coherent modem that implements 400-gigabit wavelengths in the third quarter of 2017. Since then, the company has announced several 400-gigabit deployments and trials.
Vodafone New Zealand deployed 400 gigabits in its national transport network last September, a world first, claims Ciena. German cable operator, Unitymedia, has also deployed Ciena’s WaveLogic Ai coherent modem to deliver a flexible grid and 400-gigabit wavelengths to support growing content delivered via its data centres. And JISC, which runs the UK’s national research and education network, has deployed the 6500 platform and is using 400-gigabit wavelengths.
Helen Xenos
Last September, AT&T conducted its own 400-gigabit trial with Ciena. With AT&T’s trial, the 400-gigabit signal was generated using a test bed. “An SDN controller was used to provision the circuit and the [400-gigabit] signal traversed an OpenROADM line system,” says Xenos.
Using the WaveLogic Ai coherent modem and its support for a 56Gbaud rate means that tunable capacity can now be doubled across applications, says Xenos. The wavelength capacity used for long-haul distances can now be 200 gigabits instead of 100 gigabits, while metro-regional networks spanning 1,000km can use 300-gigabit wavelengths. Meanwhile, 400-gigabit lightpaths suit distances of several hundred kilometres.
It is the large data centre operators that are driving the majority of 400 gigabit deployments, says Ciena. The reason the 400-gigabit announcements relate to telecom operators is because the data centre players have not gone public with their deployments, says Xenos.
Juniper Networks’ PTX5000 core router with 400GbE interfaces will primarily be used by the telecom operators. “We are in trials with other providers on 400 gigabits,” says Jones-Williams. “Nothing is public as yet.”
Juniper Networks opens up the optical line system
Juniper Networks has responded to the demands of the large-scale data centre players with an open optical line system architecture.
Donyel Jones-WilliamsThe system vendor has created software external to its switch, IP router and optical transport platforms that centrally controls the optical layer.
Juniper has also announced a reconfigurable optical add-drop multiplexer (ROADM) - the TCX1000 - that is Lumentum’s own white box ROADM design. Juniper will offer the Lumentum white box as its own, part of its optical product portfolio.
The open line system architecture, including the TCX1000, is also being pitched to communications service providers that want an optical line system and prefer to deal with a single vendor.
“Juniper plans to address the optical layer with a combination of software and open hardware in the common optical layer,” says Andrew Schmitt, founder and lead analyst at Cignal AI. “This is the solution it will bring to customers rather than partnering with an optical vendor, which Juniper has tried several times without great success.”
Open line systems
An optical line system comprises terminal and transmission equipment and network management software. The terminal equipment refers to coherent optics hosted on platforms, while line elements such as filters, optical amplifiers and ROADMs make up the transmission equipment. Traditionally, a single vendor has provided all these elements with the network management software embedded within the vendor’s platforms.
An open optical line system refers to line equipment and the network management system from a vendor such as Nokia, Infinera or Ciena that allows the attachment of independent terminal equipment. An example would be the Telecom Infra Project’s Voyager box linked to a Nokia line system, says Schmitt.
The open line system can also be implemented as a disaggregated design. Here, says Schmitt, the control software would be acquired from a vendor such as Juniper, Fujitsu, or Ciena with the customer buying open ROADMs, amplifiers and filters from various vendors before connecting them. Open software interfaces are used to communicate with these components. And true to an open line system, any terminal equipment can be connected.
The advantage of an open disaggregated optical line system is that elements can be bought from various sources to avoid vendor lock-in. It also allows the best components to be acquired and upgraded as needed.
Meanwhile, disaggregating the management and control software from the optical line system and equipment appeals to the way the internet content providers architect and manage their large-scale data centres. This is what Juniper’s proNX Optical Director platform enables, the second part of its open line system announcement.
Juniper believes its design is an industry first in how it separates the control plane from the optical hardware.
“We have taken the concept of disaggregation and software-defined networking to separate the control plane out of the hardware,” says Donyel Jones-Williams, director of product marketing management at Juniper Networks. “Our control plane is no longer tied to physical hardware.”
Having an open line system supplied by one vendor gets you 90% of the way there
Disaggregated control benefits the optimisation of the open line system, and enables flexible updates without disrupting the service.
Cignal AI’s Schmitt says that the cloud and co-location players are already using open line systems just not disaggregated ones.
“Having an open line system supplied by one vendor gets you 90% of the way there,” says Schmitt. For him, a key question is what problem is being solved by taking this one step further and disaggregating the hardware.
Schmitt’s view is that an operator introduces a lot of complexity into the network for the marginal benefit of picking hardware suppliers independently. “And realistically they are still single-sourcing the software from a vendor like Juniper or Ciena,” says Schmitt.
Juniper now can offer an open line system, and if a customer wants a disaggregated one, it can build it. “I don’t think users will choose to do that,” says Schmitt. “But Juniper is in a great position to sell the right open line system technology to its customer base and this announcement is interesting and important because Juniper is clearly stating this is the path it plans to take.”
TCX1000 and proNX
Juniper’s open optical line system announcement is the latest development in its optical strategy since it acquired optical transport firm, BTI Systems, in 2016.
BTI’s acquisition provided Juniper with a line system for 100-gigabit transport. “The filters and ROADMs didn’t allow the system to scale to 200-gigabit and 400-gigabit line rates and to support super-channels and flexgrid,” says Jones-Williams.
With the TCX1000, Juniper now has a one-rack-unit 20-degree ROADM that is colourless, directionless and which supports flexgrid to enable 400-gigabit, 600-gigabit and even higher capacity optical channels in future. The TCX1000 supports up to 25.6 terabits-per-second per line.
A customer can also buy the white box ROADM from Lumentum directly, says Juniper. “It gives our customers freedom as to how they want to source their product,” says Jones-Williams.
Competition between vendors is now in the software domain. We no longer believe that there is differentiation in the optical line system hardware
Juniper’s management and control software, the ProNX Optical Director, has been architected using microservices. Microservices offers a way to architect applications using virtualisation technology. Each application is run in isolation based on the service they provide. This allows a service to run and scale independently while application programming interfaces (APIs) enable communication with other services.
Container technology is used to implement microservices. Containers use fewer hardware resources than virtual machines, an alternative approach to server virtualisation.
Source: Juniper Networks.
“It is built for data centre operators,” says Don Frey, principal analyst, routers and transport at the market research firm, Ovum. “Microservices makes the product more modular.”
Juniper believes the competition between vendors is now in the software domain. “We no longer believe that there is differentiation in the optical line system hardware,” says Jones-Williams.
Data centre operators are not concerned about line system interoperability, they are just trying to remove the blade lock-in so they can get the latest technology.
Market demands
Most links between data centres are point-to-point networks yet despite that, the internet content providers are interested in ROADMs, says Juniper. What they want is to simplify network design using the ROADM’s colourless and flexible grid attributes. A directionless ROADM is only needed for complex hub sites that require flexibility in moving wavelengths through a mesh network.
The strategy of the large-scale data centre operators is to split the optical system between an open line system and purpose-built blades. The split allows them to upgrade to the best blades or pluggable optics while leaving the core untouched. “The concept is similar to the open submarine cables as the speed of innovation in core systems is not the same as the line optics,” says Frey. “Data centre operators are not concerned about line system interoperability, they are just trying to remove the blade lock-in so they can get the latest technology.”
Juniper says there is also interest from communications service providers in the ROADM as part of their embrace of open initiatives such as the Open ROADM MSA. Frey says AT&T will make its first deployment of the Open ROADM before the year-end or in early 2018.
“There are a lot of synergies in terms of what we have announced and things like Open ROADM,” says Jones-Williams. “But we know that there are customers out there that just want a line system and they do not care if it is open or not.”
Juniper is already working with customers with its open line system as part of the development of its proNX software.
The branded ROADM and the proNX Optical Director will be generally available in early 2018.