Provisioning CERNET with Dark Fiber Xing Li , Congxiao Bao CERNET Center <2003-04-08>

CERNET Optical Network Operation Experience Perspective Outline Background CERNET Optical Network Operation Experience Perspective

CERNET China Education and Research Network is one of the 10 national IP backbones in Mainland China CERNET is the 2nd largest IP backbone The equipment founding came from MoE and State Planning Commission The Operation is self funded

CERNET Link History 1995 64K leased lines link to 8 regional network centers 1996 512K leased lines link to 8 regional network centers 9.6K X.25 or 64K leased line to 28 provincial centers 1997 3.7M point-to-point satellite link to 8 regional network centers 64K point-to-point satellite link to 12 remote provincial centers 1999 155M SDH link to 8 regional network centers

CERNET Layer 3 Topology 北京 长春 哈尔滨 乌鲁木齐 拉萨 西宁 兰州 银川 呼和浩特 台北 沈阳 南昌 西安 武汉 徐闻 长春 哈尔滨 乌鲁木齐 拉萨 西宁 兰州 银川 呼和浩特 台北 沈阳 南昌 西安 徐州 武汉 合肥 郑州 石家庄 北京 南宁 广州 福州 杭州 上海 南京 天津 贵阳 海口 三亚 湛江 无锡 大连 太原 济南 烟台 成都 长沙 重庆 黄梅 九江 昆明 青岛 汕头 唐山 汉中 宜昌 珠海 深圳 惠州 柳州 百色 厦门 主干网 地区网 GigaPop Pop 桂林

CERNET Statistics 36 PoPs covers all the provincial capitals More than 1,000 universities located in 200+ cities Currently about 10M users There are 320M Students in China

CERNET Dark Fiber Topology 大连 北京 郑州 石家庄 武汉 合肥 南京 上海 长沙 南昌 杭州 广州 福州 成都 昆明 重庆 厦门 海口 桂林 沈阳 哈尔滨 天津 济南 南宁 深圳 太原 青岛 GZ SH NJ WH BJ SY XA CD

Current Architecture Router Cisco Router Cisco SDH 16x155M Lucent 2.5G 2.5G DWDM 16x2.5G Lucent Dark Fiber

CERNET Transport Network 20,000 km 200+ relay stations DWDM 16x2.5G SDH 155M

Three Types DWDM sites OA: Optical Amplifier Terminal Dual-Face

CERNET DWDM System 16x2.5G DWDM system (two lambda’s are currently running) OC48 POS links to 8 cities OC3 POS SDH links to all provincial capitals (except Lhasa) unicast and multicast

DWDM System Transmit Receive 3R 1 2 3 4 5 6 7 1 2 3 4 5 6 7 20 ppm 1550 1 2 3 4 5 6 7 1551 1 2 3 4 5 6 7 1552 1553 20 ppm 1554 50 ppm 1555 PLL 1556 1557 Receive 3R Transmit 50 ppm PLL 1 2 3 4 5 6 7 1550 1 2 3 4 5 6 7 LOOP TIMING 1551 1552 1553 1554 1555 1556 1557

Hut Spacing: 40 km vs 65 km vs 100 km vs … x km Span Optical Amplifier Regenerator Hut Spacing: 40 km vs 65 km vs 100 km vs … x km

Power Budget

Configuration of Terminal Site OTU1 OTU2 OTUn OMU ODU OA

Configuration of Dual-Face Site OTU1 OTU2 OTUn OMU ODU OA

Typical Site Configuration Example To Beijing To Hefei (Ring1) OLS80G 6x155M(e) +4x155M(e) To Guangzhou 5x155M(e) ADM16/1 (Ring2) (Ring3) 2.5G To Beijing 2.5G To Nanjing 2.5G To Guangzhou Timing TSG3800 PRR-10 GSP 48VPower To University 9x155M(o) +5x155M(o) +4x155M(o) 2x155Me) 3x155M(e) 4x155M(e) 3c 9c 1c 2c 4c 2.5G To Chengdu To Chengdu

Stations

Some Reality Because POS interface is wavelength insensitive, OTU need not to be used after ODU. Because DWDM system is point-to-point connection and has no self-healing capability, layer 3 routing restoration must be depended in case of fiber break. Optical character test of optical interface must be done periodically because of aging both in equipment and fiber.

CERNET Backbone Bandwidth 0.001 0.1 10 1000 100000 10000000 Dec-94 Dec-96 Dec-98 Dec-00 Dec-02 CERNET US

Backbone Traffic

CERNET DWDM for IPv6-CJ Testbed Core Router border Edge Router 2.5G POS WAN Guangzhou Shanghai Beijing GE LAN MAN To Japan User Network (IPv6) MAN/LAN

Next Step ELH for 3,500 km DWDM system CWDM for the MAN Remove SDH Layer Use OADM Unified Management System Optical IP OXC Traffic Engineering CWDM for the MAN City PoPs

CapEx and OpEx is Reduced by ELH-DWDM 650 km Terminal Site EDFA O-E-O Regenerator Terminal Site Replacing O-E-O by OA 2,000 km EDFA/RAMAN

Unified Control Plane (UCP) Common Set of Control Functions Addressing, Routing, and Signaling Protocols Control Network Metro DWDM Core DWDM Metro SONET IP IP Generalized across Disparate Transport Technologies UCP Beneficiaries and Functions End User On Demand, Optical Channel Provisioning Transport Provider Low Cost Per Bit Data Aware Optimization Application Provider New, Differentiated Services—At a Profit

Fiber ring OIX with OBGP Figure 11.0

Spectrum of CWDM 850nm：778nm、801nm、825nm、850nm O—Band:1275.5nm、1300.2nm、1324.7nm、1349.2nm （1290、1310、1330、1350） E—Band:1380 nm、1400nm 、1420nm 、1440nm S+C+L Band:1470nm、1490nm、 1510nm 、1530nm、1550nm、1570nm、1590nm、1610nm

CNGI Testbed Test and Measurement Network Services Demo Applications Commercial Services Network Equipment