Human Brain Vs. e-Brain Brain e-Brain Time Brain ~1950 ~1980 ~2010 11/13/2018 Human Brain Vs. e-Brain Brain e-Brain e-Brain Brain Time ~1950 ~1980 ~2010 11/13/2018 南开大学科学计算研究所 NK ISC 101

Human Brain Vs. e-Brain Pentium IV Human Brain Total # of Neurons 11/13/2018 Human Brain Vs. e-Brain Human Brain Pentium IV Total # of Neurons 20 – 50 billion 42 million Transistors Number of synapses 1014 (2,000-5,000/neuron) O(10)/transistor Weight ~1.5 kg 0.3 kg Power consumption ~40W (4 nW/neuron) ~55 W (1 mW/transist) Sleep requirement 30% 0% Normal operating temperature 37±2°C 15-85°C Maximum firing Hz of neuron 250-2,000 Hz (0.5-4 ms intervals) 1.5 GHz Signal propag speed inside axon 90 m/s sheathed, <0.1 m/s unsheathed Speed of light Processing of complex stimuli 0.5s or 100-1,000  firings Long time 11/13/2018 南开大学科学计算研究所 NK ISC 101

Massively Parallel Processing 11/13/2018 南开大学科学计算研究所 NK ISC 101

Beowulf 11/13/2018 南开大学科学计算研究所 NK ISC 101

GRID Computing 11/13/2018 南开大学科学计算研究所 NK ISC 101

Values of Parallel Processing 11/13/2018 南开大学科学计算研究所 NK ISC 101

Grand Challenges Prediction of Weather, Climate, and Global Change Materials Science Semiconductor Design Superconductivity Structural Biology Drug Design Human Genome QCD Astronomy Vehicle Signature---Military Transportation Turbulence Vehicle Dynamics Nuclear Fusion Combustion System Oil and Gas Recovery Ocean Science Speech Vision Undersea Surveillance 11/13/2018 南开大学科学计算研究所 NK ISC 101

Best Applications of PP Aircraft design, air breathing propulsion, advanced sensors, Fluid dynamics, turbulence, differential equations, numerical analysis, global optimization, numerical linear algebra, Simulation of genetic compounds, neural network, structural biology, conformation, drug design, protein folding, human genome, Polymer simulation, reaction rate prediction, Simulation of devices and circuits, VLSI, artificial intelligence, Oil and seismic exploration, enhanced oil and gas recovery, Material property prediction, modeling of new materials, superconductivity, Structural analysis, combustion simulation. Weather forecasting, climate modeling; Global ocean modeling Physics: Astrophysics, evolution of galaxies and natures of black holes; particle physics, quark interactions, properties of new particles; plasma physics, fusion reaction modeling; nuclear physics, weapon design and modeling, remedy of nuclear contaminations. 11/13/2018 南开大学科学计算研究所 NK ISC 101

Timing Examples Machines Grand Challenge Problems Moderate Examples O(100) Tflops O(1) Hrs Protein folding, QCD, Turbulence O(10) Tflops O(1) Sec O(1) Day Weather; QMD for O(100) atoms, Craft Design O(1) Tflops (NK-Stars) O(1) Minute O(1) Wks 2D CFD, CMD for 106 particles; QMD for O(10) atoms; High-End Workstation O(10) Yrs 2 GHz Pentium O(1) Days O(100) Yrs 11/13/2018 南开大学科学计算研究所 NK ISC 101

Resources Demand Spatial resolution stress memory More mesh points and more precisions Temporal resolution stresses processor speeds & processor-memory bw Both Stress inter-processor latency and bandwidth 11/13/2018 南开大学科学计算研究所 NK ISC 101

Architecture Issues 11/13/2018 南开大学科学计算研究所 NK ISC 101

Top 5 Rank Maker, Model Rmax RPeak #Procs In At 1 2,3 4 5 NEC, Earth-Simulator 35,860 40,960 5120 ‘02 Earth Simulator Center, Japan 2,3 HP, ASCI Q-AlphaServer 7,727 10,240 4096 ’02 LANL, USA 4 IBM ASCI White, SP Power3 7,226 12,288 8192 ’00 LLNL, USA 5 Linux NetworX, MCR Linux Cluster 5,694 11,060 2304 Source: top500.org 11/13/2018 南开大学科学计算研究所 NK ISC 101

Top 500 11/13/2018 南开大学科学计算研究所 NK ISC 101

Blue Gene/L 11/13/2018 11/13/2018 南开大学科学计算研究所 NK ISC 101

Projection Blue Gene/L Protein Simulator ASCI Purple 11/13/2018 南开大学科学计算研究所 NK ISC 101

南 开 之 星 … . . . Internet 11/13/2018 南开大学科学计算研究所 NK ISC 101 Firewall RAID System 2 RAID System 1 Firewall 磁盘阵列 2 防火墙 千兆以太网 交换机 磁盘阵列 1 Switch 计算机柜 1 计算机柜 15 … 以太网交换机 Internet 存储服务器 1 存储服务器 2 登陆服务器 1 登陆服务器 2 Myrinet交换机 服务机柜 . . . 计算节点 南 开 之 星 11/13/2018 南开大学科学计算研究所 NK ISC 101

Service Cabinet Myrinet switch User access nodes Gbit Ethernet switch Storage servers RAID units UPS 11/13/2018 南开大学科学计算研究所 NK ISC 101

Computational Cabinet Ethernet Concentrator switch 24 Fast Ethernet ports 2 Gigabit Ethernet Ports 20 Computational nodes Dual Pentium 4 Xeon 2.6 GHz 1GB of PC2700 DDR RAM 40 GB IDE drive Fast Ethernet port Myrinet card (64bit/66MHz slot) 11/13/2018 南开大学科学计算研究所 NK ISC 101

南开之星升级目标 Complete Time Pentium Xeon 运算能力 (万亿) RAM (GB) Storage (TB) 1 2003年5月 2x32 0.17 32 10 2 2003年10月 2x64 0.35 64 20 3 2004年3月 2x128 0.70 128 40 4 2004年8月 2x300 2.00 150 100 11/13/2018 南开大学科学计算研究所 NK ISC 101

Hardware Components Processors: Computational network: Pentium 4 Xeon 2.6 GHz Computational network: Myrinet Back-end network: Gigabit/Fast Ethernet Storage: IDE RAID 11/13/2018 南开大学科学计算研究所 NK ISC 101

Software Components Operating System: Distribution: Linux Kernel 2.4.x Distribution: RedHat 8.0 Parallel Computing Driver: MPICH-GM Batch Queue System: PBS 11/13/2018 南开大学科学计算研究所 NK ISC 101

Classifications Count Share Rmax Rpeak Procs Constellations 206 41 % 49458 71506 36708 MPP 195 39 % 126421 210450 114187 Cluster 93 19 % 78052 136048 66614 SMP 6 1 % 39126 44352 5544 Total 500 100 % 293058 462357 223053 11/13/2018 南开大学科学计算研究所 NK ISC 101

Country Shares Count Share Rmax Rpeak Procs USA Germany Japan UK 228 45.6 % 148696 247700 137736 Germany 71 14.2 % 25468 39590 17778 Japan 47 9.4 % 57902 68619 17331 UK 39 7.8 % 20644 38174 17148 France 22 4.4 % 9644 13341 6543 Italy 16 3.2 % 5525 9040 2664 Korea 9 1.8 % 2569 4554 1284 Netherlands 6 1.2 % 2036 4263 3600 China 5 1 % 1899 3473 960 Total 500 100% 293,058 462,357 223,053 11/13/2018 南开大学科学计算研究所 NK ISC 101

Makers Count Share Rmax Rpeak Procs HP SPP 112 22 % 27363 41829 14640 IBM SP 105 21 % 84878 155900 65140 Sun Fire 84 17 % 16856 22405 12432 NOW - Intel 53 10 % 33472 74234 35269 SGI Origin 44 9 % 15552 21114 26368 Compaq AlphaServer 23 5 % 35523 46194 21920 T3E/T3D 22 4 % 11568 17652 17436 NEC Vector 13 3 % 41801 47200 5964 Fujitsu VPP 5690 6135 859 Hitachi SR8xxx 12 2 % 8549 10250 1920 Total 500 100 % 293058 462357 223053 11/13/2018 南开大学科学计算研究所 NK ISC 101

Stony Brook Galaxy 11/13/2018 南开大学科学计算研究所 NK ISC 101