NPC 2016 Panel Talk 高光荣 ACM Fellow and IEEE Fellow Endowed Distinguished Professor University of Delaware 讲习教授 Tsinghua University And Founder and Chairman (ETI) 2/25/2019 NPC-2016 Panel Gao

Is Parallel Computing Dead? [1] “.. I have been asked whether parallel computing will soon be relegated to the trash heap reserved for promising technologies that never quite make it. Washington certainly seems to be looking in the other direction, agency program managers, if they talk of high-performance computing at all, seems to view it as a small and relatively unimportant subcomponent of the National Information Infrastructure.” - Ken Kennedy, 1994 But we shouldn't forget the serious situation that parallel computing once encountered. Because the situation was so serious when the godfather ken kennedy gave his famous speech "Is Parallel Computing Dead?", the people think parallel computing will soon be relegated to the trash heap and it is small and relatively unimportant subcomponent. 2/25/2019 NPC-2016 Panel Gao

However… However, the world has witnessed the fantastic successful history of sequential computer systems for 60+ years! 2/25/2019 NPC-2016 Panel Gao

几次大起大落：系统结构 vs. AI/ML 图灵机 1936 1940 1946 萌芽期 1956 Von Neumman 计算机 1958 1966 1976 1986 1996 2006 2016 1940 1958 1969 1985 1995 2010 萌芽期 Von Neumman 计算机 繁荣期 Minsky Paper 并行计算机第一繁荣期 冰河期 Hopfield BP神经网络 繁荣期 SVM，统计学习发现 并行计算机冰河/沉寂期 沉寂期 并行计算机第二春开始 繁荣期 并行计算机第二繁荣期 2/25/2019 NPC-2016 Panel Gao

Google Tensor-Flow White Paper Jeff Dean, et. al. 10/2015 Jeff Dean: Google Tensor Flow System’s Execution Model is based on “MIT Dataflow” Model 2/25/2019 NPC-2016 Panel Gao

Inspiration: Jack Dennis General purpose parallel machines based on a dataflow graph model of computation 2013年，因其在操作系统和数据流领域的重大贡献 荣获IEEE John von Neumann Medal 2/25/2019 NPC-2016 Panel Gao

An Intresting Worshop 40+ years ago in Russia Novosibirsk 2/25/2019 NPC-2016 Panel Gao

Notables Novosibirsk -1972 J. Schwartz Bahrs Luckham M. Engeler Ershov Milner Warren McCarthy Miller Igarashi Hoare Paterson F. Allen Dennis Curtesy of Jack Dennis 2/25/2019 NPC-2016 Panel Gao

NOTE: Pioneers of both fields – AI and HPC/Dataflow – were present at this 1972 workshop! 2/25/2019 NPC-2016 Panel Gao

Alan Turing- A Father of Computer Systems and AI 计算机科学之父 人工智能之父 1912.6.23-1954.6.7 出生于伦敦 1913年，考入剑桥大学国王学院。1934年他以优异成绩毕业。 1935年因中心极限定理论文当选为国王学院Fellow 2/25/2019 NPC-2016 Panel Gao

Unfortunately, there has no commonly accepted parallel Turing machine model and a corresponding parallel abstract architecture model for parallel computing. 2/25/2019 NPC-2016 Panel Gao