NPC 2016 Panel Talk 高光荣 ACM Fellow and IEEE Fellow

Presentation on theme: "NPC 2016 Panel Talk 高光荣 ACM Fellow and IEEE Fellow"— Presentation transcript:

1 NPC 2016 Panel Talk 高光荣 ACM Fellow and IEEE Fellow
Endowed Distinguished Professor University of Delaware 讲习教授 Tsinghua University And Founder and Chairman (ETI) 2/25/2019 NPC-2016 Panel Gao

2 Is Parallel Computing Dead? [1]
“.. I have been asked whether parallel computing will soon be relegated to the trash heap reserved for promising technologies that never quite make it. Washington certainly seems to be looking in the other direction, agency program managers, if they talk of high-performance computing at all, seems to view it as a small and relatively unimportant subcomponent of the National Information Infrastructure.” - Ken Kennedy, 1994 But we shouldn't forget the serious situation that parallel computing once encountered. Because the situation was so serious when the godfather ken kennedy gave his famous speech "Is Parallel Computing Dead?", the people think parallel computing will soon be relegated to the trash heap and it is small and relatively unimportant subcomponent. 2/25/2019 NPC-2016 Panel Gao

3 However… However, the world has witnessed the fantastic successful history of sequential computer systems for 60+ years! 2/25/2019 NPC-2016 Panel Gao

4 几次大起大落：系统结构 vs. AI/ML 图灵机 1936 1940 1946 萌芽期 1956 Von Neumman 计算机 1958
1966 1976 1986 1996 2006 2016 1940 1958 1969 1985 1995 2010 萌芽期 Von Neumman 计算机 繁荣期 Minsky Paper 并行计算机第一繁荣期 冰河期 Hopfield BP神经网络 繁荣期 SVM，统计学习发现 并行计算机冰河/沉寂期 沉寂期 并行计算机第二春开始 繁荣期 并行计算机第二繁荣期 2/25/2019 NPC-2016 Panel Gao

5 Google Tensor-Flow White Paper Jeff Dean, et. al. 10/2015
Jeff Dean: Google Tensor Flow System’s Execution Model is based on “MIT Dataflow” Model 2/25/2019 NPC-2016 Panel Gao

6 Inspiration: Jack Dennis
General purpose parallel machines based on a dataflow graph model of computation 2013年，因其在操作系统和数据流领域的重大贡献 荣获IEEE John von Neumann Medal 2/25/2019 NPC-2016 Panel Gao

7 An Intresting Worshop 40+ years ago in Russia
Novosibirsk 2/25/2019 NPC-2016 Panel Gao

8 Notables Novosibirsk -1972
J. Schwartz Bahrs Luckham M. Engeler Ershov Milner Warren McCarthy Miller Igarashi Hoare Paterson F. Allen Dennis Curtesy of Jack Dennis 2/25/2019 NPC-2016 Panel Gao

9 NOTE: Pioneers of both fields – AI and HPC/Dataflow – were present at this 1972 workshop!
2/25/2019 NPC-2016 Panel Gao

10 Alan Turing- A Father of Computer Systems and AI
计算机科学之父 人工智能之父 出生于伦敦 1913年，考入剑桥大学国王学院。1934年他以优异成绩毕业。 1935年因中心极限定理论文当选为国王学院Fellow 2/25/2019 NPC-2016 Panel Gao

11 Unfortunately, there has no commonly accepted parallel Turing machine model and a corresponding parallel abstract architecture model for parallel computing. 2/25/2019 NPC-2016 Panel Gao