外语测试：目标、内容与方法 韩宝成 北京外国语大学外国语言研究所 中国外语教育研究中心 中国外语测评中心.

Presentation on theme: "外语测试：目标、内容与方法 韩宝成 北京外国语大学外国语言研究所 中国外语教育研究中心 中国外语测评中心."— Presentation transcript:

1 外语测试：目标、内容与方法 韩宝成 北京外国语大学外国语言研究所 中国外语教育研究中心 中国外语测评中心

2 Qualities of a test (Lado, 1961)
Bachman, IAKELE Conference 7/6/2018 Qualities of a test (Lado, 1961) Validity as relevance Reliability (stability) Bachman, IAKELE Conference, Seoul, August 2005 2

3 Qualities of a test (Bachman & Palmer, 1996)
Bachman, IAKELE Conference 7/6/2018 Qualities of a test (Bachman & Palmer, 1996) Reliability Construct validity (interpretation) Authenticity Interactiveness Impact Practicality Bachman, IAKELE Conference, Seoul, August 2005 3

4 Nowadays Consequences Ethics Fairness Bachman, IAKELE Conference
7/6/2018 Nowadays Consequences Ethics Fairness Bachman, IAKELE Conference, Seoul, August 2005 4

5 Consequences Evaluation (Decisions) ?

6 Types of decisions for which language assessments are used
Bachman, IAKELE Conference 7/6/2018 Types of decisions for which language assessments are used Entrance, readiness Placement Changes in instruction Changes in approaches to or strategies of learning Achievement/progress/grading Certification Selection Bachman, IAKELE Conference, Seoul, August 2005 6

7 Many of these decisions are “high stakes”.

8 Consequence(s)

9 We need to JUSTIFY the uses of language assessments are to help us make DECISIONS that will ideally lead to BENEFICIAL CONSEQUENCES for stakeholders. (Bachman & Palmer 2010, p. 22)

10 Assessment Use Argument Claims, Data, Warrants, Backing

11 USEFULNESS

12 ASSESSMENT INTERPRETATION AND USE ASSESSMENT DESIGN AND DEVELOPMENT
Beneficial Consequences ASSESSMENT INTERPRETATION AND USE ASSESSMENT DESIGN AND DEVELOPMENT Decisions Information (Interpretation) Assessment Report Assessment Performance

13 后果：考什么、怎么考

14

15 ELT in China 中小学英语 大学英语 英语专业 课程 专业

16 ELT Tests in China NMET CET TEM

17 ELT Tests in China 语言考试？ 课程考试？ 专业考试？

18 目标、内容、方法

19

20 课程目标 与 测试目标

21 基础英语教育

22 NMET（高考英语） CET（大学英语考试） TEM（英语专业考试）

23 测试构念 与 测试目标

24 What is language ability?

25

26

27 Realism

28 Instrumentalism

29 Constructivism

30 self is friend second a

31 A friend is a second self. A friend is a second self.

32 语言是思想, 是智慧, 是生活, 是人, 是一切, 覆盖一切, 穿透一切。语言教育是全人教育。
语言是思想, 是智慧, 是生活, 是人, 是一切, 覆盖一切, 穿透一切。语言教育是全人教育。

33 Content and Assessment Objectives

34

35

36 Everything in a textbook is CONTENT.

37 CONTENT is all around us.

38 HOT ARTICHOKE DIP (Serves 10 to 14) 2 14-oz cans artichoke hearts
16 oz. mayonnaise (蛋黄酱) 1 c. grated Parmesan cheese Garlic salt (optional) ==================================== Drain artichoke hearts. Mash artichokes with fork. Mix with mayonnaise, cheese, and garlic salt. Bake at 350 degrees for 15 minutes or until cheese is melted. Serve with crackers (饼干) or party rye (裸麦威士忌酒). Recipes have two parts, a top part and a bottom part. The top part includes the ingredients. The bottom part describes what the cook is supposed to do with the ingredients. In the terminology of the revised Taxonomy, the top part contains the basis for Factual Knowledge (the details) while the bottom part contains the basis for Procedural Knowledge (the steps to follow). More advanced cooks may bring Conceptual Knowledge to the recipe; others may involve Metacognitive Knowledge in the preparation of the Hot Artichoke Dip. 38

39 This recipe is CONTENT.

40 When examining content from an educational perspective, a major question is “What do we intend students to learn from the content?”

41 When applied to the recipe, the question becomes: “What should students learn from the recipe?”

42 Do we intend students to:
REMEMBER the recipe, both the ingredients and directions? UNDERSTAND what each ingredient is in case there is a need to make a substitution? APPLY the recipe to make the dip? ANALYZE the recipe in terms of the relationships among the ingredients? EVALUATE the recipe (keep or throw away)? CREATE their own recipe based on the original recipe?

43 Please note The answer to the question of what we intend students to learn from the content is our objective, The same content can lead to a variety of quite different objectives.

44 Framework of educational objectives

45 Bloom Revised Bloom Create Evaluation Evaluate Synthesis Analyze
Analysis Application Apply Understand Comprehension Knowledge Remember 45

46 Revised Bloom’s Framework
Create HOTS Evaluate Analyze Apply LOTS Understand Remember 46

47 A student understands something
if he/she can interpret it, exemplify it, classify it, summarize it, make inferences, make comparisons (compare), and give explanations (explain).

48 All which the school can or need do for pupils, so far as their minds are concerned … is to develop their ability to think. John Dewey ( )

49 All lessons are lessons in thinking.
Gilbert Ryle ( )

50 “中小学十几年，大部分时间用来学习百十篇从几十字到几百字的对话或课文，操练一些四会五会的技术，束缚了孩子们的智育发展，忽视了心智健全成长，我们对不起他们。”
—许国璋

51 Bachman (1990: 70): the content of language tests can be based on either a theory of language proficiency or a specific domain of content, generally as provided in a course syllabus.

52 ?

53 1 G

54 Certificates of Proficiency in English

55 第四届中英庚款英文试题(1936年)

56

57

58

59

60

61 何炳棣（2012）：《读史阅世六十年》

62 2 G

63 Test of English as a Foreign Language

64

65

66

67

68

69 3 G

70 General Training Reading General Training Writing
IELTS Listening 30 minutes, 4 sections, 40 items General Training Reading 60 minutes, 3 sections, 40 items Academic Reading General Training Writing 60 minutes, 2 tasks Academic Writing Speaking minutes, 3 parts

71

72

73

74

75

76

77

78

79

80

81 《英国高中“中文”课程考试大纲》

82

83 英国高考语文试题 (A level)

84

85

86

87

88

89

90

91 小 结 外语教育的目标 外语考试的目标、内容与方法 基本知识和技能 语言体系, decontextulized 交流和沟通
学文化、启心智、爱生命 语言、内容、思维的结合, integrated

92 Content-based thinking assessment

93 What we assess is what we value.

94 Thanks