Thursday, September 10, 2009

Assessment and Reporting Tutorial

Writeup of A&R Tute on 6/9/09. Now I just need to find somewhere to upload the actual audio.

- 0:00 Assessment bank
- 0:45 Describe portfolio.
- 1:20 Comparability of work
- 1:50 200-400 pointscale
- 2:40 reflect the gaps rather than concentrate on getting the right rung
- 4:10 Expectations of pre-service / 1st year teacher for ranking student
- 5:20 QCAT standards for assessment bank items to be ramped up
- 6:50 Nearly Everyone sits the tests
- 7:50 Naplan results, 2nd last for Qld
- 8:45 Contextual assesment vs standalone tests
- 9:30 Building the IPT course
- 10:50 Making criteria sheets for 'A level' standard
- 11:40 Make sure you teach what you assess
- 12:10 Progressive scale of assessment
- 12:45 'Fullest and Latest'. Key principle of assessment
- 12:55 Don't simply add up the scores, use quality of material.
- 13:10 Used at panel. First assess the quality of material
- 13:50 Intentionally Hard
- 15:10 Discernment of knowledge through assessement rather than task completion.
- 16:00 80% for demonstration of mastery
- 17:00 Core Skills Test
- 17:55 Best of its type
- 18:20 Purpose - Give the student a grade on an A to E scale. C is acceptable for Lit/Num minimum
- 19:00 How many sit the test
- 20:10 Purpose - Scaling one school against another.
- 22:10 Pressure as a senior teacher to pass students rather than failing them
- 23:00 50% students well serverd by school today, 30% suffice, 20% want out
- 24:20 Schools aren't the same. Wide variety of cohorts and school direction
- 26:00 Design parameters of the QCS test
- 27:00 assessed 35 syllabuses analysed for ~60 common curriculum elements
- 29:00 Current CCEs
- 29:30 Some CCEs are performance based that can't be tested by paper, leaving 49 CCEs
- 30:10 5 big baskets of CCEs
- 30:20 Each year they don't test all CCEs, but only about 1/2 of them and rotate through them each year.
- 33:00 Navigation to Core Skills test website
- 33:30 Difference in CCEs
- 36:00 QCS test can be hard.
- 37:00 Multiple choice shouldn'thave dummy answers, all should be accptable, but one the most appropriate.
- 37:30 layout of multiple choice questions not needed to be shortest to longest
- 38:40 Language of QCSTest. Short and Sharp. Lower level language used than the core skills it attempts to test.
- 40:30 Design of NAPLAN questions: round table -> UNSW
- 41:30 Security of tests, security leaks
- 42:00 Structure of QCS Test: Short Response, 2xMultiple Choice and Writing Task
- 42:30 Testing for Equity in questions before it is sent out for use.
- 44:00 70% pass rate is a good number to aim for in general
- 44:20 Cost of QCS Test
- 44:50 New teachers mentored into the system through moderation (Professional Development)
- 47:00 Preparing for the test
- 48:00 'Test wize': How the test looks, the language, the types of questions, the time it takes to achieve.
- 48:30 QCS test design Easy ones first, might end with hard one, but not mandatory to be scaled linearly.
- 49:50 Unspeeded tests? When do we have time critical assessment in the real life?
- 50:50 Expected to be completed in 2/3rds the time allocated.
- 51:20 Review of sample question and criteria sheet for marking
- 52:30 Difficulty of question for 1 to 5 stars. Shown on test.
- 53:20 Questions weighted, but more for the expected time taken to answer rather than pure difficulty.
- 54:30 Review of sample question and criteria sheet for marking
- 56:30 Review of writing task
- 59:50 Bottom line: Best preparation for a test is do do a similar one.
- 1:00:00 Immediate quality feedback
- 1:08:00 Summative assessment runs counter to immediate quality feedback?
- 1:30:00 So many pedagogy methodologies. Which to choose? DoL, QSA.
- 1:35:00 DoL aligns to teacher best practice.