The impact of assessment on students learning

3. Characterizing an assessment environment and assessment experience questionnaire 
 
3.1 Methodology 
A methodology is developed, based on Graham Gibbs methods [4], for characterizing assessment environments in 
terms of: 
ƔThe percentage of marks from examinations. 
Ɣ+RZPDQ\ times students experienced summative-only assessment. 
Ɣ+RZPDQ\ times students experienced formative-only assessment. 
Ɣ7KHYDULHW\RI assessment methods used. 
ƔThe amount of oral and written feedback that students experienced. 
Ɣ7KHDYHUDJHtimelines of feedback from the time of submission. 
Ɣ7KHGHJUHHRIH[SOLFLWQHVVRIVSHFLILFation of course objectives and outcomes. 
Ɣ7KHOHYHO of arrangement between outcomes and assessment methods. 
Each program could then be rated high, medium or low against these characteristics to enable us to establish 
patterns in assessment characteristics. This could be done by examining course documentation and by interviewing 
program chairs and students. 
3.2 Assessment experience questionnaire (AEQ) 
An AEQ that could EHXVHGWRFKDUDFWHUL]HVWXGHQWV¶H[SHULHQFHRIWKHDVVHVVPHQWHQYLURQPHQWVRI 
Engineering programs was developed. The AEQ used in this paper contained the following scales, which were 
extracted from the course delivery questionnaire and the course content questionnaire: 
Ɣ Coverage of syllabus. 
Ɣ Clear objectives and outcomes. 
Ɣ Assessment effectiveness. 
ƔQuantity and quality of feedback. 
ƔUse of feedback. 
Ɣ Use of learning approaches (Deep approach and surface approach). 
Ɣ Learning from quizzes, assignments, and examination. 
The AEQ, which is extracted from [4], was administered to a group of students across the three programs 
(Communication, Computer, and Electronic Engineering) and student experience was measured on each of the 
above scales for each programme. Interviews were conducted with several students from each program so as to 
illustrate the range of learning responses. Scale measures on the AEQ were related to features of the assessment 
environments to identify patterns of relationships between the environment and the VWXGHQWV¶H[SHULHQFH The study 
found that the features of assessment environments and scales from AEQ have significantly lower scores in 
association with them. These features are: a high variety of assessment methods, a high degree of explicitness of 
aims and standards, and a high degree of alignment of aims and standards. On the other hand, the features that have 
significantly higher scores are: a high percentage of marks from exams, a low volume of summative assessment, a 
high volume of formative assessment, a high volume of oral and written feedback, and a high degree of timeliness of 
feedback. In Table-2 below the symbols sa, a, ?, d, and sd UHIHUWRVWURQJO\DJUHHDJUHHGRQ¶WNQRZGLVDJUHHDQG
strongly disagree, respectively. 

---

721
Shihab Jimaa / Procedia - Social and Behavioral Sciences 28 (2011) 718 – 721
Table-2 The AEQ