Boards and Consultations

Back from Helsinki, I’m now in the midst of Examination Board business. That’s two Boards for me, one for the Department of Theoretical Physics and the other for the Department of Engineering (as I’ve been teaching Engineering Mathematics).  We’ve already Preliminary meetings for both and this afternoon had the `Final’ Board for Engineering in the presence of the external examiners. The Final ‘Board’ for Theoretical Physics with the external is on Thursday. But that’s not the end of it – there is an overall University Examination Board that covers all courses in the University to formally bring an end to the examination process.

That’s quite a lot of Boards.

It is not until after all the Boards have done their business that the students get their marks and not long after that we have a Consultation Day, where

Staff will be available in all Departments to discuss results with students. Students are entitled to see their examination scripts if they wish, these will be generally available on this day or at another mutually convenient time.

When I was Head of the School of Mathematical and Physical Sciences at Sussex University I tried to introduce such a system there, but it was met with some resistance from staff who thought this would not only cause a big increase in workload and but also lead to  difficulties with students demanding their marks be increased. That has never been my experience elsewhere: only a handful take up the opportunity and those that do are told quite clearly that the mark cannot be changed.  Last year I had only one student who asked to go through their script. I was happy to oblige and we had a friendly and (I think) productive meeting.

If I had my way we would actually give all students their marked examination scripts back as a matter of routine. The fact that we don’t is no doubt one reason for relatively poor performance in student satisfaction surveys about assessment and feedback. Obviously examination scripts have to go through a pretty strict quality assurance process involving the whole paraphernalia of examination boards (including external examiners), so the scripts can’t be given back immediately but once that process is complete there doesn’t seem to me any reason why we shouldn’t give their work, together with any feedback written on it,  back to the students in its entirety.

I have heard some people argue that under the provisions of the Data Protection Act students have a legal right to see what’s written on the scripts – as that constitutes part of their student record – but that’s not my point here. My point is purely educational, based on the benefit to the student’s learning experience.

Anyway, I don’t know how widespread the practice is of giving examination scripts back to students so let me conduct a totally unscientific poll. Obviously most of my readers are in physics and astronomy, but I invite anyone in any academic discipline to vote:

And, of course, if you have any further comments to make please feel free to make them through the box below!

Follow @telescoper

Student access to marked examination scripts

I’m currently waiting for the last couple of scripts from my Physics of the Early Universe examination to arrive so I can begin the task of marking them. The examination was yesterday morning, and it’s now Friday afternoon, so I don’t know why it takes so long for the scripts to find their way to the examiner, especially when marking is on such a tight schedule. I’m away next week (in Ireland) so if I don’t get papers by this afternoon they won’t be marked until I return. The missing two are from students sitting in alternative venues, but I don’t see why that means they take over 24 hours  to get to the marker.

(By the way,  `script’ refers to what the student writes (usually in a special answer book), as opposed to the `paper’ which is the list of questions to be answered or problems to be solved in the script.)

Anyway, while I’m waiting for the missing scripts to arrive I thought I’d mention that here in the School of Physics & Astronomy at Cardiff University we have a system whereby students can get access to their marked examination scripts.  This access is limited, and for the purpose of getting feedback on where they went wrong, not for trying to argue for extra marks. The students can’t take the scripts away, nor can they make a copy, but the can take notes which will hopefully help them in future assessments. There’s a similar provision in place in the Department of Theoretical Physics at Maynooth University, where I will be relocating full-time in July, based around a so-called `Consultation Day’.

When I was Head of the School of Mathematical and Physical Sciences at Sussex University I tried to introduce such a system there, but it was met with some resistance from staff who thought this would not only cause a big increase in workload and but also lead to  difficulties with students demanding their marks be increased. That has never been the experience here at Cardiff: only a handful take up the opportunity and those that do are told quite clearly that the mark cannot be changed.  Last year I had only one student who asked to go through their script. I was happy to oblige and we had a friendly and (I think) productive meeting.

If I had my way we would actually give all students their marked examination scripts back as a matter of routine. The fact that we don’t is no doubt one reason for relatively poor performance in student satisfaction surveys about assessment and feedback. Obviously examination scripts have to go through a pretty strict quality assurance process involving the whole paraphernalia of examination boards (including external examiners), so the scripts can’t be given back immediately but once that process is complete there doesn’t seem to me any reason why we shouldn’t give their work, together with any feedback written on it,  back to the students in its entirety.

I have heard some people argue that under the provisions of the Data Protection Act students have a legal right to see what’s written on the scripts – as that constitutes part of their student record – but that’s not my point here. My point is purely educational, based on the benefit to the student’s learning experience.

Anyway, I don’t know how widespread the practice is of giving examination scripts back to students so let me conduct a totally unscientific poll. Obviously most of my readers are in physics and astronomy, but I invite anyone in any academic discipline to vote:

And, of course, if you have any further comments to make please feel free to make them through the box below!

Follow @telescoper

 

Why not give back to students their marked examination scripts?

Well, the examination period is over and we’re now in that curious interregnum in the academic year that lasts until graduation, when we get to congratulate students properly and send them on their way into the big wide world. I hope the weather is a bit cooler for that event. It’s no fun at all for either staff or students wearing a suit and tie with a heavy gown on top when the temperature is 30°!

Anyway, yesterday I had a meeting with a (Masters) student about one of his recent examinations, and it prompted me to write a short post about the reason for our discussion.

Here in the School of Physics & Astronomy at Cardiff University we have a system whereby students can get access to their marked examination scripts. By `script’ I mean what the student writes (usually in a special answer book), as opposed to the `paper’ which is the list of questions to be answered or problems to be solved in the script. This access is limited, and for the purpose of getting feedback on where they went wrong, not for trying to argue for extra marks. The students can’t take the scripts away, nor can they make a copy, but the can take notes which will hopefully help them in future assessments.

When I was Head of the School of Mathematical and Physical Sciences at Sussex University I tried to introduce such a system there, but it was met with some resistance from staff who thought this would cause a big increase in workload and lead to  difficulties with students demanding their marks be increased. That has never been the experience here at Cardiff: only a handful take up the opportunity and those that do are told quite clearly that the mark cannot be changed. This year I had only one student who asked to go through their script. I was happy to oblige and we had a friendly and (I think) productive meeting.

If I had my way we would actually give all students their marked examination scripts back as a matter of routine. The fact that we don’t is no doubt one reason for relatively poor performance in student satisfaction surveys about assessment and feedback. Obviously examination scripts have to go through a pretty strict quality assurance process involving the whole paraphernalia of examination boards (including external examiners), so the scripts can’t be given back immediately but once that process is complete there doesn’t seem to me any reason why we shouldn’t give their work, together with any feedback written on it,  back to the students in its entirety.

I have heard some people argue that under the provisions of the Data Protection Act students have a legal right to see what’s written on the scripts – as that constitutes part of their student record – but that’s not my point here. My point is purely educational, based on the benefit to the student’s learning experience.

Anyway, I don’t know how widespread the practice is of giving examination scripts back to students so let me conduct a totally unscientific poll. Obviously most of my readers are in physics and astronomy, but I invite anyone in any academic discipline to vote:

 

 

And, of course, if you have any further comments to make please feel free to make them through the box below!

 

Follow @telescoper

 

 

The Culture of Over-Assessment in STEM

This afternoon I went to yet another meeting about assessment and feedback in University teaching involving members of staff and students from the School of Physics & Astronomy here at Cardiff University as well as some people from other schools and departments. Positive though this afternoon’s discussion was, it didn’t do anything to dissuade me from a long-held view that the entire education system holds back the students’ ability to learn by assessing them far too much. This is a topic that I’ve blogged about a few times before over the years (see, e.g., here) but given that the problem hasn’t gone away (and indeed is probably going to get worse as a result of the Teaching Excellence Framework which the Westminster government is trying to impose on universities),  I make no apologies for repeating the main points here.

One important point we need to resolve to pin down essentially what is meant by “Research-led Teaching”, which is what we’re supposed to be doing at universities. In my view too much teaching is not really led by research at all, but mainly driven by assessment. The combination of the introduction of modular programmes and the increase of continuously assessed coursework has led to a cycle of partial digestion and regurgitation that involves little in the way of real learning and certainly nothing like the way research is done. I don’t know why we’ve got into this situation but it can’t be allowed to continue.

I’m not going to argue for turning the clock back entirely but, for the record, my undergraduate degree involved no continuous assessment at all (apart from a theory project I opted for in my final year. Having my entire degree result based on the results of six three-hour unseen examinations in the space of three days is not an arrangement I can defend, but note that despite the lack of continuous assessment I still spent less time in the examination hall than present-day students.

That’s not to say I didn’t have coursework. I did, but it was formative rather than summative; in other words it was for the student to learn about the subject, rather for the staff to learn about the student. I handed in my stuff every week, it was marked and annotated by a supervisor, then returned and discussed at a supervision.

People often tell me that if a piece of coursework “doesn’t count” then the students won’t do it. There is an element of truth in that, of course. But I had it drummed into me that the only way really to learn my subject (Physics) was by doing it. I did all the coursework I was given because I wanted to learn and I knew that was the only way to do it. I think we need to establish that as a basic principle of education in physics (and similar subjects).

The very fact that coursework didn’t count for assessment made the feedback written on it all the more useful when it came back because if I’d done badly I could learn from my mistakes without losing marks. This also encouraged me to experiment a little, such as using a method different from that suggested in the question. That’s a dangerous strategy nowadays, as many seem to want to encourage students to behave like robots, but surely we should be encouraging students to exercise their creativity rather than simply follow the instructions? The other side of this is that more challenging assignments can be set, without worrying about what the average mark will be or what specific learning outcome they address.

I suppose what I’m saying is that the idea of Learning for Learning’s Sake, which is what in my view defines what a university should strive for, is getting lost in a wilderness of modules, metrics, percentages and degree classifications. We’re focussing too much on those few aspects of the educational experience that can be measured, ignoring the immeasurable benefit (and pleasure) that exists for all of us humans in exploring new ways to think about the world around us.

Follow @telescoper

The Curse of Assessment-led Teaching

Yesterday I took part in a University Teaching and Learning Strategy meeting that discussed, among other things, how to improve the feedback on student assessments in order to help them learn better. It was an interesting meeting, involving academics, administrative staff and representatives of the Students Union, that generated quite a few useful ideas. Looking through my back catalogue I realise that around this time year I was at a similar event based in the School of Mathematical and Physical Sciences at the University of Sussex of which I am Head.

Positive though yesterday’s discussion was, it didn’t do anything to dissuade me from a long-held view that the entire education system holds back the students’ ability to learn by assessing them far too much. One part of the discussion was about trying to pin down essentially what is meant by “Research-led Teaching” which is what we’re supposed to be doing at universities. In my view too much teaching is not really led by research at all, but mainly driven by assessment. The combination of the introduction of modular programmes and the increase of continuously assessed coursework has led to a cycle of partial digestion and regurgitation that involves little in the way of real learning and certainly nothing like the way research is done.

I’m not going to argue for turning the clock back entirely, but for the record my undergraduate degree involved no continuous assessment at all (apart from a theory project I opted for in my final year. Having my entire degree result based on the results of six three-hour unseen examinations in the space of three days is not an arrangement I can defend, but note that despite the lack of continuous assessment I still spent less time in the examination hall than present-day students.

That’s not to say I didn’t have coursework. I did, but it was formative rather than summative; in other words it was for the student to learn about the subject, rather for the staff to learn about the student. I handed in my stuff every week, it was marked and annotated by a supervisor, then returned and discussed at a supervision.

People often tell me that if a piece of coursework “doesn’t count” then the students won’t do it. There is an element of truth in that, of course. But I had it drummed into me that the only way really to learn my subject (Physics) was by doing it. I did all the coursework I was given because I wanted to learn and I knew that was the only way to do it.

The very fact that coursework didn’t count for assessment made the feedback written on it all the more useful when it came back because if I’d done badly I could learn from my mistakes without losing marks. This also encouraged me to experiment a little, such as using a method different from that suggested in the question. That’s a dangerous strategy nowadays, as many seem to want to encourage students to behave like robots, but surely we should be encouraging students to exercise their creativity rather than simply follow the instructions? The other side of this is that more challenging assignments can be set, without worrying about what the average mark will be or what specific learning outcome they address.

I suppose what I’m saying is that the idea of Learning for Learning’s Sake, which is what in my view defines what a university should strive for, is getting lost in a wilderness of modules, metrics, percentages and degree classifications. We’re focussing too much on those few aspects of the educational experience that can be measured, ignoring the immeasurable benefit (and pleasure) that exists for all humans in exploring new ways to think about the world around us.

Follow @telescoper

The Busyness of Examination Time

Just time this evening for the briefest of brief posts. This is probably the busiest week of the year at the University of Sussex, and it’s not over yet. The main reason for this busyness is the business of examinations, assessment and degree classification.

This morning we had our meeting of the School Progression and Award Board for Years 3 and 4 at which, among other things, we sorted out the classification for honours of our graduating students. This involves distilling the marks gained over several years of assessments down to a final “Grand Mean”. It’s not a trivial process but I’m glad to say it went off very smoothly.

The pass lists have now gone to be officially signed off by the University administration. They will be posted tomorrow at noon, at which time we’ll have a celebratory drink or several ready for those getting their results.

One of my duties as Head of School is to chair this meeting, but I don’t take credit for the successful running of the meeting because all the hard work of preparation was done by our excellent office staff, especially Oonagh and Chrystelle.

That done there was time for a quick sandwich lunch before heading off to Stanmer House for a teaching “away afternoon” for the Department of Physics & Astronomy, at which we discussed ideas for improvements to the way we teach and assess students.

I’m actually in the group sitting under the parasol in the left foreground.

Stanmer House is set in beautiful parkland just a short walk from Sussex University. I took the more strenuous route over the hill, but am glad I did so because the view was so nice in the glorious sunshine and it made be realise I don’t make as much of the opportunity for walking around the campus as I should.

Tomorrow is going to be another busy day but, if you’ll excuse me, I’m now going to have a glass of chilled white wine and a bite to eat.

Follow @telescoper

Better learning means less assessment and more feedback

Yesterday I took part in a meeting that discussed, among other things, how to improve the feedback on student assessments in order to help them learn better. It was an interesting meeting, involving academics, administrative staff and a representative of the Students Union, that generated quite a few ideas which I hope will be implemented pretty soon.

Positive though the discussion was, it didn’t do anything to dissuade me from a long-held view that the entire education system holds back the students’ ability to learn by assessing them far too much. The combination of the introduction of modular programmes and the increase of continuously assessed coursework has led to a cycle of partial digestion and regurgitation that involves little in the way of real learning.

I’m not going to argue for turning the clock back entirely, but for the record my undergraduate degree involved no continuous assessment at all (apart from a theory project I opted for in my final year. Having my entire degree result based on the results of six three-hour unseen examinations in the space of three days is not an arrangement I can defend, but note that despite the lack of continuous assessment I still spent less time in the examination hall than present-day students.

That’s not to say I didn’t have coursework. I did, but it was formative rather than summative; in other words it was for the student to learn about the subject, rather for the staff to learn about the student. I handed in my stuff every week, it was marked and annotated by a supervisor, then returned and discussed at a supervision.

People often tell me that if a piece of coursework “doesn’t count” then the students won’t do it. There is an element of truth in that, of course. But I had it drummed into me that the only way really to learn my subject (Physics) was by doing it. I did all the coursework I was given because I wanted to learn and I knew that was the only way to do it.

The very fact that coursework didn’t count for assessment made the feedback written on it all the more useful when it came back because if I’d done badly I could learn from my mistakes without losing marks. This also encouraged me to experiment a little, such as using a method different from that suggested in the question. That’s a dangerous strategy nowadays, but surely we should be encouraging students to exercise their creativity rather than simply follow the instructions? The other side of this is that more challenging assignments can be set, without worrying about what the average mark will be or what specific learning outcome they address.

I suppose what I’m saying is that the idea of Learning for Learning’s Sake, which is what in my view defines what a university should strive for, is getting lost in a wilderness of modules, metrics, percentages and degree classifications. We’re focussing too much on those few aspects of the educational experience that can be measured, ignoring the immeasurable benefit (and pleasure) that exists for all humans in exploring new ways to think about the world around us.

Follow @telescoper