Showing posts with label assessment. Show all posts
Showing posts with label assessment. Show all posts

Friday, 18 May 2012

Moodle Roll Over

Well it's that time of year where we think about planning for next year. To this end, this post will discuss some of the options for carrying content from one Moodle area (e.g. 11/12 unit) into another (e.g. 12/13 unit).



Unit Import / Roll-over

The most straightforward way to roll content across from one unit into another is to bring everything across - all resources, quizzes, etc. Of course there are one or two things we'll need to 'check off', but essentially the process is straightforward enough.

You can access the CeLT guide to support this process, and/or watch this short (<5 min) video, which walks through the steps...


Checklist

  • Remember that Turnitin activities will not copy across, so these will need to be recreated in the new area
  • Any other assignments or quizzes that have dates associated will need updating to reflect the new dates - this can cause problems for students later on if overlooked. 
  • Also check the dates associated to each week in the unit (if using a weekly structure). You can edit these from the settings page (under the Administration menu).



Importing Selected Content


It's possible to import selected pieces of information, resources and activities into a new area, simply by only selecting the relevant check boxes. However there can be some problems when bringing that content into an area with existing content. If you are interested in doing this, it is advised to get in touch with me (or the eLearning Support Officer from your Faculty) to discuss the options and potential pitfalls.


Creative Commons License
This work by Peter Reed is licensed under a Creative Commons Attribution-NonCommercial 3.0 Unported License.

Tuesday, 15 May 2012

Perhaps Education isn't that broken....

There are a number of debates circulating around education, many of which focus on what's wrong with the current system; some suggest alternatives. Quite a few of these have got me thinking, so this post is yet another (somewhat garbled and at times contradictory) attempt at thinking aloud.

I must admit, I haven't been involved/engaged with the debate (or is it a movement) on the Purpose of Education as much as I would have liked. Having said that, I think there's a mutually exclusive relationship between being involved in teaching and educational technology, and the debate on the 'Purpose of Education'. I think to this end we consider, research and reflect upon many intertwined concepts on a daily basis;
  • what we are trying to achieve
  • what we want our students to achieve
  • methods for how these should be achieved
  • how we get, and become better at getting, students from A to B (if indeed that is the purpose of education)
  • how we assess and credit these achievements
  • and how in doing so, we help others (students, teachers, etc) do the same. 
I won't go into each of these here, but two fairly recent blog posts have got me thinking (both of which I believe are almost sub-debates of the wider question of 'purpose').



The purpose and future of the text book has been murmuring for a while. Audrey Watters post picks up on a few interesting things, but is generally critical of the fundamental concept of the text book. Whilst I don't see a problem with an entity that brings together information to support discussion and learning around a particular topic, I agree with Audrey in that;
'Somewhere along the way, "textbook" became "curriculum" -- and under today's testing regime, that all became wrapped up in "assessment."'
I suppose it's a subjective point as to whether a course of study should be centered around a single source such as a textbook, but that would surely depend upon specific learning outcomes. If a book is sufficiently aligned, (and of course of sufficient rigour) then is there a problem, and more to the point, any different than having multiple current sources from the web? Although I am in favour of encouraging students to search, find, review and share relevant content, I equally think providing a foundation layer to that higher level of working is no bad thing.



Audrey obviously hints, as do others, at the problems related to assessment and the methods of accreditation i.e. how do we recognise and reward learning? Much criticism has been thrown at the current model of accreditation, with the concept of Badges as a potential solution - something I'm not too keen on for formal education. Again I'm by no means an expert on this discussion, so read up for yourself, but I can't see how this less formal approach can replace existing models effectively. The Mozilla blog suggests;
"Open Badges will let you gather badges from any site on the internet, combining them into a story about what you know and what you’ve achieved. There is a real chance to create learning that works more like the web."
Whilst this sounds exciting, I think we still need the academic rigour and formal accreditation in our education system, which is measurable and somewhat tangible for employers.  I stumbled across a post recently by Ted Curran questioning badges;
“How can an employer believe that you’ve mastered content if there’s no accredited institution willing to put their reputation on the line to say that you did”?
I don't disagree, but delving into OpenBadges.org site further, it's more apparent that this might be an option for lifelong learning (CPD) out-with the degree classifications of HE. I have long thought the range of CPD courses on offer need to be benchmarked, so perhaps badges could be a way of doing so? Certainly, I don't believe anybody and everybody could offer up badges with no benchmarking or comparisons to ensure what Provider A offers is of an equal rigour to that of Provider B, otherwise the badges will quickly become meaningless. Furthermore, (and playing Devil's Advocate a little) do we really need to bloat our CV with dozens of badges?

On a side note: I really don't like the metaphor  - badges have wormed their way into a particular genre of fashion, and I don't like it. They are also something generally worn by children (and I picture them worn by Mods & Rockers as well - but that's before my time). Needless to say, I am neither! A certificate will do me fine, thank you. Herein lies a separate problem - metaphors have to be relevant and not patronising to be accepted! Where do Badges come in relation to this?



So where do these ramblings lead to?


The purpose of education; is it really to teach children who the Kings and Queens of the United Kingdom were and in what order? Or is it to develop skills to enable responsive, adaptability and reflective practice, and to better understand the world in which we live? Or is it a bit of both? I won't pretend I know the answers here, as there are far greater minds grappling with these problems and still yet to find the solutions.

Doug Belshaw interviewed David Preston recently, who suggests the purpose is about 'leading people to a deeper understanding of themselves and the world around them, through inspiring them to learn', and touches on how education currently focuses on economies of scale, measurable assessment, and efficiency.

Whilst this all this is very inspirational, how do we shape things on the ground?

(I think) I think that learning 'facts and figures' (and the definitive) are important, but the approaches we employ to support pupils/students needs to be more holistic and diverse. The textbook can still be part of the future of education (in paper or digital versions), as we need to teach students the definitive things (I think) - however we should do so whilst developing the problem solving and adaptability skills we eulogise. Nevertheless, with the focus of coursework/exams assessing specific things (skills, knowledge, understanding, etc);

  • Is there always a temptation to just give learners the information (in any format), rather than building a pathway for students to find that information themselves? 
  • Which is more efficient (in terms of ease of teaching and/or effective learning)
  • And how many teaching staff actually value the latter over the former?

One thing I do believe, is that packing students together into massive classes, and getting them sitting in a massive lecture theatre, is not the way we should go. This is strategic decision to be made by Faculty, and a difficult one where efficiency savings are at the heart of daily business.

Perhaps initiatives such as the Flipped Classroom (something I've already blogged about) attempts to combine the 'information giving' with the 'problem solving'? Could initiatives like this be the future?



To conclude....

Many say this is broken, but is it? Perhaps our Education system isn't broken at all, but rather the tools and techniques used (and importantly, those in control of those) are the real flaws in the system? With this in mind, I think about those students that have genuinely had an amazing experience in education - it wasn't broken for them. And I think about initiatives here at MMU and the annual teaching awards (were students recognise the good work being carried out not only by individual lecturers and supervisors, but by whole programmes). The teachers/lecturers have employed approaches that stretch and challenge. Corollary, the bad experiences we often hear about centre around limited support, didactic and inflexible teaching.

So just to throw the thought out there; rather than complain about the 'system', perhaps we should better prepare those responsible for supporting the development of learners in order to make education more personalised, enjoyable and meaningful for everyone.

Over to you...



Book image via Microsoft Clip Art
Badges image via Mozilla

Creative Commons License
This work by Peter Reed is licensed under a Creative Commons Attribution-NonCommercial 3.0 Unported License.

Wednesday, 18 April 2012

Providing Assessment and Overall Unit Grades through Moodle

As we all know, it is important to get assessment grades inserted into QLS as soon as possible, however many people are interested in getting these grades (and sometimes feedback) returned to students through Moodle as well.

Before we go on, it is important to remember that grades will soon be dynamically pulled out of QLS and available for students to see in the right hand block. However using the Gradebook in addition to this, can often be more useful, especially if you want to give feedback and/or format the gradebook to accurately collate individual assessments to provide a (provisional) unit total. This post attempts to show you how this can be done!



Moodle Assessments


If you have used any of the Moodle Assessment tools (quizzes, assignment uploads), a column will be automatically inserted into the Gradebook. Of course, quizzes are typically marked automatically and will populate the gradebook immediately. You can also quickly leave grades and/or feedback for other types of assignments. The short screencast (in the next section) demonstrates how you can quickly leave grades/feedback to students (ff to 1:13).



What about assessments that were not conducted in Moodle?


Many units have assessments that cannot, for one reason or another, be conducted in Moodle. For example, a unit I have been teaching this year had continuous assessment activities related to lab work. The marks for each continuous assessment were collated as a small percentage of the overall mark for the unit. This could equally relate to work submitted through Coursework Receipting or even observation based work, and you might want to provide feedback and grades online.

There are a number of options available to get these marks/feedback into Moodle and visible to students.
  1. Create an offline activity [for grades and basic feedback]
  2. Create an 'advanced uploading of files' [for grades and a return-file upload]
The following short video runs through creating these two options. A third option does exist, whereby an extra gradebook column can be added from Grades > Full View (from drop down) > Add Grade Item.




Can I provide feedback to groups?

Yes! Although the default tools discussed above do not currently support group feedback, the most effective method is to ensure the students are in Groups (this blog post discusses groups & groupings). You can then create a Forum set to Separate Groups, and provide feedback for each group (and even facilitate discussion around grades/feedback). The beauty here is that essentially, a 'separate' forum is created for each group, and only those students in the group can see/participate in that forum.



Can I upload grades to the Gradebook?


Yes! It is possible to upload a csv file to insert grades/feedback in bulk. This involves exporting the gradebook to get some of the default fields (user ID, etc), and then importing the csv to insert the values. The two links provided go through these step-by-step.



How do I prevent the gradebook combining formative and summative grades?


...easier than you think actually! From within Grades > Full view, you can quickly change the weightings of different assessments to either exclude some (formative) and collate others. This short video demonstrates how you can do this.







Creative Commons License
This work by Peter Reed is licensed under a Creative Commons Attribution-NonCommercial 3.0 Unported License.

Tuesday, 17 April 2012

Efficiencies in Assessments through Technology

Over the past year at MMU, I have promoted various technologies and tools to help encourage staff to get more involved with eLearning. I'm now working on a couple of posts to provide short (ish) Case Studies to exemplify real word activities and what might be achieved with technological implementations.

This first case study is about a project I led in a previous role, and have supported (to some extent) here at MMU, related to redesigning everyday business processes to manage the assessment life cycle more efficiently.


What was the Problem?

For quite some time, students have been making their views known about the efficiency (or lack thereof) of the assessment -- feedback cycle; in short, students want feedback quicker, and in a form that they can understand (opposed to unreadable hand-written feedback).

Licensed under CC-NC-ND from Flickr User UBC Library
Secondly, the economic and environmental impact, and the costs associated to printing hundreds and thousands of essays were (and are) significant. Removing this can only be seen as positive!

Strategy?

Well, a strategic decision was made by the Dean (of a Faculty in a previous role elsewhere) and other senior colleagues. The decision was that all assessments (that were suitable - mainly essays) should be managed through TurnItIn, including the submission, marking and feedback processes.
(I think if the truth be told, this strategic decision hadn't considered what would be required to actually get this working, but that's where I came in).

What did we do?

It was essential that a working group was formed to scope out and oversee the project - this multi-professional group involved academic staff, learning technology experts/managers, senior administrative staff, and academic managers (including Associate Dean for Teaching and Learning).

After initial discussions amongst the group, I worked with the Programme Team Leader and senior academic colleagues to scope out and timeline existing processes, including hand-in dates, how submissions were handled and recorded, passed to markers, moderators, etc. From this we could then identify where technology and new processes were required.

So what were the new processes?

  • All students were informed of the new processes at the beginning of the semester
  • Students were encouraged to submit a draft (but preferably a formative) piece of work to TurnItIn at least two weeks before the coursework due date. This was largely to overcome any technical barriers that inevitably occur when students submit 5 minutes before the deadline.
  • Programme team would monitor submissions within the VLE before, at, and after the deadline, and inform markers of papers to mark (this often included a number of academic staff to split large groups of students - 200+).
  • Markers would view papers in TurnItIn and use Grademark facilities to leave in-text and general comments on papers, as well as a grade.
  • Programme team would download the Gradebook and inform second markers/moderators to log in and mark/moderate.
  • Programme team could mass download papers for archiving, as well as download marks into Excel to be reformatted and uploaded to the student record system.
  • Students could retrieve marks and electronic feedback from within TurnItIn

What were the benefits of the new processes?

  • Students were no longer required to travel to campus from across the country to submit coursework
  • Easier/Quicker for staff to leave common comments on student work through developing a QuickMark set, which could be drag & dropped onto student work
  • Electronic feedback and grades much easier to understand
  • Manual handling times reduced due to electronic procedures
  • Staff didn't need to carry a small suitcase to take scripts home with them - it's all in the cloud!
  • Printing completely removed - massive economic and environmental benefits - a sample of 6 first-year units saved over 7500 sheets of paper, or 15 reams of paper!

What support was provided?

  • Specific training sessions for academic and administrative staff, including guides and screencasts
  • Guides and Screencasts for students 
  • Faculty guidelines for the use of Turnitin and Grademark
  • Assignment template for students, including front cover and pre-formatted pages

What challenges did we face?

  • A major challenge was training all Faculty staff in the workings of TurnItIn and Grademark, and informing them of the new policies. 
  • Technically, we only came across one problem - we found that at various times, Grademark facilities became really slow - so much so that it seriously hindered the ability to mark and leave feedback. Using Firefox seemed to help this a great deal though.

Where next?


Turnitin & Grademark have an interesting feature called Rubrics, which could further enhance online marking. Furthermore, the developments in relation to tablet computing could lead to some interesting pilot projects - word has it TurnItIn will be releasing a dedicated iPad app next year!



Have you used any of these tools in your teaching/learning?

Are you using technology effectively in your teaching and want to feature on a case study here?

This case study has used the JISC Case Study template as a basis.

Please use the comments section to get involved in discussion. 


Creative Commons License
This work by Peter Reed is licensed under a Creative Commons Attribution-NonCommercial 3.0 Unported License, however image work might contain alternative licenses.