e-Learning Stuff

This week on ocTEL we’re looking at assessment. As part of my thinking I refelcted on the use of quizzes in Moodle.

Designing Moodle quizzes is much more than just been able to use the quiz tool from a technical perspective. There is a real art to crafting questions so that they not only allow the learner to test their understanding, but also require a higher level of thinking.

If we look at the following multiple choice questions, the format of which is one of many different types available on Moodle, it provides the structure and the practitioner provides the question and the answers:

Which is these is a mammal?

Shark
Dog
Spider
Crocodile

This question does not test understanding, most students would be able to guess the answer or would not find it challenging. Within Bloom’s Taxonomy this is testing knowledge only, the bottom layer of the triangle.

In terms of feedback, you can design Moodle quizzes to provide feedback on questions. So you can explain why their answer is wrong or right and where to look for further information or support.

Onto a similar question:

What is the capital of Australia?

Sydney
Melbourne
Canberra
Melbourne

If we look at this question if you didn’t know the answer then you would need to do some research. However as with the previous question within Bloom’s Taxonomy this is testing knowledge only, the bottom layer of the triangle. It’s more challenging than the first question, but if you didn’t know it already then a quick Google search and you have the right answer.

So what about this question:

Which of these is the odd one out?

The “problem” with this question is that there is no single right answer. The answer needs an explanation, and it’s the explanation that demonstrates understanding of the question, not the answer.

If we look at Bloom’s Taxonomy it is possible with this question to go all the way to the top.

However Moodle will struggle with assessing a question with no “right” answer and certainly would not be able to assess the explanation.

You could provide generic feedback on why there is no “right” answer, but that may not be useful for all learners. Feedback needs to be personalised to be really effective. Students generally don’t appreciate generic feedback.

This doesn’t mean that Moodle quizzes aren’t an useful tool for checking learning, but its limitations in assessing higher order thinking needs to be considered when designing assessment.

Back in 2009 at ALT-C we had the VLE is Dead debate. My view back then hasn’t changed much in the last four years. To save you watching the video, the heart of my viewpoint was that the VLE was the core of a student’s online presence and that other tools and services would plug into that.

I was recently discussing with a group of Psychology students how they used and felt about the VLE. Their response was quite positive, they found the VLE useful and it helped them with their learning. What they also said was that they were pleased it was available. When I asked them about discussions and chat functionality, they were quick to respond that no they didn’t do this on the VLE, but were much more likely to use their “homemade” group on Facebook for those kinds of discussions. When I reminded them that learners had asked for Facebook to be blocked in the library, they replied that this didn’t matter as they preferred to use Facebook on their smartphones.

You get a picture of how they were using different online environments and tools to support their learning. They were making choices about which tools they preferred and those that they didn’t. The students could have created a group on our Mahara site, but they preferred to use a familiar tool such as Facebook.

The question we might want to ask is how do we “assess” these discussions or even access them? Another question might be, do we need to?

If students are using a Facebook group for discussions, should we be trying to impose restrictions on their choices and make them discuss course related stuff on the VLE rather than in a closed group on a different service? Or should we focus on the importance of discussing over the importance of the platform?

In face to face discussions, these do take place in a classroom or seminar, however the vast majority happen elsewhere, whether that be in the refectory, the coffee shop, the library, at home, in the workplace or while travelling. Can we be surprised that online discussions also take place outside the “offical” discussion forums?

One of the common themes that comes out when people discuss how to use Moodle, is the inevitable scroll of death.

As you start to use Moodle and create a course for the first time., you add a title, add a label describing the course and then you add a link to file, a link to the forum, some quizzes, a wiki, an assignment, then another. Before long you will have a long list of resources, the inevitable “scroll of death”.

From a learner’s perspective this is a long list of links, no context and not really an engaging and interactive learning experience. It will be more challenging to use Moodle, it won’t be intuitive. The end result will be disengaged learners and people saying that Moodle is “boring”, why can’t it be more like Facebook, Twitter or Google+?

If you are reflective and ask learners for feedback, when you next build a Moodle course, hopefully you will think about whole course design and not build merely a list of links. However years of talking to educators I have found that they rarely talk about whole course design, they are more worried about what they are going to teach tomorrow, or at best next week. They may well have a scheme of work, but that doesn’t mean that it’s useful or they stick to it.

This short-term planning often resulted in the resources been posted to Moodle without any thinking about the context or the impact this approach will have over the whole course.

Now at this point we mustn’t dismiss this approach entirely. It’s often seen as a good thing that we see learning on the VLE, however this doesn’t mean that when you find just a list of resources means that there is no learning happening. It may be happening in the classroom, in the workshop, the workplace, the resources are merely a starting point or a catalyst for learning.

An unplanned approach to curriculum design, combined with a interface flaw within Moodle, means that you are more likely to end up with the “scroll of death” than anything else. If you throw into that mix all the resources that are used over a course, there could be lots of them, probably much more so than any kind of interactive activity, then is it any wonder that when used extensively, most Moodle courses have the “scroll of death”. I know that when I was planning lessons I would have many kinds of resources to support the activities, there may anything up to ten resources for any one activity or assignment. This can quite easily lead to a “scroll of death”.

Another aspect to consider is that the VLE in most FE Colleges (and Universities) is used more often to support, enhance and enrich delivery in the classroom or the lecture theatre. It’s more rare for the VLE to be used for the delivery of learning on its own. Support often means resources, as opposed to a series of learning activities.

Having said all that there is no excuse for the “scroll of death” with a little planning, it’s quite easy to not only avoid it, but add context to any resources and activities, so making the VLE an engaging and useful experience for learners.

Interesting Examples of Technology Enhanced Learning – ocTEL

Probably the most interesting example of TEL for me at the moment is the MOOC, but probably not in the way you would expect.

What interests me about MOOCs is the hype surrounding them and a belief that they will have a significant impact on the HE sector. Some have been saying that MOOCs are to HE, in the same way that Napster was to the music industry. I am less confident in that view, but I do wonder (as someone who works in formal education) if I am thinking as a record company rather than an innovator.

The thing is that over the last few years there have been a fair few ideas and technologies that people have talked about as revolutionising education.

Go back to the 1990s and lots of people back then were talking about how online learning and VLEs were going to revolutionise education. Fast forward to today and VLEs are embedded in a fair few educational organisations (and used intermittently in others) however the VLE is in the main used to enhance and enrich an existing educational experience. You still have traditional classroom and lecture theatre delivery, but there is support, communication tools, extra resources and activities on the VLE that allow for a more personalised and individual learning experience. Rarely will you see a course delivered wholly on the VLE and where you do, it’s usually by an organisation that was doing that kind of remote learning before with paper.

In 2006 many people were talking about mobile learning (oh and still are) and how mobile devices were going to break apart traditional education delivery allowing learning to happen at a time and place to suit the learner. Fast forward again and what we find is that mobile devices are again in the main used to enhance and enrich an existing educational experience. Learners use mobile devices to access additional information and resources, as well as communicate. Services such as Twitter which work well on mobile devices allows back channel communication and sharing of resources and links. You aren’t seeing in the mainstream whole courses designed to be delivered on a mobile device. Some subject areas have made good use of mobile learning, but as with the VLE, the real strength of mobile has been to add value to a traditional learning experience.

Go back just a few years and everyone was talking about the PLE (Personal Learning Environment), how every learner could create their own learning environment, how Web 2.0 tools could take learning outside not just the institutional VLE, but also allow learning in communities and add an element of social learning. At a simple level, in a PLE, a learner would use a range of web based tools and services to create their own learning environment, engaging with learning communities across a range of institutions. Though that is happening today, it certainly isn’t mainstream.

I don’t see mainstream education using the PLE concept, yes individuals are pushing it and encouraging their learners to engage with web tools and services, but the PLE revolution that was talked about, just hasn’t happened and the term is rarely referred to or mentioned today in discussions about learning technologies. Certainly I don’t think I have seen the term PLE in any of the discussions in this MOOC.

In many ways I do think that MOOC is similar to what we have seen before. A lot of people evangelise how this “concept” will revolutionise education and cause traditional institutions to change. Personally I don’t see that happening.

In many ways MOOCs for me are an evolution of the PLE. By adding content and structure to the PLE you get a MOOC.

So will MOOCs revolutionise education in the same way that Napster changed the music industry?

What needs to be remembered is that there were lots of other services at that time, as well as other technologies, it wasn’t just Napster that had an impact on the music industry. Well maybe we should look whether it was just Napster, in many ways I think mp3 and the iPod (and iTunes) had a bigger impact. Also where is Napster now, the original Napster concept that is? It’s gone.

MOOCs will change education, the fact we are talking and discussing them implies that this will feed into how we work and support learning. But is it Napster? I don’t think it is.

Having avoided taking part in a MOOC since they became the latest fad, I have now taken the plunge and enrolled on the ALT ocTEL MOOC.

So who am I?

What do I want?

I have been working with using technology in learning since the early 1990s.

Prior to that I used technology as a learner. I remember sending e-mail in 1987 at the University of York and getting “flamed” by a technical administrator at Brunel University for sending the “wrong” kind of e-mail.

I also recall a friend of mine at University creating (what today we would call) a social network on the VAX system, it was very similar to Facebook! That VAX system was also my first introduction to WordPerfect.

After a few different things I settled down as a Business Studies and Economics teacher at colleges in the South West. It was in this role that I started to make use of various technologies to enhance my learners experiences. This started with using DTP programmes such as PagePlus to create engaging handouts, Freelance Graphics (and an early version of Powerpoint) to print off acetates for use with an OHP (no projectors back then). I made my own VLE (okay a website) back in 1998 to enable my learners to access links and resources and have discussions. Due to the sort of things I was doing I started doing a lot of staff development, helping staff at City of Bristol College where I was working to gain new skills in using technology to enhance learning.

From there, apart from working in a museum for a while, I worked for a consortium of FE Colleges all using a common VLE, TekniCAL’s Virtual Campus. Following five years there I got a job at Gloucestershire College as ILT & Learning Resources Manager.

In this role I am responsible for the strategic direction in the use of technology to support learning, the VLE, mobile learning, libraries, use of ebooks, digital and online resources and a fair few other things too.

Over the last few years I have been researching and looking at the use of ebooks and also mobile learning.

Have always had an holistic approach to embedding the use of technology, lets get everyone moving forward and where possible try and avoid shiny things unless they help and support learning. Okay yes I do have an iPad.