Let’s Transform Education! (MOOC Hijinks Hilarity! Jinkies!)

Posted: September 1, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , , , , | 4 Comments

I had one of those discussions yesterday that every one in Higher Education educational research comes to dread: a discussion with someone who basically doesn’t believe the educational research and, within varying degrees of politeness, comes close to ignoring or denigrating everything that you’re trying to do. Yesterday’s high point was the use of the term “Mr Chips” to describe the (from the speaker’s perspective) incredibly low possibility of actually widening our entrance criteria and turning out “quality” graduates – his point was that more students would automatically mean much larger (70%) failure rates. My counter (and original point) is that since there is such a low correlation between school marks and University GPA (roughly 40-45% and it’s very noisy) that successful learning and teaching strategies could deal with an influx of supposedly ‘lower quality’ students, because the quality metric that we’re using (terminal high school grade or equivalent) is not a reliable indicator of performance. My fundamental belief is that good education is transformative. We start with the students that schools give us but good, well-constructed, education can, in the vast majority of cases, successfully educate students and transform them into functioning, self-regulating graduates. We have, as a community, carried out a lot of research that says that this works, provided that we are happy to accept that we (academics) are not by any stretch of the imagination the target demographic or majority experience in our classes, and that, please, let’s look at new teaching methods and approaches that actually work in developing the knowledge and characteristics that we’re after.

The “Mr Chips” thing is a reference to a rather sentimental account of the transformative influence of a school master, the eponymous Chips, and, by inference, using it in a discussion of the transformative power of education does cast the perception of my comments on equality of access, linked with educational design and learning systems as transformative technologies, as being seen as both naïve and (in a more personal reading) makes me uncomfortably aware that some people might think I’m talking about myself as being the key catalyst of some sort. One of the nice things about being an academic is that you can have a discussion like this and not actually come to blows over it – we think and argue for a living, after all. But I find this dismissive and rude. If we’re not trying to educate people and transform them, then what the hell are we doing? Advocating inclusion and transformation shouldn’t be seen as grandstanding – it should be seen as our job. I don’t want to be the keystone, I want systems that work and survive individuals, but that individuals can work within to improve and develop – we know this is possible and it’s happening in a lot of places. There are, however, pockets of resistance: people who are using the same old approaches out of laziness, ignorance and a refusal to update for what appear to be philosophical reasons but have no evidence to support them.

Frankly, I’m getting a little irritated by people doubting the value of the volumes of educational research. If I was dealing with people who’d read the papers, I’d be happier, but I’m often dealing with people who won’t read the papers because they just don’t believe that there’s a need to change or they refuse to accept what is in there because of a perceived difficulty in making it work. (A colleague demanded a copy of one of our papers showing the impact of our new approaches on retention – I haven’t heard from him since he got it. This probably means that he’s chosen to ignore it and is going to pretend that he never asked.) Over coffee this morning, musing on this, it occurred to me that at the same time that we’re not getting the greatest amount of respect and love in the educational research community, we’re also worried about the trend towards MOOCs. Many of our concerns about MOOCs are founded in the lack of evidence that they are educationally effective. And I saw a confluence.

All of the educational researchers who are not able to sway people inside their institutions – let’s just ignore them and surge into the MOOCs. We can still teach inside our own places, of course, and since MOOCs are free there’s no commercial conflict – but let’s take all of the research and practice and build a brave new world out in MOOC space that is the best of what we know. We can even choose to connect our in-house teaching into that system if we want. (Yes, we still have the face-to-face issue for those without a bricks-and-mortar campus, but how far could we go to make things better in terms of what MOOCs can offer?) We’re transformers, builders and creators. What could we do with the infinite canvas of the Internet and a lot of very clever people, working with a lot of very other clever people who are also driven and entrepreneurial?

The MOOC community will probably have a lot to say about this, which is why we shouldn’t see this as a hijack or a take-over, and I think it’s helpful to think of this very much as a confluence – a flowing together. I am, not for a second, saying that this will legitimise MOOCs, because this implies that they are illegitimate, but rather than keep fighting battles with colleagues and systems that can defeat 40 years of knowledge by saying “Well, I don’t think so”, let’s work with people who have already shown that they are looking to the future. Perhaps, combining people who are building giant engines of change with the people who are being frustrated in trying to bring about change might make something magical happen? I know that this is already happening in some places – but what if it was an international movement across the whole sector?

Jinkies! (Sorry, the title ran to this and I get to use a picture of a t-shirt with Velma on it!)

Relma!

The purpose of this is manifold:

  1. We get to build the systems that we want to, to deliver education to students in the best ways we know.
  2. We (potentially) help to improve MOOCs by providing strong theory to construct evidence gathering mechanisms that allow us to really get inside what MOOCs are doing.
  3. More students get educated. (Ok, maybe not in our host institutions, but what is our actual goal anyway?)
  4. We form a strong international community of educational researchers with common outputs and sharing that isn’t necessarily owned by one company (sorry, iTunesU).
  5. If we get it right, students vote with their feet and employers vote with their wallets. We make educational research important and impossible to ignore through visible success.

Now this is, of course, a pipe dream in many ways. Who will pay for it? How long will it take before even not-for-pay outside education becomes barred under new terms and conditions? Who will pay my mortgage if I get fired because I’m working on a deliberately external set of courses for students who are not paying to come to my institution?

But, the most important thing, for me, is that we should continue what has been proposed and work more and more closely with the MOOC community to develop exemplars of good practice that have strong, evidence-based outcomes that become impossible to ignore. Much as students use temporal discounting to procrastinate about their work, administrators tend to use a more traditional financial discounting when it comes to what they consider important. If it takes 12 papers and two years of study to justify spending $5,000 on a new tool or time spent on learning design – forget about it. If, however, MOOCs show strong evidence of improving student retention (*BING*), student attraction (*BING*), student engagement (*BING*) and employability – well, BINGO. People will pay money for that.

I’ve spoken before about how successful I had to be before I was tolerated in my pursuit of educational research and, while I don’t normally talk about it in detail because it smacks of hubris and I sincerely believe that I am not a role model of any kind, I  hope that you will excuse me so that I can explain why I think it’s crazy as to how successful I had to be in order to become tolerated – and not yet really believed. To summarise, I’m in three research groups, I’ve brought in (as part of a group and individually) somewhere in the order of $0.5M in one non-ed research area, I’ve brought in something like $30-50K in educational research money, I’ve published two A journals (one CS research, one CS ed), two A conferences (both ed) and one B conference (ed/CS) and I have a faculty level position as an Associate Dean and I have a national learning and teaching presence. All of the things on that line – that’s 2012. 2011 wasn’t quite as successful but it wasn’t bad by any stretch of the imagination. I think that’s an unreasonably high bar to pass in order to be allowed the luxury of asking questions about what it is that we’re doing with learning and teaching. But if I can leverage that to work with other colleagues who can then refer to what we’ve done in a way that makes administrators and managers accept the real value of an educational revolution – then my effort is shared over many more people and it suddenly looks like a much better investment of my time.

This is more musing that mission, I’m afraid, and I realise that any amount of this could be shot down but I look forward to some discussion!

 

 

Warning: Objects in Mirror May Appear Important Because They Appear Closer

Posted: August 31, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , | 1 Comment

I had an interesting meeting with one of my students who has been trying to allocate his time to various commitments, including the project that he’s doing with me. He had been spending most of his time on an assignment for another course and, while this assignment was important, I had to carry out one of the principle duties of the supervisor: pointing out the obvious when people have their face pressed too close to the window, staring at the things that are close.

There are three major things a project supervisor does: kick things off and give some ideas, tell the student when they’re not making good progress and help them to get back on track, and stop them before they run off into the distance and get them to write it all down as a thesis of some sort.

So, in our last meeting, I asked the student how much the other assignment was worth.

“About 10%.”

How much is your project work in terms of total courses?

“4 courses worth.”

So the project is 40 times the value of that assignment that has taken up most of your time? What’s that – 4,000%?

…

To his credit, he has been working along and it’s not too late yet, by any stretch of the imagination, but a little perspective is always handy. He has also started to plan his time out better and, most rewardingly, appreciates the perspective. This, to be honest, is the way that I like it: nothing bad has happened, everyone’s learned something. Hooray!

I sometimes wonder if it’s one of the crucial problems that we face as humans. Things that are close look bigger, whether optically because of how eyes work or because of things that are due tomorrow seem to have so much more importance than much, much bigger tasks due in four weeks. Oh, we could start talking about exponential time distributions or similar things but I prefer the comparison with the visual illusion.

Just because it looks close doesn’t mean it’s the biggest thing that you have to worry about.

Some close things are worth worrying about, however.

Six Heads Are Better Than One

Posted: August 30, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , | Leave a comment

We had the final project one group feedback session today for the Grand Challenges course. Lots of very impressive posters, as I would have expected with all the work we’ve done on them, but the best outcome was the quality and quantity of useful feedback from the group. There were a number of useful suggestions that identified key improvements to each of the posters.

The framing was important: look at the poster, then discuss how we could improve the presentation, or the underlying analysis. We went through the group in a variety of sequences to get the feedback, so that the last word generally belonged to a different person each time, as did the first. My voice was heard a fair bit, no surprise, but some of the best solutions came from the students, without question.

One of the grand challenges is the formation of a community that can solve the problems and the importance of inter-disciplinary cooperation. By providing an atmosphere where everyone’s voice can be heard, and having the rare opportunity to be able to run a course like this, I’ve been able to demonstrate exactly why this is so important.

Put simply, by yourself you make think of some amazing things, but a group view, with appropriate preparation and framing, will give you the extra things that you didn’t think of – the things that other people will see and, down the track, you might even kick yourself because you didn’t see it.

I don’t want to single out any of the students, because they’re all doing great things, but this is one that’s the closest to completion at the moment. There’s work to do, because the group suggestions put some really good ideas on the table, but the big advantage is that the producer (Heya, M!) was open to suggestions from his peer group and, of course, contributed as much to his peers – including offering to help people develop their expertise in the D3/JavaScript programming combination he used to make this.

250 Internet Maps, a lot of work by a PhD student, a postdoc, several lecturers and a rather busy Grand Challenges student: one picture of the awe-inspiring randomness that is the Internet.

I’m very happy with the progress that these students are made in terms of their knowledge development but also in terms of their overall demonstration of the importance of collaboration and cooperation. We still have a way to go, including some of the most difficult reports and projects, and the first really big marking stage is possibly going to introduce some strain – but I’m optimistic that things will keep going along good lines because I’ve been nothing other than honest about what has to happen, what I’m trying to do and why I believe it’s important.

I think I can sleep well tonight. 🙂

Musing on scaffolding: Why Do We Keep Needing Deadlines?

Posted: August 29, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , , | 1 Comment

One of the things about being a Computer Science researcher who is on the way to becoming a Computer Science Education Researcher is the sheer volume of educational literature that you have to read up on. There’s nothing more embarrassing than having an “A-ha!” moment that turns out to have been covered 50 years and the equivalent of saying “Water – when it freezes – becomes this new solid form I call Falkneranium!”

Ahem. So my apologies to all who read my ravings and think “You know, X said that … and a little better, if truth be told.” However, a great way to pick up on other things is to read other people’s blogs because they reinforce and develop your knowledge, as well as giving you links to interesting papers. Even when you’ve seen a concept before, unsurprisingly, watching experts work with that concept can be highly informative.

I was reading Mark Guzdial’s blog some time ago and his post on the Khan Academy’s take on Computer Science appealed to me for a number of reasons, not least for his discussion of scaffolding; in this case, a tutor-guided exploration of a space with students that is based upon modelling, coaching and exploration. Importantly, however, this scaffolding fades over time as the student develops their own expertise and needs our help less. It’s like learning to ride a bike – start with trainer wheels, progress to a running-alongside parent, aspire to free wheeling! (But call a parent if you fall over or it’s too wet to ride home.)

One of my key areas of interest is self-regulation in students – producing students who no longer need me because they are self-aware, reflective, critical thinkers, conscious of how they fit into the discipline and (sufficiently) expert to be able to go out into the world. My thinking around Time Banking is one of the ways that students can become self-regulating – they manage their own time in a mature and aware fashion without me having to waggle a finger at them to get them to do something.

Today, R (postdoc in the  Computer Science Education Research Group) and I were brainstorming ideas for upcoming papers over about a 2 hour period. I love a good brainstorm because, for some time afterwards, ideas and phrases come to me that allow me to really think about what I’m doing. Combining my reading of Mark’s blog and the associated links, especially about the deliberate reduction of scaffolding over time, with my thoughts on time management and pedagogy, I had this thought:

If imposed deadlines have any impact upon the development of student timeliness, why do we continue to need them into the final year of undergraduate and beyond? When do the trainer wheels come off?

Now, of course, the first response is that they are an administrative requirement, a necessary evil, so they are (somehow) exempt from a pedagogical critique. Hmm. For detailed reasons that will go into the paper I’m writing, I don’t really buy that. Yes, every course (and program) has a final administrative requirement. Yes, we need time to mark and return assignments (or to provide feedback on those assignments, depending on the nature of the assessment obviously). But all of the data I have says that not only do the majority of students hand up on the last day (if not later), but that they continue to do so into later years – getting later and later as they progress, rather than earlier and earlier. Our administrative requirement appears to have no pedagogical analogue.

So here is another reason to look at these deadlines, or at least at the way that we impose them in my institution. If an entry test didn’t correlate at all with performance, we’d change it. If a degree turned out students who couldn’t function in the world, industry consultation would pretty smartly suggest that we change it. Yet deadlines, which we accept with little comment most of the time, only appear to work when they are imposed but, over time, appear to show no development of the related skill that they supposedly practice – timeliness. Instead, we appear to enforce compliance and, as we would expect from behavioural training on external factors, we must continue to apply the external stimulus in order to elicit the appropriate compliance.

Scaffolding works. Is it possible to apply a deadline system that also fades out over time as our students become more expert in their own time management?

I have two days of paper writing on Thursday and Friday and ‘m very much looking forward to the further exploration of these ideas, especially as I continue to delve into the deep literature pile that I’ve accumulated!

Marcus Aurelius: Says It All, Really.

Posted: August 28, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , | Leave a comment

I’m reading Marcus Aurelius’ Meditations, which I read years ago but had the opportunity to pick up again for $8.33. (Woohoo, cheap Penguins!) The book is full of great thoughts and aphorisms but there are three, from Book 12, that have always appealed to me:

13, How absurd – and a complete stranger to the world – is the man who is surprised at any aspect of his experience in life!

15, The light of a lamp shines on and does not lose its radiance, until it is extinguished. Will then the truth, justice, and self-control which fuel you fail before your own end?

17, If it is not right, don’t do it; if it is not true, don’t say it.

I feel 13 a lot – and it’s rather embarrassing because I am often surprised by the world but I suspect that’s because I’m in my own head a lot. 15 is something I’ve said before, in different ways and never as elegantly, and it’s a great image.

17, however, says it all to me. It’s incredibly, naïvely simple but that is part of its appeal. It is probably one of the greatest maxims for teaching, in terms of commitment, in terms of content and in terms of bravery when faced with the choice of presenting something that you know to be true – and something that you’ve been told to teach.

Marcus Aurelius  was an Emperor, philosopher (philosopher king, even, a reputation he gained in his own life time) and the Emperor Hadrian, his sponsor, had a special nickname for him – “Verissimus”, the most true. Herodian wrote: “he gave proof of his learning not by mere words or knowledge of philosophical doctrines but by his blameless character and temperate way of life.”

I spoke earlier this week of champions. It’s nice to read Marcus Aurelius and be reminded of how many amazing thinkers have been contributing to our shared literary legacy over 2000 years.

“If it is not right, don’t do it; if it is not true, don’t say it.”

Vale, Neil Armstrong (or, What Happened to my Moon Base?)

Posted: August 27, 2012 | Author: | Filed under: Education, Opinion | Tags: , , , , , , , , , , , , , , | Leave a comment

Neil Alden Armstrong, the first human to set foot on the Moon, has left us at the age of 82. I don’t remember the moonwalk although, as a baby, I was placed in front of the television to ‘watch’ as, on July 21st, we walked on another world. Growing up, of course, it quickly became apparent that we didn’t go to the Moon anymore, the last walk being when I was 4ish. Apollo 17, the last mission, was in December, 1972, and the planned Apollos (out to 20) were scrubbed. Yes, we got Skylab up into orbit and that was really exciting, as were the docking missions, but it wasn’t THE MOON.

(The Silence are standing behind the large Moon to the rear.)

But we were still in space! After all, it was only 8 years later that we all watched as the Space Shuttles started to go into the sky. Well, we were in space. It was obvious that other countries were doing things as well (for those who didn’t grow up with this, it’s fair to say that the USA and USSR didn’t get on for a while so information sharing was limited and often heavily propagandised by both parties) but that glorious shuttle, climbing up into the sky, had taken the baton and we even (finally) managed to get a space station in orbit that was bigger than a breadbox. But, by Moon shot comparisons, it wasn’t quite in the same league.

Now, I’m not for a moment suggesting that space travel has been the best use of our time and money but, goodness, has it been inspirational! We’ve developed some amazing things along the way and we’ve learned a great deal about ourselves – one of which, sadly, is that the future that I am living is not the future that I thought I would inhabit.

Growing up, I made a number of assumptions, based on the talk of the time and the books I read (a lot of which were science fiction) and, looking back on it now, these ideas were very inspirational. Growing up in the England of the early-mid 70s (a cold, lean and unpleasant place) having heroes from space was an important thing for me to have. The messages from the real-life stories of achievement (we went to the Moon! We’re getting rid of smallpox! We’re pushing back disease!) were, and still are, an important part of me. Even where we had dystopia presented to us, it was in order to learn. (The Earth has finite resources, for example, so perhaps we should be living within our means a little better – this is the message of so many works from the mid-late 20th century.)

An Eagle Transporter from the UK television series Space:1999. Note almost complete lack of aerodynamic features, including wing-based control surfaces, because (wait for it) there is no air on the Moon!

But, of course, we have no moon base. We have carried out an incredible and technologically staggering feat to gently drop the new Mars explorer on Mars – but there are no people there. I’m not sure how many times we’ll go back there and my fear is that, within 10 years, we abandon that too. But we aren’t just losing space. A number of our achievements in the face of disease and social equality, for example, are being undermined by deliberate dissemination of disinformation and the shameful exploitation of fear and ignorance.

Sadly, at least some of the people who read this will scoff at the idea that we even went to the Moon. “You rube,” they’re thinking, “Everyone knows it was a giant hoax and cover-up.” The same thing applies to vaccines, where the human failing regarding probability and modelling comes to the fore and the fearful and anecdotal are treasured over the science. Don’t even get me started on the climate change denial movement.

Is this our fault? As scientists did we presume too much in our certainty and, after so many mistakes, have we earned this distrust? Frankly, while scientists have been responsible for some shameful acts of wilful destruction or negligence, I don’t think we deserve to be viewed in such a harsh light. What I believe we’re seeing is the snake oil merchant at its finest – preying on the weak, undermining reality for their own ends, looking into the near term future of the wallet rather than the long term future of us all.

What scares me is that we may be losing our knowledge. That the simplest of ideas in science, that you collect and observe evidence in order to allow you to confirm or contradict your hypotheses, is being overrun by a mad dash towards a certainty based on wilful ignorance where you only see the evidence that agrees with your hypothesis, after the fact, and truth be damned. Should we be spending the money required to go back to the Moon? Perhaps not as it is a lot of money and, goodness knows, we have things to spend it on. But if our reason for not going back to the Moon is that we lack the drive, the imagination, the tenacity or the vision to achieve it – then we are in serious trouble.

People sometimes ask me how many students I need to have in my classroom in order to deliver a lecture. I like to have 80-95%, of course, but my answer is always the same: one. I will not consider it a waste of my time if I spend an hour with a student discussing the ideas and sharing knowledge with them. I want my students to be imaginative, driven, to be able to hang on like a terrier as they search for the truth and to understand that the search for knowledge is important – so I have to try to live that. I have to live it all the time because, all too often, there are too many examples of people ignoring the truth for a comfortable lie, for being famous for being famous, for being famous for being thoughtlessly reactive (shock jock, anyone), for changing their minds for political expediency, for outright lying, and for only valuing quantities and dollars rather than people and knowledge.

What gets me out of bed in the morning is my own set of heroes: my wife, my friends, those in my family who have overcome adversity, the real educators who do their job because they have to and because of their deep and enduring relationship with knowledge, the stars in my firmament. I looked to my own heroes growing up and those heroes wouldn’t have let the world resemble “Silent Running”, “Soylent Green” or “The Omega Man” – they, like me, wanted our children to grow up in a better world. Those films of the 60s and 70s were the product of SF writers looking forward and saying “We don’t want this.” In the absence of vision, in the attack upon science and in the minimisation of majestic and inspirational events, we get ever closer to these stinking, diseased, dying worlds that should only ever exist in our nightmares.

The green in this still from Silent Running is, in theory, almost all of what is left of Earth’s greenery. Not very large, is it?

I grew up thinking that “Silent Running”, a movie where companies ordered the destruction the last of Earth’s biomass because it was too expensive to keep, was hyperbole – at most a cautionary tale. Now, every day, I get out of bed to try and educate a new generation of scientists so that we don’t accidentally or deliberately end up going over exactly that precipice. Thought is the greatest tool that we have and, like any tool, it can work for us and against us. Guiding thought along constructive paths is challenging and it always helps to have a large and visible goal to aim for: navigators need stars or ships get lost.

We need champions. We need champions so large that even our other champions look to them – we need ideas so beautiful and so huge and so captivating that the vast majority of people, when exposed to them, roll up their sleeves and say “I can help.” We need people for your children to aspire to be, because of what they did, not who they are. However, while we have many champions, the giant blazing comets that I had growing up are all dying or dead and it makes me very sad. Yes, there is incredible achievement going on and there are many, many great stories but what does the future look like to someone growing up now?

My future was full of moon bases, flying cars, leisure time, robots, everyone well fed, no war, gender and race equality – what’s our scorecard looking like?

Soon there will be no-one left who walked on the moon. After 2099, there will probably be no-one alive when we did walk on the moon. What happens to the accounts of the Moon then? How long before it becomes a myth? How long before the real footage gets mixed up with Hollywood movies – or the MTV Logo becomes the 22nd century’s view of what happened on the Moon?

Of course, there is no real need to go back to the Moon. There are many other things that we can usefully do with that money and, ethically, we probably should. In terms of inspiration, it’s hard to beat, but that just makes it a challenge to find a problem that is equally big and put it together in a way that we can all see the rightness of it.

If you’ve read this far, thank you, but I have an additional favour to ask of you. This week, if possible, I’d like you to find an extra something, somewhere, that puts an extra champion into your life or into the life of someone else. It doesn’t have to be a person, it just has to be a star to set a course by. Something to look up to in high seas to know why you’re going where you’re going and that the risk is worth it. Have you told one of your living champions how much they mean to you? Have you made the time to share your (I know, precious) time and knowledge with someone else? Can you pin a picture of Hypatia to your pinboard? Rosa Parks? Jon Snow? Curie? Lister? Brunel? da Vinci? The SS Great Britain? Euler? Gauss? Florey? The Wrights? The 1902 Glider or the Wright Flyer 1? Crick/Watson/Franklin (bonus points if you have them in a wrestling ring wearing Luchador masks)? A Crab Canon? Telemann? Steve Kardynal?

“Reserve your right to think, for even to think wrongly is better than not to think at all,” Hypatia of Alexandria.

Have you taken your champion out of your head and told everyone else about them? When we landed on the Moon a vast number of us looked up and, for one moment, we all shared the same vision.

Neil Armstrong lived a good life, one that was useful and surprisingly humble given what he achieved and the position in which he found himself, but he’s gone now and we need more people and inspiration to fill the gap that he left. We need to look up once more.

The Most Terrifying Compliance: The Inert Student

Posted: August 25, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , | 3 Comments

I’ve been doing a lot with schools recently – enough that I won’t be identifying any particular students with this next post – and I’ve had an opportunity to see how students react when they haven’t yet made it into Uni. My first-years are a pretty energetic lot and, for the most part, it’s more of a challenge to get them to stop talking than to get them to start. (Part of that might be me, I’m un petite peu de Energiser Bunny.)

Captured using a laser flash and 1/100000 second shutter.

What I saw in some of the school-aged children was the same: bouncy, participating, not quite getting the filter going between brain and mouth. All the good energy that I can work with, use in collaboration and build upon to teach. Culturally, of course, this varies wildly and some of my students from other cultures would rather be electrocuted than say something in class. (Note: No evidence to support this exists, nor have we even applied for ethics approval for this.) So what these differently-acculturated students often do is… nothing. (When they first come to u.s)

They just sit there. Ask them a question. They say nothing. You have to wait it out. Eventually, they’ll say something and doing this, with care, over time brings them into the collaborative zone where we can really start to work. What is interesting, however, is that they are still (if you watch carefully) involved in the class. They take notes. They discuss things between themselves, to a degree. They’re doing something – they just aren’t that keen on answering questions. That’s ok, I can deal with that.

However, there’s a more advanced form of doing nothing which I’ll talk about now, because it bothers me.

What chilled me the first time that I saw it was the students who actually do nothing. And, by this, I mean nothing at all. In between answering questions, if they answered to any degree, they sit there and they’re not surfing the internet, doodling, talking or doing anything else. They will sit, still, looking into space, for up to an hour. Maybe two. No apparent registration. Can talk. Can communicate well. But don’t. (Note: I’m not talking about isolated students, I’m talking about students grouped by school.)

I would really like to believe that they are thinking about other things but, especially in a space that is active, that is engaging other students, that is full of the sound of discussion, laughter and enjoyment… this inertia is terrifying.

In my experience these students are terribly polite. If you tell them to do something then they will. But step away or give them a moment and they stop doing anything. My apologies to the teachers in the space who are nodding wisely (if this is just a thing that I don’t often see) but all of my students do something else when they’re not doing what I ask them to do – even if it’s sleeping. I’m not sure I’ve ever seen one sit there politely, staring into space, not doing anything that could get them into trouble but, because they don’t want to participate, not actually doing anything.

As far as I could tell, this wasn’t a cultural issue but what it does make me wonder is if I had run across compliant students from a particular school rather than interested students. After all, as I’ve said several times, I get the results of the Year 12 filter: the ones who really have behavioural issues don’t make it to me. The ones who couldn’t sit still, yelled out, played up – if they couldn’t rein it in then I don’t see them.

When some teachers receive a letter offering an opportunity for students to come to something or to bring them to something where I come to the school, do I see the ones that should be coming, or the ones that won’t embarrass the school?

I have no real idea how to even think about this but I sincerely hope that this inertia is an accidental construct and not something that has been engineered as anything desirable. Yes, iconoclasts and heretics can be really, really irritating to teach but – oh! the potential rewards to us and the rest of the world! More importantly, considerate behaviour to peers and educators does not start and stop with mindless and silent compliance.

Let’s hope that this was an unfortunate juxtaposition of very shy people who will all contact me later to ask me more – once they’ve thought about it. Because I’d really prefer that suggestion to the idea that there are schools out there who are engineering these kinds of zombies and sending them along just because they’ll sit still.

I’m happy for “The Midwich Cuckoos” to remain fictional.

Musing on MOOCs

Posted: August 24, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , | 1 Comment

Mark Guzdial’s blog contains a number of posts where he looks at Massive Open On-line Courses (MOOCs) but a recent one on questionable student behaviour made me think about how students act and, from the link where students sign up multiple times so that they can accumulate a ‘perfect’ score for one of their doppelgängers, why a student would go to so much trouble in a course. As the post that Mark refers to asks, is this a student retaking the course/redoing an assignment until they achieve mastery (which is highly desirable) or are they recording their attempts and finding the right answer through exhausting the search space (which is not productive and starts to look like cheating, if it isn’t actually cheating – it’s certainly against the terms of service of the courses.)

Why is this important? It’s important because MOOCs look great in terms of investment and return. Set up a MOOC and you can have 100,000 students enrol! One instructor, maybe a handful of TAs, some courseware – 100,000 students! (Some of the administrators in my building have just had to break out the smelling salts at the thought of income to expenditure ratio.) Of course, this assumes that we’re charging, which most don’t just for participation although you may get charged a fee for anything that allows you to derive accreditation. It also assumes that 100,000 students turns into some reasonable number of completions, which it also doesn’t and, as has been discussed elsewhere, plagiarism/copying is a pretty big problem.

Hang on. The course is free. It’s voluntary to sign-up to in the vast majority of cases. Why are people carrying out this kind of behaviour in a voluntary, zero-cost course? One influence is possible future accreditation, where students regard their previous efforts as a dry-run to get a high percentage outcome on a course from a prestigious institution. I’ll leave those last two words hanging there while I talk about James Joyce for a moment.

If you know of James Joyce, or you’ve read any James Joyce, you may be able to guess the question that I’m about to ask.

“Have you read and finished Ulysses?”

Joyce’s Ulysses is regarded as one of the best English-language novels of the 20th Century. However, at over 250,000 words long (that’s longer than the longest Harry Potter, by the way, and about half the count of Lord of the Rings) , full of experimental techniques, complexity and a stream-of-consciousness structure, it isn’t exactly accessible to a vast number of readers. But, because it is widely regarded as a very important novel, it is often a book that people are planning to read. Or, having started, that they plan to finish.

However, the number of people that have actually read Ulysses, all the way through and reading every word, is probably quite small. The whole ‘books I claim to have read’ effect is discussed reasonably often. From that link:

Asked if they had ever claimed to read a book when they had not, 65% of respondents said yes and 42% said they had falsely claimed to have read Orwell’s classic [1984] in order to impress. This is followed by Tolstoy’s War and Peace (31%), James Joyce’s Ulysses (25%) and the Bible (24%).

So, having possibly neither started nor finished, they claim that they have read it, because of the prestige of the work. 42% of people claim to, but haven’t read 1984, which, compared to Ulysses, is positively a pamphlet – a bus ticket aphorism in terms of relative length and readability. And we see that the other three books on the list are large, long and somewhat ponderous. (Sorry, Tolstoy, but we don’t all get locked into our dachas for 6 months when it snows.) 1984, of course, is in the public eye because of the ‘Big Brother’ associations and the on-going misinterpretation of the work as predictive, rather than as an insightful and brooding reflection of Eric’s dislike of the BBC and post-war London. (Sorry, that’s a bit glib, but I’m trying to keep it short.)

I have read Ulysses but I think it fair to say that I read it, and forced myself to complete it, for entirely the wrong reasons. Now that I enjoy the work of the Modernists far more, I’m planning to return to Ulysses and see how much I enjoy the journey this time – especially as I shall be reading it for my own reasons. But, the first time, I read it and completed it because of the prestige of the work and because I wanted to see what all the fuss was about. (Hint: it’s about a day in Dublin.)

I think there’s an intersection between the mindset that would make you claim to read a book that you had not, for reasons of prestige rather than purely for tribal membership, and that required to take a MOOC from Stanford, Harvard or Berkeley, and to falsify your progress by copying answers from other people or by solemnly duplicating your identities to accumulate enough answers to be able to ‘graduate’ summa cum laude. In this case, taking a course from one of these august institutions, especially in these days of the necessity of having a college degree for many jobs that have no professional requirement for it, is better than not. Completing assignments to a high standard, however you achieve it, may start to define your worth – this is a conjunction of prestige and tribalism that may one day allow you to become a graduate of University X (even if it is tagged as on-line or there is subsequent charging or marking load for accreditation).

And here we find our strong need for real evidence of the efficacy of the MOOC approach. Let’s assume that we solve the identity problem and can now attach work to a person reliably – how will we measure if someone is seeking mastery or is actually trying to cheat? We can ask that now – is the student who seeks questions to previous examinations testing their understanding and knowledge or conducting a brute force attack against our test bank? If MOOCs can work then the economies of scale make them a valuable tool for education but there are so many confounding factors as we try to assess these new courses: high sign-up rates with very low completion rates, high levels of plagiarism, obvious and detectable levels of gaming and all of this happening before they actually become strong alternatives to the traditional approach.

It would be easy to dismiss my comments as those of a disgruntled traditionalist but that would be wrong. What I need is evidence of what works. I have largely abandoned lectures in favour of collaborative and interactive sessions because the efficacy of the new approach became apparent – through research and evidence. Similarly for my investigation into deadlines and assessment, evidence drove me here.

If MOOCs work, then I would expect to see evidence that they do. If they don’t, then I don’t want students to sign up to something that doesn’t work, potentially at the expense of other educational opportunities that do work, any more than I want someone to stop taking their medication because someone convinces them that unverifiable alternatives are better. If MOOCs don’t quite work yet, by collecting evidence, maybe we can make them work, or part of our other courses, or produce something that benefits all of us.

It’s not about tradition or exclusivity, it’s about finding what works, which is all about collecting evidence, constructing hypotheses and testing them. Then we can find out what actually works.

More Thoughts on Partnership: Teacher/Student

Posted: August 23, 2012 | Author: | Filed under: Education, Opinion | Tags: , , , , , , , , , , , , , , , | Leave a comment

I’ve just received some feedback on an abstract piece that is going into a local educational research conference. I talked about the issues with arbitrary allocation of deadlines outside of the framing of sound educational design and about how it fundamentally undermines any notion of partnership between teacher and student. The responses were very positive although I’m always wary when people staring using phrases like “should generate vigorous debate around expectations of academics” and “It may be controversial, but [probably] in a good way”. What interests me is how I got to the point of presenting something that might be considered heretical – I started by just looking at the data and, as I uncovered unexpected features, I started to ask ‘why’ and that’s how I got here.

When the data doesn’t fit your hypothesis, it’s time to look at your data collection, your analysis, your hypothesis and the body of evidence supporting your hypothesis. Fortunately, Bayes’ Theorem nicely sums it up for us: your belief in your hypothesis after you collect your evidence is proportional to how strongly your hypothesis was originally supported, modified by the chances of seeing what you did given the existing hypothesis. If your data cannot be supported under your hypothesis – something is wrong. We, of course, should never just ignore the evidence as it is in the exploration that we are truly scientists. Similarly, it is in the exploration of our learning and teaching, and thinking about and working on our relationship with our students, that I feel that we are truly teachers.

All your Bayes are belong to us. (Sorry.)

Once I accepted that I wasn’t in competition with my students and that my role was not to guard the world from them, but to prepare them for the world, my job got easier in many ways and infinitely more enjoyable. However, I am well aware that any decisions I make in terms of changing how I teach, what I teach or why I teach have to be based in sound evidence and not just any warm and fuzzy feelings about partnership. Partnership, of course, implies negotiation from both sides – if I want to turn out students who will be able to work without me, I have to teach them how and when to negotiate. When can we discuss terms and when do we just have to do things?

My concern with the phrase “everything is negotiable” is that it, to me, subsumes the notions that “everything is equivalent” and “every notion is of equal worth”, neither of which I hold to be true from a scientific or educational perspective. I believe that many things that we hold to be non-negotiable, for reasons of convenience, are actually negotiable but it’s an inaccurate slippery slope argument to assume that this means that we  must immediately then devolve to an “everything is acceptable” mode.

Once again we return to authenticity. There’s no point in someone saying “we value your feedback” if it never shows up in final documents or isn’t recorded. There’s no point in me talking about partnership if what I mean is that you are a partner to me but I am a boss to you – this asymmetry immediately reveals the lack of depth in my commitment. And, be in no doubt, a partnership is a commitment, whether it’s 1:1 or 1:360. It requires effort, maintenance, mutual respect, understanding and a commitment from both sides. For me, it makes my life easier because my students are less likely to frame me in a way that gets in the way of the teaching process and, more importantly, allows them to believe that their role is not just as passive receivers of what I deign to transmit. This, I hope, will allow them to continue their transition to self-regulation more easily and will make them less dependent on just trying to make me happy – because I want them to focus on their own learning and development, not what pleases me!

One of the best definitions of science for me is that it doesn’t just explain, it predicts. Post-hoc explanation, with no predictive power, has questionable value as there is no requirement for an evidentiary standard or framing ontology to give us logical consistency. Seeing the data that set me on this course made me realise that I could come up with many explanations but I needed a solid framework for the discussion, one that would give me enough to be able to construct the next set of analyses or experiments that would start to give me a ‘why’ and, therefore, a ‘what will happen next’ aspect.

 

Reflection on Work Load: I may have been too convincing

Posted: August 22, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , | Leave a comment

I’m a bit of a hypocrite when it comes to taking my own advice on exercise. “Start easy,” I say, as I come back from injury with a fast 10 mile run. “Don’t over do it!” I admonish as I try to lift my own body weight in a gym. I have two knee surgeries, multiple calf strains and a torn plantar fascia to bear witness to this. For this, and many other reasons, I have a personal training for the gym stuff who I see once a week and a running partner who (facetiously) threatens to slap me if I run too hard or too far. I’m more scared of her than I am my personal trainer but don’t tell her that.

To fit everything in, I train in the gym at 6am on Wednesdays and, while this gives me a long day it allows me to get some good core and upper body work in to balance my legs and overall fitness – strength is useful in many ways as a day-to-day thing but balance, the other effect of good core strength, is incredibly useful and makes me a much better runner. I also take the opportunity to talk to someone who doesn’t work with me, isn’t related to me and knows what I do, but not in much detail. It’s very relaxing to talk to someone like that, especially when you have things on your mind.

Time Banking has been on my mind, as has my own time management, so I’ve talked a lot about making my life more effective, working less and working better, all those good things. So imagine my surprise when my trainer wrote to me asking if we could move sessions a little, if possible, as he’d been listening to what I’d been saying and realised that he’d been working reactively by not allowing himself enough time to plan and structure his day, especially as he’s now managing the gym I train at.

I’ve been thinking about changing away from the Wednesday 6 slot and this means that this is great timing for me. I’d like to keep training with him but I could train with someone else who doesn’t have his burdens or schedule quite easily and still have a really good experience – I’ve trained with other people before there, it’s a good gym. But what I really like is the thought process – contemplative and transformative.

Now, either this is the greatest con job that I’ve been privy to or I may have actually helped someone else to see a new way of thinking about their own life. Either way, there appears to be some knowledge transfer going on.

One person at a time. It’s slow but I can work with that. 🙂

 

← Older Entries
Newer Entries →