The defining question.
Posted: July 2, 2013 Filed under: Education, Opinion | Tags: advocacy, community, education, educational problem, ethics, feedback, higher education, in the student's head, reflection, student perspective, teaching, teaching approaches, thinking, tools, workload Leave a commentThere has been a lot going on for me recently. A lot of thinking, a lot of work and an amount of getting involved in things because my students trust me and will come to me to ask questions, which sometimes puts me in the uncomfortable position of having to juggle my accommodation for the different approaches of my colleagues and my own beliefs, as well as acting in everyone’s best interests. I’m not going to go into details but I think that I can summarise my position on everything, as an educator, by phrasing it in one question.
Is this course of action to the student’s benefit?
I mean, that’s it, isn’t it? If the job is educating students and developing the citizens of tomorrow, then everything that we do should be to the benefit of the student and/or future graduate. But it’s never simple, is it, because the utilitarian calculus to derive benefit quickly becomes complicated when we consider the effect of institutional reputation or perception on the future benefit to the student. But maybe that’s over thinking things (gasp, I hear regular readers cry). I’m not sure I know how to guide student behaviour to raise my University’s ranking in various measures – but I do know how to guide student behaviour to reduce the number of silly or thoughtless things they do, to enhance their learning and to help them engage. Maybe the simple question is the best? Will the actions I take today improve my students’ knowledge or enhance their capacity to learn? Have I avoided wasting their time doing something that we do because we have always done it, rather than giving them something to do because it is what we should be doing? Am I always considering the benefit to the largest group of students, while considering the needs of the individual?
Every time I see a system that has a fixed measure of success, people optimise for it. If it’s maximum profit, people maximise profit. If it’s minimum space, people cut their space. Guidelines help a lot in working out which course of action to take: when faced with a choice between A and B, choose the option that maximises your objective. This even works without a strong vision of the future, which is good because I’m not sure we have a clear enough view of the long path to graduation to really be specific about this. There is always a risk that people will get the assessment of benefit wrong, which can lead to soft marking or lax standards, but I’m not a believer that post hoc harshness is the solution to inherited laxity from another system (especially where that may be a perception that’s not grounded in reality). Looking at all of my actions in terms of a real benefit, to the student, to their community, to our equality standards, to our society – that shines a bright light on what we do so we can clearly see what we’re doing and, if it requires change, illuminates the path to change.
Let’s not turn “Chalk and Talk” into “Watch and Scratch”
Posted: July 1, 2013 Filed under: Education | Tags: advocacy, authenticity, blogging, community, curriculum, design, education, educational problem, educational research, ethics, feedback, higher education, moocs, principles of design, reflection, resources, teaching, teaching approaches, tools, universal principles of design 1 CommentWe are now starting to get some real data on what happens when people “take” a MOOC (via Mark’s blog). You’ll note the scare quotes around the word “take”, because I’m not sure that we have really managed to work out what it means to get involved in a course that is offered through the MOOC mechanism. Or, to be more precise, some people think they have but not everyone necessarily agrees with them. I’m going to list some of my major concerns, even in the face of the new clickstream data, and explain why we don’t have a clear view of the true value/approaches for MOOCs yet.
- On-line resources are not on-line courses and people aren’t clear on the importance of an overall educational design and facilitation mechanism. Many people have mused on this in the past. If all the average human needed was a set of resources and no framing or assistive pedagogy then our educational resources would be libraries and there would be no teachers. While there are a number of offerings that are actually courses, applying the results of the MIT 6.002x to what are, for the most part, unstructured on-line libraries of lecture recordings is not appropriate. (I’m not even going to get into the cMOOC/xMOOC distinction at this point.) I suspect that this is just part of the general undervaluing of good educational design that rears its head periodically.
- Replacing lectures with on-line lectures doesn’t magically improve things. The problem with “chalk and talk”, where it is purely one-way with no class interaction, is that we know that it is not an effective way to transfer knowledge. Reading the textbook at someone and forcing them to slowly transcribe it turns your classroom into an inefficient, flesh-based photocopier. Recording yourself standing in front a class doesn’t automatically change things. Yes, your students can time shift you, both to a more convenient time and at a more convenient speed, but what are you adding to the content? How are you involving the student? How can the student benefit from having you there? When we just record lectures and put them up there, then unless they are part of a greater learning design, the student is now sitting in an isolated space, away from other people, watching you talk, and potentially scratching their head while being unable to ask you or anyone else a question. Turning “chalk and talk” into “watch and scratch” is not an improvement. Yes, it scales so that millions of people can now scratch their heads in unison but scaling isn’t everything and, in particular, if we waste time on an activity under the illusion that it will improve things, we’ve gone backwards in terms of quality for effort.
- We have yet to establish the baselines for our measurement. This is really important. An on-line system us capable of being very heavily tracked and it’s not just links. The clickstream measurements in the original report record what people clicked on as they worked with the material. But we can only measure that which is set up for measurement – so it’s quite hard to compare the activity in this course to other activities that don’t use technology. But there are two subordinate problems to this (and I apologise to physicists for the looseness of the following) :
- Heisenberg’s MOOC: At the quantum scale, you can either tell where something is or what it is doing – the act of observation has limits of precision. Borrowing that for the macro scale: measure someone enough and you’ll see how they behave under measurement but the measurements we pick tend to fall into the stage they’ve reached or the actions they’ve taken. It’s very complex to combine quantitative and qualitative measures to be able to map someone’s stage and their comprehension/intentions/trajectory. You don’t have to accept arguments based on the Hawthorne Effect to understand why this does not necessarily tell you much about unobserved people. There are a large number of people taking these courses out of curiosity, some of whom already have appropriate qualifications, with only 27% the type of student that you would expect to see at this level of University. Combine that with a large number of researchers and curious academics who are inspecting each other’s courses, I know of at least 12 people in my own University taking MOOCs of various kinds to see what they’re like, and we have the problem that we are measuring people who are merely coming in to have a look around and are probably not as interested in the actual course. Until we can actually shift MOOC demography to match that of our real students, we are always going to have our measurements affected by these observers. The observers might not mind being heavily monitored and observed, but real students might. Either way, numbers are not the real answer here – they show us what but there is still too much uncertainty in the why and the how.
- Schrödinger’s MOOC: Oh, that poor reductio ad absurdum cat. Does the nature of the observer change the behaviour of the MOOC and force it to resolve one way or another (successful/unsuccessful)? If so, how and when? Does the fact of observation change the course even more than just in enrolments and uncertainty of validity of figures? The clickstream data tells us that the forums are overwhelmingly important to students, with 90% of people who viewed threads without commenting, and only 3% of total students enrolled every actually posted anything in a thread. What was the make-up of that 3% and was it actual students or the over-qualified observers who then provided an environment that 90% of their peers found useful?
- Numbers need context and unasked questions give us no data: As one example, the authors of the study were puzzled that so few people had logged in from China, which surprised them. Anyone who has anything to do with network measurement is going to be aware that China is almost always an outlier in network terms. My blog, for example, has readers from around the world – but not China. It’s also important to remember that any number of Chinese network users will VPN/SSH to hosts outside China to enjoy unrestricted search and network access. There may have been many Chinese people (who didn’t self-identify for obvious reasons) who were using proxies from outside China. The numbers on this particular part of the study do not make sense unless they are correctly contextualised. We also see a lack of context in the reporting on why people were doing the course – the numbers for why people were doing it had to be augmented from comments in the forum that people ‘wanted to see if they could make it through an MIT course’. Why wasn’t that available from the initial questions?
- We don’t know what pass/fail is going to look like in this environment. I can’t base any MOOC plans of my own on how people respond to a MIT-branded course but it is important to note that MIT’s approach was far more than “watch and scratch”, as is reflected by their educational design in providing various forms of materials, discussions forums, homework and labs. But still, 155,000 people signed up for this and only 7,000 received certificates. 2/3 of people who registered then went on to do nothing. I don’t think that we can treat a success rate of less than 5% as a success rate. Even where we say that 2/3 dropped out, this still equates to a pass rate under 14%. Is that good? Is that bad? Taking everything into account from above, my answer is “We don’t know.” If we get 17% next time, is that good or bad? How do we make this better?
- The drivers are often wrong. Several US universities have gone on the record to complain about undermining their colleagues and have refused to take part in MOOC-related activities. The reasons for this vary but the greatest fear is that MOOCs will be used to reduce costs by replacing existing lecturing staff with a far smaller group and using MOOCs to handle the delivery. From a financial argument, MOOCs are astounding – 155,000 people contacted for the cost of a few lecturers. Contrast that with me teaching a course to 100 students. If we look at it from a quality perspective, and dealing with all of the points so far, we have no argument to say that MOOCs are as good as our good teaching – but we do know that they are easily as good as our bad teaching. But from a financial perspective? MOOC is king. That is, however, not how we guarantee educational quality. Of course, when we scale, we can maintain quality by increasing resources but this runs counter to a cost-saving argument so we’re almost automatically being prevented from doing what is required to make the large scale course work by the same cost driver that led to its production in the first place!
- There are a lot of statements but perhaps not enough discussion. These are trying times for higher education and everyone wants an edge, more students, higher rankings, to keep their colleagues and friends in work and, overall, to do the right thing for their students. Senior management, large companies, people worried about money – they’re all talking about MOOCs as if they are an accepted substitute for traditional approaches – at the same time as we are in deep discussion about which of the actual traditional approaches are worthwhile and which new approaches are going to work better. It’s a confusing time as we try to handle large-scale adoption of blended learning techniques at the same time people are trying to push this to the large scale.
I’m worried that I seem to be spending most of my time explaining what MOOCs are to people who are asking me why I’m not using a MOOC. I’m even more worried when I am still yet to see any strong evidence that MOOCs are going to provide anything approaching the educational design and integrity that has been building for the past 30 years. I’m positively terrified when I see corporate providers taking over University delivery before we have established actual measurable quality and performance guidelines for this incredibly important activity. I’m also bothered by statements found at the end of the study, which was given prominence as a pull quote:
[The students] do not follow the norms and rules that have governed university courses for centuries nor do they need to.
I really worry about this because I haven’t yet seen any solid evidence that this is true, yet this is exactly the kind of catchy quote that is going to be used on any number of documents that will come across my desk asking me when I’m going to MOOCify my course, rather than discussing if and why and how we will make a transition to on-line blended learning on the massive scale. The measure of MOOC success is not the number of enrolees, nor is it the number of certificates awarded, nor is it the breadth of people who sign up. MOOCs will be successful once we have worked out how to use this incredibly high potential approach to teaching to deliver education at a suitably high level of quality to as many people as possible, at a reduced or even near-zero cost. The potential is enormous but, right now, so is the risk!
Another semester, more lessons learned (mostly by me).
Posted: June 16, 2013 Filed under: Education, Opinion | Tags: advocacy, authenticity, collaboration, community, curriculum, design, education, educational problem, educational research, ethics, feedback, Generation Why, higher education, in the student's head, learning, plagiarism, principles of design, reflection, resources, student perspective, teaching, teaching approaches, thinking, tools, universal principles of design Leave a commentI’ve just finished the lecturing component for my first year course on programming, algorithms and data structures. As always, the learning has been mutual. I’ve got some longer posts to write on this at some time in the future but the biggest change for this year was dropping the written examination component down and bringing in supervised practical examinations in programming and code reading. This has given us some interesting results that we look forward to going through, once all of the exams are done and the marks are locked down sometime in late July.
Whenever I put in practical examinations, we encounter the strange phenomenon of students who can mysteriously write code in very short periods of time in a practical situation very similar to the practical examination, but suddenly lose the ability to write good code when they are isolated from the Internet, e-Mail and other people’s code repositories. This is, thank goodness, not a large group (seriously, it’s shrinking the more I put prac exams in) but it does illustrate why we do it. If someone has a genuine problem with exam pressure, and it does occur, then of course we set things up so that they have more time and a different environment, as we support all of our students with special circumstances. But to be fair to everyone, and because this can be confronting, we pitch the problems at a level where early achievement is possible and they are also usually simpler versions of the types of programs that have already been set as assignment work. I’m not trying to trip people up, here, I’m trying to develop the understanding that it’s not the marks for their programming assignments that are important, it’s the development of the skills.
I need those people who have not done their own work to realise that it probably didn’t lead to a good level of understanding or the ability to apply the skill as you would in the workforce. However, I need to do so in a way that isn’t unfair, so there’s a lot of careful learning design that goes in, even to the selection of how much each component is worth. The reminder that you should be doing your own work is not high stakes – 5-10% of the final mark at most – and builds up to a larger practical examination component, worth 30%, that comes after a total of nine practical programming assignments and a previous prac exam. This year, I’m happy with the marks design because it takes fairly consistent failure to drop a student to the point where they are no longer eligible for redemption through additional work. The scope for achievement is across knowledge of course materials (on-line quizzes, in-class scratchy card quizzes and the written exam), programming with reference materials (programming assignments over 12 weeks), programming under more restricted conditions (the prac exams) and even group formation and open problem handling (with a team-based report on the use of queues in the real world). To pass, a student needs to do enough in all of these. To excel, they have to have a good broad grasp of theoretical and practical. This is what I’ve been heading towards for this first-year course, a course that I am confident turns out students who are programmers and have enough knowledge of core computer science. Yes, students can (and will) fail – but only if they really don’t do enough in more than one of the target areas and then don’t focus on that to improve their results. I will fail anyone who doesn’t meet the standard but I have no wish to do any more of that than I need to. If people can come up to standard in the time and resource constraints we have, then they should pass. The trick is holding the standard at the right level while you bring up the people – and that takes a lot of help from my colleagues, my mentors and from me constantly learning from my students and being open to changing the learning design until we get it right.
Of course, there is always room for improvement, which means that the course goes back up on blocks while I analyse it. Again. Is this the best way to teach this course? Well, of course, what we will do now is to look at results across the course. We’ll track Prac Exam performance across all practicals, across the two different types of quizzes, across the reports and across the final written exam. We’ll go back into detail on the written answers to the code reading question to see if there’s a match for articulation and comprehension. We’ll assess the quality of response to the exam, as well as the final marked outcome, to tie this back to developmental level, if possible. We’ll look at previous results, entry points, pre-University marks…
And then we’ll teach it again!
The Continuum of Ethical Challenge: Why the Devil Isn’t Waiting in the Alleyway and The World is Harder than Bioshock.
Posted: June 15, 2013 Filed under: Education, Opinion | Tags: advocacy, authenticity, community, curriculum, design, education, educational research, ethics, feedback, Generation Why, higher education, in the student's head, learning, principles of design, reflection, student perspective, teaching, teaching approaches, thinking Leave a commentThis must be a record for a post title but I hope to keep the post itself shortish. Years ago, when I was still at school, a life counsellor (who was also a pastor) came to talk to us about life choices and ethics. He was talking about the usual teen cocktail: sex, drugs and rebellion.. However, he made an impression on me by talking about his early idea of temptation. Because of the fire and brimstone preaching he’d grown up with, he half expected temptation to take the form of the Devil, beckoning him into an alleyway to take an illicit drag on a cigarette. As he grew up, and grew wiser, he realised that living ethically was really a constant set of choices, interlocking or somewhat dependant, rather than an easy life periodically interrupted by strictly defined challenges that could be overcome with a quick burst of willpower.
I recently started replaying the game Bioshock, which I have previously criticised elsewhere, and was struck by the facile nature of the much-vaunted ethical aspect to game play. For those who haven’t played it, you basically have a choice between slaughtering or saving little girls – apart from that, you have very little agency or ability to change the path you’re on. In fact, rather than provide you with the continual dilemma of whether you should observe, ignore or attack the inhabitants of the game world, you very quickly realise that there are no ‘good’ people in the world (or there are none that you are actually allowed to attack, they are all carefully shielded from you) so you can reduce your ‘choices’ when encountering a figure crouching over a pram to “should I bludgeon her to death, or set her on fire and shoot her in the head”. (It’s ok, if you try anything approaching engagement, she will try and kill you.) In fact, one of the few ‘innocents’ in the game is slaughtered in front of you while you watch impotently. So your ethical engagement is restricted, at very distinctly defined intervals, to either harvesting or rescuing the little girls who have been stolen from orphanages and turned into corpse scavenging monsters. This is as ridiculous as the intermittent Devil in the alleyway, in fact, probably more so!
I completely agree with that counsellor from (goodness) 30 years ago – it would be a nonsense to assume that tests of our ethics can be conveniently compartmentalised to a time when our resolve is strong and can be so easily predicted. The Bioshock model (or models like it, such as Call of Duty 4, where everyone is an enemy or can’t be shot in a way that affects our game beyond a waggled finger and being taken back to a previous save) is flawed because of the limited extent of the impact of the choices you make – in fact, Bioshock is particularly egregious because the ‘outcome’ of your moral choice has no serious game impact except to show you a different movie at the end. Before anyone says “it’s only a game”, I agree, but they were the ones who imposed the notion that this ethical choice made a difference. Games such as Deus Ex gave you very much un-cued opportunities to intervene or not – with changes to the game world depending on what happened. As a result, people playing Deus Ex had far more moral engagement with the game and everyone I’ve spoken to felt as if they were making the choices that led to the outcome: autonomy, mastery and purpose anyone? That was in 2000 – very few games actually see the world as one that you can influence (although some games are now coming up to par on this).
I think about this a lot for my learning design. While my students may recognise ethical choices in the real world, I am always concerned that a learning design that reduces their activities to high stakes hurdle challenges will mimic the situation where we have, effectively, put the Devil in the alleyway and you can switch on your ‘ethical’ brain at this point. I posed a question to my students in their sample exam where I proposed that they had commissioned someone to write their software for an assignment – and them asked to think about the effect that this decision would have on their future self in terms of knowledge development, if we assumed that they would always be better prepared if they did the work themselves. This takes away the focus from the day or so leading up to an individual assignment and starts to encourage continuum thinking, where every action is take as part of a whole life of ethical actions. I’m a great believer that skills only develop with practice and knowledge only stays in your head when you reinforce it, so any opportunity to encourage further development of ethical thinking is to be encouraged!
“Hi, my name is Nick and I specialise in failure.”
Posted: June 10, 2013 Filed under: Education, Opinion | Tags: advocacy, collaboration, community, curriculum, design, education, educational research, ethics, failure, Generation Why, higher education, in the student's head, learning, measurement, reflection, resources, student perspective, survivorship, teaching, teaching approaches, thinking, tools Leave a commentI recently read an article on survivorship bias in the “You Are Not So Smart” website, via Metafilter. While the whole story addressed the World War II Statistical Research Group, it focused on the insight contributed by Abraham Wald, a statistician. The World War II Allied bomber losses were large, very large, and any chances of reducing this loss was incredibly valuable. The question was “How could the US improve their chances of bringing their bombers back intact?” Bombers landing back after missions were full of holes but armour just can’t be strapped willy-nilly on to a plane without it becoming land-locked. (There’s a reason that birds are so light!) The answer, initially, was obvious – find the place where the most holes were, by surveying the fleet, and patching them. Put armour on the colander sections and, voila, increased survival rate.
No, said Wald. That wouldn’t help.
Wald’s logic is both simple and convincing. If a plane was coming back with those holes in place, then the holes in the skin were not leading to catastrophic failure – they couldn’t have been if the planes were returning! The survivors were not showing the damage that would have led to them becoming lost aircraft. Wald used the already collected information on the damage patterns to work out how much damage could be taken on each component and the likelihood of this occurring during a bombing run. based on what kind of forces it encountered.
It’s worth reading the entire article because it’s a simple and powerful idea – attributing magical properties to the set of steps taken by people who have become ultra-successful is not going to be as useful as looking at what happened to take people out of the pathway to success. If you’ve read Steve Jobs’ biography then you’re aware that he had a number of interesting traits, only some of which may have led to him becoming as successful as he did. Of course, if you’ve been reading a lot, you’ll be aware of the importance of Paul Jobs, Steve Wozniak, Robert Noyce, Bill Gates, Jony Ive, John Lasseter, and, of course, his wife, Laurene Powell Jobs. So the whole “only eating fruit” thing, the “reality distortion field” thing and “not showering” thing (some of which he changed, some he didn’t) – which of these are the important things? Jobs, like many successful people, failed at some of his endeavours, but never in a way that completely wiped him out. Obviously. Now, when he’s not succeeding, he’s interesting, because we can look at the steps that took him down and say “Oh, don’t do that”, assuming that it’s something that can be changed or avoided . When he’s succeeding, there are so many other things getting in the way that depend upon what’s happened to you so far, who your friends are, and how many resources you get to play with, it’s hard to be able to give good advice on what to do.
I have been studying failure for some time. Firstly in myself, and now in my students. I look for those decisions, or behaviours, that lead to students struggling in their academic achievement, or to falling away completely in some cases. The majority of the students who come to me with a high level of cultural, financial and social resources are far less likely to struggle because, even when faced with a set-back, they rarely hit the point where they can’t bounce back – although, sadly, it does happen but in far fewer numbers. When they do fall over, it is for the same reasons as my less-advantaged students, who just do so in far greater numbers because they have less resilience to the set-backs. By studying failure, and the lessons learned and the things to be avoided, I can help all of my students and this does not depend upon their starting level. If I were studying the top 5% of students, especially those who had never received a mark less than A+, I would be surprised if I could learn much that I could take and usefully apply to those in the C- bracket. The reverse, however? There’s gold to be mined there.
By studying the borderlines and by looking for patterns in the swirling dust left by those departing, I hope that I can find things which reduce failure everywhere – because every time someone fails, we run the risk of not getting them back simply because failure is disheartening. Better yet, I hope to get something that is immediately usable, defensible and successful. Probably rather a big ask for a protracted study of failure!
Note to Self
Posted: May 19, 2013 Filed under: Education, Opinion | Tags: authenticity, community, education, educational problem, ethics, higher education, in the student's head, learning, marcus aurelius, meditations, reflection, resources, teaching, teaching approaches, thinking 3 CommentsI’ve mentioned the “Meditations” of the Emperor Marcus Aurelius before – I’ve been writing this blog for over 450 hours, I’m not sure there’s anything I haven’t mentioned except my feelings on the season finale of Doctor Who, Series 7. (Eh.) Marcus Aurelius, philosopher, statesman, Roman, and Emperor wrote twelve “books” which were apparently never meant to be published. These are the private musings, notes to self, of a thoughtful man, written stoically and Stoically. When he lectures anyone, he lectures himself. He even poses questions to parts of himself: his soul, most notably.
There is much to admire in the simplicity and purpose of Marcus Aurelius’ thoughts. They are brief, because Emperors are busy people, especially when earning titles such as Germanicus (which usually involves squashing a nation state or two). They are direct, because he is talking to himself and he needs to be honest. He repeats himself for emphasis and to indicate importance, not out of forgetfulness.
Best, he writes for himself, for clarity, for the now and without thinking of a future audience.
There is a great deal to think about in this, because if you have read “Meditations”, you will know that every page contains a gem and some pages have jewels cascading from them. Yet these are the private thoughts of a person recording ways to improve himself and to keep himself in check – while he managed the Roman empire.
When I talk about improvement, I’m always trying to improve myself. When I find fault, I’ve usually found it in myself first. Yet, what a lot of words I write! Perhaps it is time to reinvestigate brevity, directness and a generosity towards the self that translates well into a kindness to strangers who might stumble upon this. The last thing I’d want to do is to stop people finding what zircons there are because the preamble is too demanding or the journey to the point too long.
Once again, I give my thanks to the writings of someone who died 2000 years ago and gave me so much to think about. Vale, Marcus Aurelius.
The Blame Game: Things were done, mistakes were made.
Posted: May 2, 2013 Filed under: Education, Opinion | Tags: authenticity, community, education, ethics, Generation Why, higher education, in the student's head, learning, reflection, resources, student perspective, teaching, teaching approaches, work/life balance, workload 5 CommentsNote: This is a re-post of something that I put up on a student discussion forum as part of one of my first-year teaching courses. I write a number of longer posts to the students to discuss some of the things that are not strictly Computer Science but can be good to know. One of my colleagues asked me to put it up in a place where he could refer to it even after the original forum was closed, so here it is.
The Irish Central Bank recently released a 10 Euro coin with a quote from James Joyce on it. Regrettably, they got the quote wrong by inserting a ‘that’ which was not in the original quote. While this is hardly newsworthy usually, I want to draw your attention to the way that the bank handled this error.
According to the bank, the coin was “an artistic representation of the author and text and not intended as a literal representation”. In fact, “the text on the Joyce coin does not correspond to the precise text as it appears in Ulysses” and “the error is regretted”.
The error is regretted? By whom? This is a delightful example of the passive voice, frequently used because people wish to avoid associating the problem with themselves. Before this coin hit the mint, people could see the graphic design and the mistake would have been there. Was the error with the original brief, the designer, the people who should have been proofing? (The actual ‘apology’ is even worse as it says “While the error is regretted” and then goes on to try and weasel out.)
Look, the blame game is seductive because people love to allocate blame and, frankly, blame assignation is not very productive because it doesn’t fix the existing problem and, worse, it rarely fixes the future problem. However, the error (in this case) did not leap into the printing presses at the mint due to run-away nanotechnology – in this case, the producing organisation (the bank) should have said “Argh, sorry. We made a mistake.” and then gone on with the offers of refunds – but more importantly, having accepted that it was their error, they would have the mental gears engaged to make changes to stop it happening again. Right now, the bank is trying to wriggle out of a mistake, which might fool people inside the bank into thinking that this is how you deal with errors – through “after the fact” passive apology, rather than taking responsibility and doing some proper proof-reading!
Years ago, I worked with a guy whose motto was “Don’t tell me that you knew it wasn’t going to work. Tell me when you think that and tell me how we’re going to fix it.” Don’t just play the blame and “I told you so” game, be active and try to fix things!
But let’s bring this closer to home. Running late for a lecture? What happened? Was the traffic really bad – or did you not allow enough time to get there, having expected really good traffic? “The traffic was awful” is a great excuse occasionally but all the time? “I didn’t allow enough time for the traffic.” What does this mean? Allow more time! Be active! Take control (if you can). If you’re on a dire bus route, then you may have to think about other ways to deal with it – perhaps you just can’t allow enough time for the awful traffic. In that case, what do you need to do in order to get the lecture content? What do you need to let the lecturer know so that we can help you?
See the difference? If “the traffic is awful” then we have no solutions because a million cars and the Adelaide City traffic computers are beyond your control. If “I have a problem with time” then it is easier to start thinking about ways to fix this that involve you.
When you think to yourself “the assignment wasn’t completed on time”, who was actually responsible for that? Note, I’m not talking about assigning blame – I’m talking about taking responsibility. If you didn’t finish the assignment on time because you didn’t start early enough, then you have started the mental processes that lead to a potential conclusion of “Oh, I should start working on things a bit earlier.” Were you sick? Should you have organised a med cert or spoken to the lecturer?
Responsibility doesn’t have to be a burden but it does give you a reason to exercise your agency, your capacity to act and to make change in the world. If all of your problems are in the passive voice, then “assignments are handed in late”, “the money ran out”, “mistakes were made” rather than “I didn’t start early enough or put enough time in or I was horribly ill and thought I could just push through”, “I spent all of my money too quickly.” and “I made a mistake”.
Obviously, a false declaration of responsibility, where you have no intention of changing, is just as bad as weasel words in the passive voice. Saying “I made a mistake” achieves nothing unless you try and change what you’re doing to stop it happening again.
When you feel that you are responsible for something, you are more likely to devote time and effort to it. The way that you describe the things in your life can help to remind you of what you are responsible for and where you can take charge and try to bring about a positive change. Language is powerful – it can really help to focus the mind on what you need to do to get the best out of everything. Use it!
(Edit: This is now in the comments but after the original post, I linked to an article on one set of steps students could use to write a real apology. You can find it here. Thanks for the nudge, Liz!)
The Kids are Alright (within statistical error)
Posted: April 21, 2013 Filed under: Education, Opinion | Tags: blogging, community, data visualisation, design, education, educational research, ethics, feedback, Generation Why, higher education, in the student's head, learning, reflection, thinking, tools 3 CommentsYou may have seen this quote, often (apparently inaccurately) attributed to Socrates:
“The children now love luxury; they have bad manners, contempt for authority; they show disrespect for elders and love chatter in place of exercise. Children are now tyrants, not the servants of their households. They no longer rise when elders enter the room. They contradict their parents, chatter before company, gobble up dainties at the table, cross their legs, and tyrannize their teachers.” (roughly 400BC)
Apparently this is either a paraphrase of Aristophanes or misquoted Plato – like all things attributed to Socrates, we have to remember that we don’t have his signature to any of them. However, it doesn’t really matter if Socrates said it because not only did Hesiod say something in 700BC:
“I see no hope for the future of our people if they are dependent on frivolous youth of today, for certainly all youth are reckless beyond words… When I was young, we were taught to be discreet and respectful of elders, but the present youth are exceedingly wise [disrespectful] and impatient of restraint”
And then we have Peter the Hermit in 1274AD:
“The world is passing through troublous times. The young people of today think of nothing but themselves. They have no reverence for parents or old age. They are impatient of all restraint. They talk as if they knew everything, and what passes for wisdom with us is foolishness with them. As for the girls, they are forward, immodest and unladylike in speech, behavior and dress.”
(References via the Wikiquote page of Socrates and a linked discussion page.)
Let me summarise all of this for you:
You dang kids! Get off my lawn.
As you know, I’m a facty-analysis kind of guy so I thought that, if these wise people were correct and every generation is steadily heading towards mental incapacity and moral turpitude, we should be able to model this. (As an aside, I love the word turpitude, it sounds like the state of mind a turtle reaches after drinking mineral spirits.)
So let’s do this, let’s assume that all of these people are right and that the youth are reckless, disrespectful and that this keeps happening. How do we model this?
It’s pretty obvious that the speakers in question are happy to set themselves up as people who are right, so let’s assume that a human being’s moral worth starts at 100% and that all of these people are lucky enough to hold this state. Now, since Hesiod is chronologically the first speaker, let’s assume that he is lucky enough to be actually at 100%. Now, if the kids aren’t alright, then every child born will move us away from this state. If some kids are ok, then they won’t change things. Of course, every so often we must get a good one (or Socrates’ mouthpiece and Peter the Hermit must be aliens) so there should be a case for positive improvement. But we can’t have a human who is better than 100%, work with me here, and we shall assume that at 0% we have the worst person you can think of.
What we are now modelling is a random walk, starting at 100 and then adding some combination of -1, 0 or 1 at some regular interval. Let me cut to the chase and show you what this looks like, when modelled. I’ve assumed, for ease of modelling, that we make the assessment of the children every year and we have at most a 1 percentile point shift in that year, whatever other assumptions I made. I’ve provided three different models, one where the kids are terrible – we choose very year from no change or a negative shift. The next model is that the kids have some hope but sometimes do nothing, and we choose from an improvement, no change or steady moral decline! The final model is one where we either go up or down. Let’s look at a random walk across all three models over the span of years from 700BC to today:
As you can see, if we take the dire predictions of the next generation as true, then it is only a few hundred years before everything collapses. However, as expected, random walks over this range move around and hit a range of values. (Right now, you should look up Gambler’s Ruin to see why random walks are interesting – basically, over an infinite time, you’d expect to hit all of the values in the range from 0 to 100 an infinite number of times. This is why gamblers with small pots of money struggle against casinos with effectively infinite resources. Maths.)
But we know that the ‘everything is terrible’ model doesn’t work because both Socrates and Peter the Hermit consider themselves to be moral and both lived after the likely ‘decline to zero’ point shown in the blue line. But what would happen over longer timeframes? Let’s look at 20,000 and 200,000 years respectively. (These are separately executed random walks so the patterns will be different in each graph.)
What should be apparent, even with this rather pedantic exploration of what was never supposed to be modelled is that, even if we give credence to these particular commentators and we accept that there is some actual change that is measurable and shows an improvement or decline between generations, the negative model doesn’t work. The longer we run this, the more it will look like the noise that it is – and that is assuming that these people were right in the first place.
Personally, I think that the kids of this generation are pretty much the same as the one before, with some different adaptation to technology and societal mores. Would I have wasted time in lectures Facebooking if I had the chance? Well, I wasted it doing everything else so, yes, probably. (Look around your next staff meeting to see how many people are checking their mail. This is a technological shift driven by capability, not a sign of accelerating attention deficit.) Would I have spent tons of times playing games? Would I? I did! They were just board, role-playing and simpler computer games. The kids are alright and you can see that from the graphs – within statistical error.
Every time someone tells me that things are different, but it’s because the students are not of the same calibre as the ones before… well, I look at these quotes over the past 2,500 and I wonder.
And I try to stay off their lawn.
Compound Interest, False Laws and Shiny Taps
Posted: April 14, 2013 Filed under: Education, Opinion | Tags: advocacy, education, ethics, Generation Why, higher education, reflection, thinking 2 Comments(I return with a very long rant about funding cuts in higher education. Rather political so feel free to not read if you’re after my edu research and praxis stuff.)
Like most governments, the Australian Federal Government is making spending cuts at the moment. Unlike most countries, Australia is actually doing pretty well but, unfortunately, we have a federal election coming up this year and we are losing the ability to do mathematics in a sea of politics. One initiative that has just been announced is increased funding to schools in line with the Gonski review – hooray! The only problem is that they are cutting University funding to do this – wait, what? (Four different links from different news organisations, for your delectation.) School funding will go up $14.5bn over six years and, for my sector, “$2.8 billion in cuts to universities, discounts for families paying upfront HECS fees, self education tax deduction changes and converting a student scholarship scheme into a loans scheme” (from the last link). The University cuts include a $900M “University funding efficiency dividend“.
Efficiency dividend?
For those who, like me, have just seen the Australian University sector be scheduled for a 2% efficiency dividend you may have wondered “What does this actually mean?” You can read about this concept at this web site, but let me summarise it here. The efficiency dividend is defined as an ‘annual reduction in funding for the overall running costs of an agency’ so, if you were looking for a different way to say this, you might say ‘annual scheduled operational budget cut’. This is tied together with the concept of efficiency and is based on the assumption that a (public service) department will become steadily more productive over time and thus we can cut resources and still get the same level of output. Money saved here can then be used for other high priority projects. What this means to me is that we, as Universities, will get less money and must cut our resourcing but have to maintain our quality of outputs because of a staggering belief that there is some sort of dependable Moore’s Law productivity gain for public sector and quasi-government agencies – and this includes Universities. (Moore’s Law is “the observation that over the history of computing hardware, the number of transistors on integrated circuits doubles approximately every two years” – Wikipedia – and is often reinterpreted as “computers double in speed every 18 months”. Moore’s Law is actually an observation and people who use it as a reliable prediction of the future are missing the point. I note that the semiconductor industry is starting to think that the doubling rate is dropping to ever three years, which makes this even less of a “Law”.)
Let me clear up something straight away. Yes, the schools need more funds, teachers need more pay and this is essential to our future and stability as a nation. And, yes, I know the money has to come from somewhere, but if we are going to trim under the illusion of doing it along productivity maintenance lines then let us clear up some fundamental misconceptions so that we know whether we are surgically trimming or whole carcass butchering.
It’s worth reading the whole document because it contains gems such as “The efficiency dividend also recognises that the public sector does not face the same incentives as the private sector to pass on gains from increased productivity in the form of lower prices.” Well, this is true, the public service is not in competition and the same is, to a reasonable extent, still true of schools. Most students will go to a mainstream public school funded by government and determined by where they live. Some will go to private schools that still get a sizeable chunk of change from the government. It is, however, unlikely that the majority of students will migrate to a different state to attend school and, conversely, setting up competing schools is a highly regulated activity (as one would actually hope) so competition is kept at bay.
What gets cut, usually? Let me quote from the document:
The efficiency dividend is primarily applied to departmental appropriations including ‘funding for depreciation/amortisation, Departmental and Administered Capital Budgets and Collection Development Acquisition Budgets’. [21] The dividend is also applied to ‘appropriations for other expenses of a departmental outputs type nature’ and ‘funding for all new policy initiatives following the year in which the new measures are introduced into those appropriations’.[22]
Capital budgets, acquisition budgets, expenses incurred for outputs and new policy initiatives. At a time when the Federal Government is, at the same time, trying to increase the number of Australians in tertiary education and all of us a trying to work out if MOOC is some kind of long con or useful technology, a 2% cut in our ability to buy things, innovate and improve our teaching and research (our outputs) seems… odd.
It’s worth remembering that the Higher education sector is actually in a highly competitive market – at the national and international level. We face competition from other states and countries and if you think that the Group of 8 (the notional top 8 Universities in Australia) and the “almost 8s”, who are eyeing “weak” members in the group, aren’t already storing their powder and trimming sails to politely engage each other in a rather genteel multi-way replay of the battle for dominance of the trade routes, then you haven’t been paying much attention. On top of that, investment targeted at increasing international standing in the various lists is already redirecting funds. Putting on an ‘upwards trajectory’ Professor with lots of citations? Not only is that almost a no-brainer but many places will have special funds to target this. Where does that money come from? Existing staffing not being refilled, contracts not being renewed, outsourcing to a partial position at corporate rates to reduce overhead. I’m lucky in that we are not yet in the full grip of this – but take away 2% of our resource growth and development funding annually and it will be rampant soon enough. You know all of the travel I do? Almost all of the money for that comes from months or years of prior work, hard-fought competitive grants with travel components and the Uni pays for very little of it – 10 years ago they would have funded several of my trips. I’m lucky in that I got a start when the money was flowing because, right now, we’re beyond lean and mean and heading towards emaciated and angry. Yet, I come from a relatively well-off Uni with a fairly good market position. We’re only grumpy but I have colleagues at other places who are struggling to keep enough people to produce any outputs, let alone the high quality ones magically predicted by the efficiency dividend document.
And, please, let’s not forget that the vast majority of educators are already working well over allotted time, using their own resources, haven’t had real pay raises in many places for years and, in some cases, supporting their own students in order to keep education going. This is already unsustainable, for both productivity and quality of product, in the long term – making it harder isn’t sensible or in anyone’s long term interests. I’m sick of going to conferences to hear how many people have been made redundant in the past year – but it’s a deep pit of the stomach sickness because I know it’s not going to stop.
But let’s step sideways to look at a strange mechanism – the notion of fungible product. Something is fungible if units of it can be substituted. Crude oil is the common example used here – a barrel of crude is a barrel of crude. Can we make all of our products mutually substitutable, because that is one of the obvious ways that we somehow maintain the same output despite cutting back our production. If we designate the annual productivity of a government department as P, then this total productivity is made up of sub-tasks, p1…pn, which have some notional ‘benefit’. There are two ways we can increase the productivity – we can add more ‘p’s in later years, so we have pn+1 and so on, or we can increase the benefit of these sub-tasks. The productivity trade-off of the efficiency dividend assumes that, if it takes R resources to produce the ‘p’s, we can cut R by some value and somehow generate a subset of the ‘p’s that is still considered productive. However, if we had actually increased our productivity by increasing benefit (and let us assume that this maps to quality) then what we are now saying is that the cut in R means the removal of an existing service – not the removal of an added service. Now, yes, the obvious onus of this is on administrative efficiency and we can denote the administrative sub-services as ‘a’s. So P is now composed of the maximum number of ‘p’s and the minimum number of ‘a’s. Ultimately, we reduce down to one ‘a’ administrative service and we have the most efficient government department in the land – all but one of our efforts is directed at productivity. Hooray! The system works!
But this is wrong for two reasons. Firstly, the product of almost all of these areas is most certainly not fungible and we do not have a uniform value for quality, nor do we exist in a vacuum. Has it honestly been so long since “Yes Minister” that we have forgotten how important employment and transport are in marginal electorates? We don’t even have clean value propositions for those services that we wish to keep as benefit is so hard to pin down in a world where public money, public opinion and high profile representation intersect. Why are Unis being cut for schools? My dark suspicion is that this is the natural intersection of an election year and rather cynical calculation that more people have kids at schools than at Uni, hence this will please more voters. To meme for a moment, desperate government is desperate.
The second reason that this is wrong is that establishing the productivity of any given area is a highly controversial measure and tying a cut to reported productivity increases ignores any number of human factors, as well as compound interest. How long does it take a 2% annual ‘efficiency dividend’ to severely reduce the real budget? Let’s look at 25 years. After 25 years, your budget will be at 60% of its original figure. Please, stick your hand up if you provide me with a sound, evidence-based solution that will allow us to maintain the quality of the Universities with 60% of the cash. 3% per year? We’re under 50% of budget in 25 years. Managers are under pressure to report improvements in productivity but, having driven people to work harder, having already streamlined operations to do so, the reward is that, next year, it gets harder. As my colleagues in the US can tell you, there is a point at which you stop cutting fat and you start cutting flesh. In some parts of the US, they are nearly out of flesh and are using the bone saws to get at the marrow. That sound you hear from the disadvantaged states in the US is not the whistle of air escaping from the balloon, it is a straw sucking air from a hollow bone.
My friends, I am not the hardest working person I know, but I do know that I’m no longer shaking illnesses as quickly, my blood pressure is up, I don’t sleep as well and, given half a chance, I will spend the whole weekend working, only to discover that there is always six months more work ahead of me. I’m not sure I have 2% more to give – perhaps it is time I stepped aside for someone hungrier or better (or cheaper)? Will this give us the efficiency that is sought, when we remove me and my 20-odd years of educational experience, 7 at the higher ed level?
An interesting subsection of the document I’ve referred to is that exemptions are granted – either recurring or annually. Nine agencies continue to be exempt from efficiency dividends for a variety of reasons. Three are fully exempt: ABC, SBS (both broadcasters who are exempt because of election promises), Safe Work Australia (co-funded State/Fed). Six are partially exempt: CSIRO and Aust Inst of Marine Science, Australian Council of the Arts, Customs and Border Protection, ANSTO and DoD – all of whom can pretty much keep their cuts away from major operational areas because of FEAR to a large extent. (It’s always sad when xenophobia becomes one of the facets you depend upon for continued funding.)
In 2008-09, the following got a one year reprieve: Australian Trade Commission; Australian Fair Pay Commission Secretariat; Workplace Authority; Australian Prudential Regulation Authority; Australian Sports Commission
In 2012-13, another set with one year reprieves: Family Court of Australia; Federal Court of Australia; High Court of Australia; Federal Magistrates Court; Administrative Appeals Tribunal; Social Security Appeals Tribunal; National Native Title Tribunal; Migration Review Tribunal—Refugee Review Tribunal; Australian National Maritime Museum; National Gallery of Australia; National Museum of Australia; National Library of Australia; Australia Council for the Arts; Australian Film Television and Radio School; Australian Sports Commission; National Film and Sound Archive; National Archives of Australia; Old Parliament House (Museum of Australian Democracy); Screen Australia; Australian Institute of Aboriginal and Torres Strait Islander Studies; Australian War Memorial; Torres Strait Regional Authority; Aboriginal Hostels Limited; Indigenous Business Australia; Indigenous Land Corporation; Australian Communications and Media Authority.
Confusingly, if you look at that list, the entire Australian higher education sector is ranked slightly lower in priority than a vast number of bodies who depend upon our scholarship and educational infrastructure and our increasingly (and overdue) embracing of more inclusiveness and outreach into non-traditional pathways. Yes, schools need money and, yes, money has to come from somewhere, but why are we interfering with one of the receiving points of the system we’re trying to fix!
This is, frankly, silly. When you have a water crisis, you have to find the water, make it drinkable and get it to people who need it. The pipeline is a great way to do this because it centralises your maintenance expenses and works as a distribution mechanism with much lower cost than container transport – lower waste footprint as well! But building giant shiny new taps in the city does not mean that the water will just magically appear with no intervening pipeline or treatment. Neither does building an intake in the ocean automatically mean that a disconnected sink in Wagga will suddenly yield clean water. Education is a pipeline from which we can only lose students. We start with a number at the start of primary school and we’ve lost a lot (over 80%) by the time we get to University. Transitioning students into higher ed is non-trivial, retention is not guaranteed and sometimes it’s hard enough to be 17 without throwing our stuff on top. Reducing our ability to innovate is making a hard situation harder. Reducing our ability to invest for the future doesn’t just hurt us now, it hurts us for decades to come.
Education costs money and we are already well beyond the salad days fondly remembered by politicians who were last in our system 20-30 years ago. Every professor we lose takes 20-25 years of knowledge with her or him. Every teaching assistant we don’t replace increases the student-teacher ratio and this, in turn, will have an effect in the future. Every time our educational system shrinks, we reduce the outputs in terms of graduates, therefore in terms of professionals and academics, which gives us a generational problem because, on this trend, that 25 year timeframe doesn’t just give us 60% of our budget, it gives us much fewer potential staff and this just keeps happening.
Education is the core of civilisation. Education should not be a tool of class warfare, a cheap grab at votes or overseen by people who wilfully refuse to think in anything other than 3-4 year terms – and I paint all sides of politics with this brush. Get some generational focus issues going – 25 year projects with no political currency or opportunism. Yes, let’s fix up the schools, but let’s not do so in order to funnel students into work training schemes to produce cheap labour with no hope of anything beyond that. Let’s look at education as what it is – a lifelong endeavour made up of schools, communities, Universities, businesses and government working together.
Goodness knows, we’re all working hard enough already. Maybe working together might give us enough total effort to do something about this.
SIGCSE 2013: The Revolution Will Be Televised, Perspectives on MOOC Education
Posted: March 17, 2013 Filed under: Education, Opinion | Tags: advocacy, community, education, educational research, ethics, Generation Why, higher education, learning, measurement, moocs, sigcse, teaching, teaching approaches, tools 4 CommentsLong time between posts, I realise, but I got really, really unwell in Colorado and am still recovering from it. I attended a lot of interesting sessions at SIGCSE 2013, and hopefully gave at least one of them, but the first I wanted to comment on was a panel with Mehram Sahami, Nick Parlante, Fred Martin and Mark Guzdial, entitled “The Revolution Will Be Televised, Perspectives on MOOC Education”. This is, obviously, a very open area for debate and the panelists provided a range of views and a lot of information.
Mehram started by reminding the audience that we’ve had on-line and correspondence courses for some time, with MIT’s OpenCourseWare (OCW) streaming video from the 1990s and Stanford Engineering Everywhere (SEE) starting in 2008. The SEE lectures were interesting because viewership follows a power law relationship: the final lecture has only 5-10% of the views of the first lecture. These video lectures were being used well beyond Stanford, augmenting AP courses in the US and providing entire lecture series in other countries. The videos also increased engagement and the requests that came in weren’t just about the course but were more general – having a face and a name on the screen gave people someone to interact with. From Mehram’s perspective, the challenges were: certification and credit, increasing the richness of automated evaluation, validated peer evaluation, and personalisation (or, as he put it, in reality mass customisation).
Nick Parlante spoke next, as an unashamed optimist for MOOC, who has the opinion that all the best world-changing inventions are cheap, like the printing press, arabic numerals and high quality digital music. These great ideas spread and change the world. However, he did state that he considered artisinal and MOOC education to be very different: artisinal education is bespoke, high quality and high cost, where MOOCs are interesting for the massive scale and, while they could never replace artisinal, they could provide education to those who could not get access to artisinal.
It was at this point that I started to twitch, because I have heard and seen this argument before – the notion that MOOC is better than nothing, if you can’t get artisinal. The subtext that I, fairly or not, hear at this point is the implicit statement that we will never be able to give high quality education to everybody. By having a MOOC, we no longer have to say “you will not be educated”, we can say “you will receive some form of education”. What I rarely hear at this point is a well-structured and quantified argument on exactly how much quality slippage we’re tolerating here – how educational is the alternative education?
Nick also raised the well-known problems of cheating (which is rampant in MOOCs already before large-scale fee paying has been introduced) and credentialling. His section of the talk was long on optimism and positivity but rather light on statistics, completion rates, and the kind of evidence that we’re all waiting to see. Nick was quite optimistic about our future employment prospects but I suspect he was speaking on behalf of those of us in “high-end” old-school schools.
I had a lot of issues with what Nick said but a fair bit of it stemmed from his examples: the printing press and digital music. The printing press is an amazing piece of technology for replicating a written text and, as replication and distribution goes, there’s no doubt that it changed the world – but does it guarantee quality? No. The top 10 books sold in 2012 were either Twilight-derived sadomasochism (Fifty Shades of Unncessary) or related to The Hunger Games. The most work the printing presses were doing in 2012 was not for Thoreau, Atwood, Byatt, Dickens, Borges or even Cormac McCarthy. No, the amazing distribution mechanism was turning out copy after copy of what could be, generously, called popular fiction. But even that’s not my point. Even if the printing presses turned out only “the great writers”, it would be no guarantee of an increase in the ability to write quality works in the reading populace, because reading and writing are different things. You don’t have to read much into constructivism to realise how much difference it makes when someone puts things together for themselves, actively, rather than passively sitting through a non-interactive presentation. Some of us can learn purely from books but, obviously, not all of us and, more importantly, most of us don’t find it trivial. So, not only does the printing press not guarantee that everything that gets printed is good, even where something good does get printed, it does not intrinsically demonstrate how you can take the goodness and then apply it to your own works. (Why else would there be books on how to write?) If we could do that, reliability and spontaneously, then a library of great writers would be all you needed to replace every English writing course and editor in the world. A similar argument exists for the digital reproduction of music. Yes, it’s cheap and, yes, it’s easy. However, listening to music does not teach you to how write music or perform on a given instrument, unless you happen to be one of the few people who can pick up music and instrumentation with little guidance. There are so few of the latter that we call them prodigies – it’s not a stable model for even the majority of our gifted students, let alone the main body.
Fred Martin spoke next and reminded us all that weaker learners just don’t do well in the less-scaffolded MOOC environment. He had used MOOC in a flipped classroom, with small class sizes, supervision and lots of individual discussion. As part of this blended experience, it worked. Fred really wanted some honest figures on who was starting and completing MOOCs and was really keen that, if we were to do this, that we strive for the same quality, rather than accepting that MOOCs weren’t as good and it was ok to offer this second-tier solution to certain groups.
Mark Guzdial then rounded out the panel and stressed the role of MOOCs as part of a diverse set of resources, but if we were going to do that then we had to measure and report on how things had gone. MOOC results, right now, are interesting but fundamentally anecdotal and unverified. Therefore, it is too soon to jump into MOOC because we don’t yet know if it will work. Mark also noted that MOOCs are not supporting diversity yet and, from any number of sources, we know that many-to-one (the MOOC model) is just not as good as 1-to-1. We’re really not clear if and how MOOCs are working, given how many people who do complete are actually already degree holders and, even then, actual participation in on-line discussion is so low that these experienced learners aren’t even talking to each other very much.
It was an interesting discussion and conducted with a great deal of mutual respect and humour, but I couldn’t agree more with Fred and Mark – we haven’t measured things enough and, despite Nick’s optimism, there are too many unanswered questions to leap in, especially if we’re going to make hard-to-reverse changes to staffing and infrastructure. It takes 20 years to train a Professor and, if you have one that can teach, they can be expensive and hard to maintain (with tongue firmly lodged in cheek, here). Getting rid of one because we have a promising new technology that is untested may save us money in the short term but, if we haven’t validated the educational value or confirmed that we have set up the right level of quality, a few years now from now we might discover that we got rid of the wrong people at the wrong time. What happens then? I can turn off a MOOC with a few keystrokes but I can’t bring back all of my seasoned teachers in a timeframe less than years, if not decades.
I’m with Mark – the resource promise of MOOCs is enormous and they are part of our future. Are they actually full educational resources or courses yet? Will they be able to bring education to people that is a first-tier, high quality experience or are we trapped in the same old educational class divisions with a new name for an old separation? I think it’s too soon to tell but I’m watching all of the new studies with a great deal of interest. I, too, am an optimist but let’s call me a cautious one!





