When Does Failing Turn You Into a Failure?
Posted: December 17, 2012 Filed under: Education, Opinion | Tags: advocacy, authenticity, blogging, ci2012, community, conventicle, curriculum, design, education, educational research, ethics, feedback, Generation Why, grand challenge, higher education, icer2012, in the student's head, learning, principles of design, reflection, research, resources, student perspective, teaching, teaching approaches, thinking, tools, workload Leave a commentThe threat of failure is very different from the threat of being a failure. At the Creative Innovations conference I was just at, one of the strongest messages there was that we learn more from failure than we do from success, and that failure is inevitable if you are actually trying to be innovative. If you learn from your failures and your failure is the genuine result of something that didn’t work, rather than you sat around and watched it burn, then this is just something that happens, was the message from CI, and any other culture makes us overly-cautious and risk averse. As most of us know, however, we are more strongly encouraged to cover up our failures than to celebrate them – and we are frequently better off not trying in certain circumstances than failing.
At the recent Adelaide Conventicle, which I promise to write up very, very soon, Dr Raymond Lister presented an excellent talk on applying Neo-Piagetian concepts and framing to the challenges students face in learning programming. This is a great talk (which I’ve had the good fortune to see twice and it’s a mark of the work that I enjoyed it as much the second time) because it allows us to talk about failure to comprehend, or failure to put into practice, in terms of a lack of the underlying mechanism required to comprehend – at this point in the student’s development. As part of the steps of development, we would expect students to have these head-scratching moments where they are currently incapable of making any progress but, framing it within developmental stages, allows us to talk about moving students to the next stage, getting them out of this current failure mode and into something where they will achieve more. Once again, failure in this case is inevitable for most people until we and they manage to achieve the level of conceptual understanding where we can build and develop. More importantly, if we track how they fail, then we start to get an insight into which developmental stage they’re at.
One thing that struck me with Raymond’s talk, was that he starts off talking about “what ruined Raymond” and discussing the dire outcomes promised to him if he watched too much television, as it was to me for playing too many games, and it is to our children for whatever high tech diversion is the current ‘finger wagging’ harbinger of doom. In this case, ruination is quite clearly the threat of becoming a failure. However, this puts us in a strange position, because if failure is almost inevitable but highly valuable if managed properly and understood, what is it about being a failure that is so terrible? It’s like threatening someone that they’ll become too enthusiastic and unrestrained in their innovation!
I am, quelle surprise, playing with words here because to be a failure is to be classed as someone for whom success is no longer an option. If we were being precise, then we would class someone as a perpetual failure or, more simply, unsuccessful. This is, quite usually, the point at which it is acceptable to give up on someone – after all, goes the reasoning, we’re just pouring good money after bad, wasting our time, possibly even moving the deck chairs on the Titanic, and all those other expressions that allow us to draw that good old categorical line between us and others and put our failures into the “Hey, I was trying something new” basket and their failures into the “Well, he’s just so dumb he’d try something like that.” The only problem with this is that I’m really not sure that a lifetime of failure is a guaranteed predictor of future failure. Likely? Yeah, probably. So likely we can gamble someone’s life on it? No, I don’t believe so.
When I was failing courses in my first degree, it took me a surprisingly long time to work out how to fix it, most of which was down to the fact that (a) I had no idea how to study but (b) no-one around me was vaguely interested in the fact that I was failing. I was well on my way to becoming a perpetual failure, someone who had no chance of holding down a job let alone having a career, and it was a kind and fortuitous intervention that helped me. Now, with a degree of experience and knowledge, I can look back into my own patterns and see pretty much what was wrong with me – although, boy, would I have been a difficult cuss to work with. However, failing, which I have done since then and I will (no doubt) do again, has not appeared to have turned me into a failure. I have more failings than I care to count but my wife still loves me, my friends are happy to be seen with me and no-one sticks threats on my door at work so these are obviously in the manageable range. However, managing failure has been a challenging thing for me and I was pondering this recently – how people deal with being told that they’re wrong is very important to how they deal with failing to achieve something.
I’m reading a rather interesting, challenging and confronting, article on, and I cannot believe there’s a phrase for this, rage murders in American schools and workplaces, which claims that these horrifying acts are, effectively, failed revolts, which is with Mark Ames, the author of “Going Postal” (2005). Ames seems to believe that everything stems from Ronald Reagan (and I offer no opinion either way, I hasten to add) but he identifies repeated humiliation, bullying and inhumane conditions as taking ordinary people, who would not usually have committed such actions, and turning them into monstrous killing machines. Ames’ thesis is that this is not the rise of psychopathy but a rebellion against breaking spirit and the metaphorical enslavement of many of the working and middle class that leads to such a dire outcome. If the dominant fable of life is that success is all, failure is bad, and that you are entitled to success, then it should be, as Ames says in the article, exactly those people who are most invested in these cultural fables who would be the most likely to break when the lies become untenable. In the language that I used earlier, this is the most awful way to handle the failure of the fabric of your world – a cold and rational journey that looks like madness but is far worse for being a pre-meditated attempt to destroy the things that lied to you. However, this is only one type of person who commits these acts. The Monash University gunman, for example, was obviously delusional and, while he carried out a rational set of steps to eliminate his main rival, his thinking as to why this needed to happen makes very little sense. The truth is, as always, difficult and muddy and my first impression is that Ames may be oversimplifying in order to advance a relatively narrow and politicised view. But his language strikes me: the notion of the “repeated humiliation, bullying and inhumane conditions”, which appears to be a common language among the older, workplace-focused, and otherwise apparently sane humans who carry out such terrible acts.
One of the complaints made against the radio network at the heart of the recent Royal Hoax, 2DayFM, is that they are serial humiliators of human beings and show no regard for the general well-being of the people involved in their pranks – humiliation, inhumanity and bullying. Sound familiar? Here I am, as an educator, knowing that failure is going to happen for my students and working out how to bring them up into success and achievement when, on one hand, I have a possible set of triggers where beating down people leads to apparent madness, and at least part of our entertainment culture appears to delight in finding the lowest bar and crawling through the filth underneath it. Is telling someone that they’re a failure, and rubbing it in for public enjoyment, of any vague benefit to anyone or is it really, as I firmly believe, the best way to start someone down a genuinely dark path to ruination and resentment.
Returning to my point at the start of this (rather long) piece, I have met Raymond several times and he doesn’t appear even vaguely ruined to me, despite all of the radio, television and Neo-Piagetian contextual framing he employs. The message from Raymond and CI paints failure as something to be monitored and something that is often just a part of life – a stepping stone to future success – but this is most definitely not the message that generally comes down from our society and, for some people, it’s becoming increasingly obvious that their inability to handle the crushing burden of permanent classification as a failure is something that can have catastrophic results. I think we need to get better at genuinely accepting failure as part of trying, and to really, seriously, try to lose the classification of people as failures just because they haven’t yet succeeded at some arbitrary thing that we’ve defined to be important.
Taught for a Result or Developing a Passion
Posted: December 13, 2012 Filed under: Education | Tags: advocacy, authenticity, blogging, Bloom, community, curriculum, design, education, educational problem, educational research, ethics, feedback, Generation Why, grand challenge, higher education, learning, measurement, MIKE, PIRLS, PISA, principles of design, reflection, research, resources, student perspective, teaching, teaching approaches, thinking, tools, universal principles of design, workload Leave a commentAccording to a story in the Australian national broadcaster, the ABC, website, Australian school children are now ranked 27th out of 48 countries in reading, according to the Progress in International Reading Literacy Study, and that a quarter of Australia’s year 4 students had failed to meet the minimum standard defined for reading at their age. As expected, the Australian government has said “something must be done” and the Australian Federal Opposition has said “you did the wrong thing”. Ho hum. Reading the document itself is fascinating because our fourth graders apparently struggle once we move into the area of interpretation and integration of ideas and information, but do quite well on simple inference. There is a lot of scope for thought about how we are teaching, given that we appear to have a reasonably Bloom-like breakdown on the data but I’ll leave that to the (other) professionals. Another international test, the Program for International School Assessment (PISA) which is applied to 15 year olds, is something that we rank relatively highly in, which measures reading, mathematics and science. (And, for the record, we’re top 10 on the PISA rankings after a Year 4 ranking of 27th. Either someone has gone dramatically wrong in the last 7 years of Australian Education, or Year 4 results on PIRLS doesn’t have as much influence as we might have expected on the PISA).We don’t yet have the results for this but we expect it out soon.
What is of greatest interest to me from the linked article on the ABC is the Oslo University professor, Svein Sjoberg, who points out the comparing educational systems around the globe is potentially too difficult to be meaningful – which is a refreshingly honest assessment in these performance-ridden and leaderboard-focused days. As he says:
“I think that is a trap. The PISA test does not address the curricular test or the syllabus that is set in each country.
Like all of these tests, PIRLS and PISA measure a student’s ability to perform on a particular test and, regrettably, we’re all pretty much aware, or should be by now, that using a test like this will give you the results that you built the test to give you. But one thing that really struck me from his analysis of the PISA was that the countries who perform better on the PISA Science ranking generally had a lower measure of interest in science. Professor Sjoberg noted that this might be because the students had been encouraged to become result-focused rather than encouraging them to develop a passion.
If Professor Sjoberg is right, then is not just a tragedy, it’s an educational catastrophe – we have now started optimising our students to do well in tests but be less likely to go and pursue the subjects in which they can get these ‘good’ marks. If this nasty little correlation holds, then will have an educational system that dominates in the performance of science in the classroom, but turns out fewer actual scientists – our assessment is no longer aligned to our desired outcomes. Of course, what it is important to remember is that the vast majority of these rankings are relative rather than absolute. We are not saying that one group is competent or incompetent, we are saying that one group can perform better or worse on a given test.
Like anything, to excel at a particular task, you need to focus on it, practise it, and (most likely) prioritise it above something else. What Professor Sjoberg’s analysis might indicate, and I realise that I am making some pretty wild conjecture on shaky evidence, is that certain schools have focused the effort on test taking, rather than actual science. (I know, I know, shock, horror) Science is not always going to fit into neat multiple choice questions or simple automatically marked answers to questions. Science is one of the areas where the viva comes into its own because we wish to explore someone’s answer to determine exactly how much they understand. The questions in PISA theoretically fall into roughly the same categories (MCQ, short answer) as the PIRLS so we would expect to see similar problems in dealing with these questions, if students were actually having a fundamental problem with the questions. But, despite this, the questions in PISA are never going to be capable of gauging the depth of scientific knowledge, the passion for science or the degree to which a student already thinks within the discipline. A bigger problem is the one which always dogs standardised testing of any sort, and that is the risk that answering the question correctly and getting the question right may actually be two different things.
Years ago, I looked at the examination for a large company’s offering in a certain area, I have no wish to get sued so I’m being deliberately vague, and it became rapidly apparent that on occasion there was a company answer that was not the same as the technically correct answer. The best way to prepare for the test was not to study the established base of the discipline but it was to read the corporate tracts and practise the skills on the approved training platforms, which often involved a non-trivial fee for training attendance. This was something that was tangential to my role and I was neither of a sufficiently impressionable age nor strongly bothered enough by it for it to affect me. Time was a factor and incorrect answers cost you marks – so I sat down and learned the ‘right way’ so that I could achieve the correct results in the right time and then go on to do the work using the actual knowledge in my head.
However, let us imagine someone who is 14 or 15 and, on doing the practice tests for ‘test X’ discovers that what is important is in hitting precisely the right answer in the shortest time – thinking about the problem in depth is not really on the table for a two-hour exam, unless it’s highly constrained and students are very well prepared. How does this hypothetical student retain respect for teachers who talk about what science is, the purity of mathematics, or the importance of scholarship, when the correct optimising behaviour is to rote-learn the right answers, or the safe and acceptable answers, and reproduce those on demand. (Looking at some of the tables in the PISA document, we see that the best performing nations in the top band of mathematical thinking are those with amazing educational systems – the desired range – and those who reputedly place great value in high power-distance classrooms with large volumes of memorisation and received wisdom – which is probably not the desired range.)
Professor Sjoberg makes an excellent point, which is that trying to work out what is in need of fixing, and what is good, about the Australian education system is not going to be solved by looking at single figure representations of our international rankings, especially when the rankings contradict each other on occasion! Not all countries are the same, pedagogically, in terms of their educational processes or their power distances, and adjacency of rank is no guarantee that the two educational systems are the same (Finland, next to Shanghai-China for instance). What is needed is reflection upon what we think constitutes a good education and then we provide meaningful local measures that allow us to work out how we are doing with our educational system. If we get the educational system right then, if we keep a bleary eye on the tests we use, we should then test well. Optimising for the tests takes the effort off the education and puts it all onto the implementation of the test – if that is the case, then no wonder people are less interested in a career of learning the right phrase for a short answer or the correct multiple-choice answer.
Core Values of Education and Why We Have To Oppose “Pranking”
Posted: December 11, 2012 Filed under: Education, Opinion | Tags: advocacy, authenticity, blogging, community, education, educational problem, ethics, feedback, Generation Why, higher education, in the student's head, learning, principles of design, reflection, resources, student perspective, teaching, teaching approaches, thinking, tools, workload 2 CommentsI’ve had a lot of time to think about education this year (roughly 400 hours at current reckoning) so it’s not surprising that I have some opinions on what constitutes the key values of education. Of course, as was noted at the Creative Innovations conference I went to, a corporate values statement is a wish list that doesn’t necessarily mean much so I’m going to talk about what I see when education is being performed well. After I’ve discussed these, I’m then going to briefly argue for why these values mean that stupid stunts (such as the Royal prank where some thoughtless DJs called up a hospital) should be actions that we identify as cruel and unnecessary interpretations of the term ‘entertainment’.
- Truth.
We start from the assumption that we only educate or train our students in what we, reasonably, assume to be the truth. We give the right answers when we know them and we admit it when we don’t. Where we have facts, we use them. When we are standing on opinion, we identify it. When we are telling a story, where the narrative matters more than the contents, we are careful to identify what we are doing and why we are doing it. We try not to deceive, even accidentally, and we do not make a practice of lying, even to spare someone’s feelings. In order to know the truth, we have to know our subject and we try to avoid blustering, derision and appealing to authority when we feel that we are being challenged.
There is no doubt that this can be hard in contentious and emerging areas but, as a primary value, it’s at the core of our educational system. Training someone to recite something that is not true, while still popular in many parts of the world, is indoctrination, not education.
- Respect.
We respect the students that we teach and, in doing this, we prepare them to respect us. We don’t assume that they are all the same, that they all learn at the same rate, that they have had all the preparation that they need for courses or our experiences, nor do assume that they can take anything that we feel inclined to fling at them. We respect them by treating them as people, as individuals, as vulnerable, emotional and potentially flawed humans. We evaluate their abilities before we test their mettle. We give them space to try again. We do all this because it then allows them, without hypocrisy or obligation, to treat us the same way. Respect of effort and of application does not demand perfection or obsession from either party.
- Fairness. We are objective in our assignment and assessment of work and generous in our interpretations when such generosity does not compromise truth or respect. We do not give false praise but we do all give all praise that is due, at the same time giving all of the notes for improvement. We strive to ensure that every student has the same high-quality and fair experience, regardless of who they are and what they do. When we define the rules, we stick to them, unless we have erred in their construction when, having fixed the rules, we then offer the best interpretation to every student. Our students acting in error or unfairly does not allow us to reciprocate in kind. The fairness of our system is not conditional upon a student being a perfect person and its strength lies in the fact that it is fair for all, regardless. What we say, we mean and what we mean, we say. A student’s results are ultimately the reflection of their own application to the course, relative to their opportunities to excel. Students are not unfairly punished because we have not bothered to work out if they are prepared for the course (which is very different from their own application of effort inside the course, which is ultimately their responsibility moderated by the unforeseen and vagaries of life), nor does the action of one student unduly influence the results of another, except where this is clearly identified and students have sufficient autonomy to control the outcome of this situation.
These stupid pranking stunts on the radio are usually considered acceptable because the person being pranked is contacted after the fact to ask if it can be broadcast. Frankly, I think this is bordering on coercive (because you risk being a bad sport if you don’t participate and I suspect that the radio stations don’t accept a simple first ‘no’) but some may disagree. (It’s worth noting that while the radio station tried to contact the nurses, they failed to get approval to broadcast.)
These pranks are, at heart, valueless lies, usually calculated to embarrass someone or expose them undertaking a given behaviour. They are neither truthful nor respectful. While this is often the high horse of pomposity (haven’t you got a sense of humour), it is important to realise that truly funny things can usually be enjoyed by everyone and that there is a world of difference between a joke that involves old friends and one that exploits strangers. The second situation just isn’t fair. The radio station is setting up a situation that is designed to elicit a response that everyone other than the victim will find amusing, because the victim is somehow funny or vulnerable. Basically, it’s unfair. You don’t get to laugh at or humiliate someone in a public forum just because you think it’s funny – didn’t we get over this in primary school? A lack of fairness often leads to situations that are coercive because we impose cultural norms, or peer-pressure, to force people to ‘go along with the joke’.
I had a student in my office recently, while another academic who happened to be my wife was helping me clear a backlog of paper, and before I discussed his final mark, I asked my wife if she would mind leaving the room. This was because there was no way I could ask the student if he minded discussing his mark with my wife in the room and not risk the situation being coercive. It’s a really simple thing to fix if you think about it. In order to respect the student’s privacy, I needed to be fair in the way that I controlled his ability to make decisions. Now I’m not worried that this student is easily coerced but that’s not my call to make – it’s not up to me to tell a student if they are going to be comfortable or not.
The Royal prank has clearly identified that that we can easily go down very dark and unexpected roads when we start to treat people as props, without sticking to the truth or respecting them enough to think about how they might feel about our actions, and that’s patently unfair. If these are our core values, and again many would disagree, then we have to stand up and object when we see them being mucked around with by our society. As educators, we have to draw a line and say that “just because you think it’s funny, doesn’t mean that you were right to do it” and we can do that and not be humourless or party-poopers. We do it because we want to allow people to still be funny, and have fun, muck around and have a joke with people that they know – because we’ve successfully trained them to know when they should stop, because we’ve correctly instilled the values of truth, respect and fairness.
“You Will Never Amount to Anything!”
Posted: December 10, 2012 Filed under: Education | Tags: advocacy, authenticity, blogging, community, curriculum, education, educational research, ethics, feedback, Generation Why, grand challenge, higher education, in the student's head, learning, led zeppelin, measurement, principal skinner, principles of design, reflection, resources, simpsons, student perspective, teaching, teaching approaches, thinking, tools, universal principles of design, work/life balance, workload Leave a commentI am currently reading “When Giants Walked the Earth: A Biography of Led Zeppelin” by Mick Wall. I won’t go into much of the detail of the book but the message presented around the four members of the group is that most of them did not have the best experiences in school and that, in at least two cases, the statements written on their reports by their teachers were profoundly dismissive. Now, it is of course entirely possible the that the Led Zep lads were, at time of leaving school, incapable of achieving anything – except that this is a total nonsense as it is quite obvious that they achieved a degree of musical and professional success that few contemplate, let alone reach.
You’ll often read this kind of line in celebrity biographies – that semi-mythical reforging of the self after having been judged and found wanting. (From a narrative perspective, it’s not all that surprising as it’s an easy way to increase the tension.) But one of the reasons that it pops up is that such a statement is so damning that it is not surprising that a successful person might want to wander back to the person who said it and say “Really?” But to claim that such a statement is a challenge (as famously mocked in the Simpsons where Principal Skinner says that these children have not future and is forced to mutter, with false bonhomie, ‘Prove me wrong, kids, prove me wrong.’) is confused at best, disingenuous and misdirecting at worst. If you want someone to achieve something, provide a clear description of the task, the means to achieve that task and then set about educating and training. No-one has ever learned brain surgery by someone yelling “Don’t open that skull” so pretending that an entire life’s worth of motivation can be achieved by telling something that they have no worth is piffle. Possibly even balderdash.
The phrase “You Will Never Amount To Anything” is, in whatever form it is uttered, a truly useless sentiment. It barely has any meaning (isn’t just being alive being something and hence amounting to a small sort of anything?) but, of course, it is not stated in order to achieve an outcome other than to place the blame for the lack of engagement with a given system squarely at the feet of the accused. You have failed to take advantage of the educational opportunities that we have provided and this is such a terminal fault, that the remaining 90% of your life will be spent in a mobile block of amber, where you will be unable to affect any worthwhile interaction with the universe.
I note that, with some near misses, I have been spared this kind of statement but I do feel very strongly that it is really not anything that you can with any credibility or useful purpose. If you happen to be Death, the Grim Reaper, then you can stand at the end of someone’s life and say “Gosh, you didn’t do a great deal did you” (although, again, what does it mean to do anything anyway?) but saying it when someone is between the ages of 16 and 20? You might be able to depend upon the statistical reliability that, if rampant success in our society is only given to 1%, 99% of the time, everyone you say “You will not be a success” will accidentally fall into that category. It’s quite obvious that any number of the characteristics that are worthy of praise in school contribute nothing to the spectacular success enjoyed by some people, where these characteristics are “sitting quietly”, “wearing the correct uniform” or “not chewing gum”. These are excellent facets of compliance and will make for citizens who may be of great utility to the successful, but it’s hard to see many business leaders whose first piece of advice to desperate imitators is “always wear shiny shoes”.
If we are talking about perceived academic ability then we run into another problem, in that there is a great deal of difference between school and University, let along school and work. There is no doubt that the preparation offered by a good schooling system is invaluable. Reading, writing, general knowledge, science, mathematics, biology, the classics… all of these parts of our knowledge and our society can be introduced to students very usefully. But to say that your ability to focus on long division problems when you are 14 is actually going to be the grand limiting factor on your future contribution to the world? Nonsense.
Were you to look at my original degree, you might think “How on Earth did this man end up with a PhD? He appears to have no real grasp of study, or pathway through his learning.” and, at the time of the degree, you’d be right. But I thought about what had happened, learned from it, and decided to go back and study again in order to improve my level of knowledge and my academic record. I then went back and did this again. And again. Because I persevered, because I received good advice on how to improve and, most importantly, because a lot of people took the time to help me, I learned a great deal and I became a better student. I developed my knowledge. I learned how to learn and, because of that, I started to learn how to think about teaching, as well.
If you were to look at Nick Falkner at 14, you may have seen some potential but a worry lack of diligence and effort. At 16, you would have seen him blow an entire year of school exams because he didn’t pay attention. At 17 he made it into Uni, just, but it wasn’t until the wheels really started to fall off that he realised that being loquacious and friendly wasn’t enough. Scurrying out of Uni with a third-grade degree into a workforce that looked at the evidence of my learning drove home that improvements were to be made. Being unemployed for most of a year cemented it – I had set myself up for a difficult life and had squandered a lot of opportunities. And that is when serendipity intervened, because the man who has the office next to me now, and with whom I coffee almost every morning, suggested that I could come back and pursue a Masters degree to make up for the poor original degree, and that I would not have to pay for it upfront because it was available as a government deferred-payment option. (Thank you, again, Kevin!)
That simple piece of advice changed my life completely. Instead of not saying anything or being dismissive of a poor student, someone actually took the time to say “Well, here’s something you could do and here’s how you do it.” And now, nearly 20 years down the track, I have a PhD, a solid career in which I am respected as an educator and as a researcher and I get to inspire and help other students. There’s no guarantee that good advice will always lead to good outcomes (and we all know about the paving on the road to Hell) but it’s increasingly obvious to me that dismissive statements, unpleasant utterances and “cut you loose” curtness are far more likely to do nothing positive at all.
If the most that you can say to a student is “You’re never going to amount to anything”, it might be worth looking in a mirror to see exactly what you’ve amounted to yourself…
AAEE 2012 – Yes, Another Conference
Posted: December 5, 2012 Filed under: Education | Tags: aaee2012, advocacy, ci2012, conventicle, education, educational research, feedback, Generation Why, higher education, in the student's head, learning, reflection, research, student perspective, teaching, teaching approaches, thinking, tools, universal principles of design 3 CommentsIn between writing up the conventicle (which I’m not doing yet), the CI Conference (which I’m doing slowly) and sleep (infrequent), I’m attending the Australasian Association for Engineering Education 2012 conference. Today, I presented a paper on e-Enhancing existing courses and, through a co-author, another paper on authentic teaching tool creation experiences.
My first paper gave me a chance to look at the Google analytics and tracking data for the on-line material I created in 2009. Since then, there have been:
- 11,118 page views
- 2.99 pages viewed/visit
- 1,721 unique visitors
- 3,715 visits overall
The other thing that is interesting is that roughly 60% of the viewers return to view the podcasts again. The theme of my talk was “Is E-Enhancement Worth It” and I had the pleasure of pointing out that I felt that it was because, as I was presenting, I was simultaneously being streamed giving my thoughts of computer networks to students in Singapore and (strangely enough) Germany. As I said in the talk and in the following discussion, the podcasts are far from perfect and, to increase their longevity, I need to make them shorter and more aligned to a single concept.
Why?
Because while the way I present concepts may change, because of sequencing and scaffolding changes, the way that I present an individual concept is more likely to remain the same over time. My next step is to make up a series of conceptual podcasts that are maybe 3-5 minutes in duration. Then the challenge is how to assemble these – I have ideas but not enough time.
One of the ideas raised today is the idea that we are seeing the rise of the digital native, a new type of human acclimatised to a short gratification loop, multi-tasking, and a non-linear mode of learning. I must be honest and say that everything I’ve read on the multi-tasking aspect, at least, leads me to believe that this new generation don’t multi-task any better than anyone else did. If they do two things, then they do them more slowly and don’t achieve the same depth: there’s no shortage of research work on this and given the limits of working memory and cognition this makes a great deal of sense. Please note, I’m not saying that I don’t believe that Homo Multiplexor can’t emerge, it’s just that I have not yet any strong scientific evidence to back up the anecdotes. I’m perfectly willing to believe that default searching activities have changed (storing ways of searching rather than the information) because that is a logical way to reduce cognitive load but I am yet to see strong evidence that my students can do two things at once well and without any loss of time. Either working memory has completely changed, which we should be able to test, or we risk confusing the appearance of doing two things at once with actually doing two things at once.
This is one of those situations that, as one of my colleagues observed, leaves us in that difficult position of being told, with great certainty, about a given student (often someone’s child) who can achieve great things while simultaneously watching TV and playing WoW. Again, I do not rule out the possibility of a significant change in humanity (we’re good at it) but I have often seen that familiar tight smile and the noncommittal nod as someone doesn’t quite acknowledge that your child is somehow the spearhead of a new parallelised human genus.
It’s difficult sometimes to express ideas like this. Compare this to the numbers I cited above. Everyone who reads this will look at those numbers and, while they will think many things, they are unlikely to think “I don’t believe that”. Yet I know that there are people who have read this and immediately snorted (or the equivalent) because they frankly disbelieve me o the multi-tasking, with no more or less hard evidence than that supporting the numbers. I’m actually expecting some comments on this one because the notion of the increasing ability of young people to multitask is so entrenched. If there is a definitive set of work supporting this, then I welcome it. The only problem is that all I can find supports the original work on working memory and associated concepts – there are only so many things you can focus on and beyond that you might be able to function but not at much depth. (There are exceptions, of course, but the 0.1% of society do not define the rule.)
The numbers are pasted straight out of my Google analytics for the learning materials I put up – yet you have no more reason to believe them than if I said “83% of internet statistics are made up”, which is a made up statistic. (If is is true, it is accidentally true.) We see again one of the great challenges in education: numbers are convincing, evidence that contradicts anecdote is often seen as wrong, finding evidence in the first place can be hard.
One more day of conference tomorrow! I can only wonder what we’ll be exposed to.
Game Design and Boredom: Learning From What I Like
Posted: November 25, 2012 Filed under: Education, Opinion | Tags: authenticity, blogging, collaboration, community, curriculum, data visualisation, design, education, games, Generation Why, higher education, in the student's head, learning, principles of design, reflection, resources, teaching, teaching approaches, thinking, tools, zombies 5 CommentsFor those of you poor deluded souls who are long term readers (or long term “receivers of e-mail that you file under the ‘read while anaesthetised’ folder”) you will remember that I talked about producing a zombie game some time ago and was crawling around the house to work out how fast you could travel as a legless zombie. Some of you (well, one of you – thanks, Mark) has even sent me appropriately English pictures to put into my London-based game. Yet, as you can see, there is not yet a game.
What happened?
The first thing I wanted to do was to go through the design process and work out if I could produce a playable game that worked well. Along the way, however, I’ve discovered a lot of about games because I have been thinking in far more detail about games and about why I like to play the games that I enjoy. To quote my previous post:
I play a number of board games but, before you think “Oh no, not Monopoly!”, these are along the lines of the German-style board games, games that place some emphasis on strategy, don’t depend too heavily on luck, may have collaborative elements (or an entirely collaborative theme), tend not to be straight war games and manage to keep all the players in the game until the end.
What I failed to mention, you might notice, is that I expect these games to be fun. As it turns out, the first design for the game actually managed to meet all of the above requirements and, yet, was not fun in any way at all. I realised that I had fallen into a trap that I am often prone to, which is that I was trying to impose a narrative over a set of events that could actually occur in any order or any way.
Ever prepared for a class, with lots of materials for one specific area, and then the class takes a sudden shift in direction (it turns out that the class haven’t assimilated a certain foundation concept) and all of that careful work has to be put away for later? Sometimes it doesn’t matter how much you prepare – life happens and your carefully planned activities get derailed. Even if you don’t get any content surprises, it doesn’t take much to upset the applecart (a fire alarm goes off, for example) and one of the signs of the good educator is the ability to adapt to continue to bring the important points to the learner, no matter what happens. Walking in with a fixed narrative of how the semester is going to roll out is unlikely to meet the requirements of all of your students and if something goes wrong, you’re stuffed (to use the delightful Australian vernacular, which seems oddly appropriate around Thanksgiving).
In my head, while putting my game together, I had thought of a set of exciting stories, rather than a possible set of goals, events and rules that could apply to any combination of players and situations. When people have the opportunity to explore, they become more engaged and they tend to own the experience more. This is what I loved about the game Deus Ex, the illusion of free will, and I felt that I constructed my own narrative in there, despite actually choosing from one of the three that was on offer on carefully hidden rails that you didn’t see until you’d played it through a few times.
Apart from anything else, I had made the game design dull. There is nothing exciting about laying out hexagonal tiles to some algorithm, unless you are getting to pick the strategy, so my ‘random starting map’ was one of the first things to go. London has a number of areas and, by choosing a fixed board layout that increased or decreased based on player numbers, I got enough variation by randomising placement on a fixed map.
I love the game Arkham Horror but I don’t play it very often, despite owning all of the expansions. Why? The set-up and pack-up time take ages. Deck after deck of cards, some hundreds high, some 2-3, have to be placed out onto a steadily shrinking playing area and, on occasion, a player getting a certain reward will stop the game for 5-10 minutes as we desperately search for the appropriate sub-pack and specific card that they have earned. The game company that released Arkham has now released iPhone apps that allow you to monitor cards on your phone but, given that each expansion management app is an additional fee and that I have already paid money for the expansions themselves, this has actually added an additional layer of irritation. The game company recognises that their system is painful but now wish to charge me more money to reduce the problem! I realised that my ‘lay out the hexes’ for the game was boring set-up and a barrier to fun.
The other thing I had to realise is that nobody really cares about realism or, at least, there is only so much realism people need. I had originally allows for players to be soldiers, scientists, police, medical people, spies and administrators. Who really wants to be the player responsible for the budgetary allocation of a large covert government facility? Just because the administrator has narrative value doesn’t mean that the character will be fun to play! Similarly, why the separation between scientists and doctors? All that means is I have the unpleasant situation where the doctors can’t research the cure and the scientists can’t go into the field because they have no bandaging skill. If I’m writing a scenario as a novel or short story, I can control the level of engagement for each character because I’m writing the script. In a randomised series of events, no-one is quite sure who will be needed where and the cardinal rule of a game is that it should be fun. In fact, that final goal of keeping all players in the game until the end should be an explicit statement that all players are useful in the game until the end.
The games I like are varied but the games that I play have several characteristics in common. They do not take a long time to set-up or pack away. They allow every player to matter, up until the end. Whether working together or working against each other, everyone feels useful. There is now so much randomness that you can be destroyed by a bad roll but there is not so much predictability that you can coast after the second round. The games I really like to play are also forgiving. I am playing some strategy games at the moment and, for at least two of them, decisions made in the first two rounds will affect the entire game. I must say that I’m playing them to see if that is my lack of ability or a facet of the game. If it turns out to be the game, I’ll stop playing because I don’t need to have a game berating me for making a mistake 10 rounds previously. It’s not what I call fun.
I hope to have some more time to work on this over the summer but, as a design exercise, it has been really rewarding for me to think about. I understand myself more and I understand games more – and this means that I am enjoying the games that I do play more as well!
Ebb and Flow – Monitoring Systems Without Intrusion
Posted: November 23, 2012 Filed under: Education | Tags: collaboration, community, curriculum, data visualisation, education, educational problem, educational research, ethics, feedback, Generation Why, higher education, in the student's head, learning, measurement, MIKE, principles of design, reflection, resources, student perspective, SWEDE, teaching, teaching approaches, thinking, tools Leave a commentI’ve been wishing a lot of people “Happy Thanksgiving” today because, despite being frightfully Antipodean, I have a lot of friends and family who are Thanksgiving observers in the US. However, I would know that something was up in the US anyway because I am missing about 40% of my standard viewers on my blog. Today is an honorary Sunday – hooray, sleep-ins all round! More seriously, this illustrates one of the most interesting things about measurement, which is measuring long enough to be able to determine when something out of the ordinary occurs. As I’ve already discussed, I can tell when I’ve been linked to a higher profile blog because my read count surges. I also can tell when I haven’t been using attractive pictures because the count drops by about 30%.

A fruit bat, in recovery, about to drink its special fruit smoothie. (Yes, this is shameless manipulation.)
This is because I know what the day-to-day operation of the blog looks like and I can spot anomalies. When I was a network admin, I could often tell when something was going wrong on the network just because of the way that certain network operations started to feel, and often well before these problems reached the level where they would trigger any sort of alarm. It’s the same for people who’ve lived by the same patch of sea for thirty years. They’ll look at what appears to be a flat sea on a calm day and tell you not to go out – because they can read a number of things from the system and those things mean ‘danger’.
One of the reasons that the network example is useful is because any time you send data through the network to see what happens, you’re actually using the network to do it. So network probes will actually consume network bandwidth and this may either mask or exacerbate your problems, depending on how unlucky you are. However, using the network for day-today operations, and sensing that something is off, then gives you a reason to run those probes or to check the counters on your networking gear to find out exactly why the hair on the back of your neck is going up.
I observe the behaviour of my students a lot and I try to gain as much information as I can from what they already give me. That’s one of the reasons that I’m so interested in assignment submissions, because students are going to submit assignments anyway and any extra information I can get from this is a giant bonus! I am running a follow-up Piazza activity on our remote campus and I’m fascinated to be able to watch the developing activity because it tells me who is participating and how they are participating. For those who haven’t heard about Piazza, it’s like a Wiki but instead of the Wiki model of “edit first, then argue into shape”, Piazza encourages a “discuss first and write after consensus” model. I put up the Piazza assignment for the class, with a mid-December deadline, and I’ve already had tens of registered discussions, some of which are leading to edits. Of course, not all groups are active yet and, come Monday, I’ll send out a reminder e-mail and chat to them privately. Instead of sending a blanket mail to everyone saying “HAVE YOU STARTED PIAZZA”, I can refine my contact based on passive observation.
The other thing about Piazza is that, once all of the assignment is over, I can still see all of their discussions, because that’s where I’ve told them to have the discussion! As a result, we can code their answers and track the development of their answers, classifying them in terms of their group role, their level of function and so on. For an open-ended team-based problem, this allows me a great deal of insight into how much understanding my students have of the area and allows me to fine-tune my teaching. Being me, I’m really looking for ways to improve self-regulation mechanisms, as well as uncovering any new threshold concepts, but this nonintrusive monitoring has more advantages than this. I can measure participation by briefly looking at my mailbox to see how many mail messages are foldered under a particular group’s ID, from anywhere, or I can go to Piazza and see it unfolding there. I can step in where I have to, but only when I have to, to get things back on track but I don’t have to prove or deconstruct a team-formed artefact to see what is going on.
In terms of ebb and flow, the Piazza groups are still unpredictable because I don’t have enough data to be able to tell you what the working pattern is for a successful group. I can tell you that no activity is undesirable but, even early on, I could tell you some interesting things about the people who post the most! (There are some upcoming publications that will deal with things along these lines and I will post more on these later.) We’ve been lucky enough to secure some Summer students and I’m hoping that at least some of their work will involve looking at dependencies in communication and ebb and flow across these systems.
As you may have guessed, I like simple. I like the idea of a single dashboard that has a green light (healthy course), an orange light (sick course) and a red light (time to go back to playing guitar on the street corner) although I know it will never be that easy. However, anything that brings me closer to that is doing me a huge favour, because the less time I have to spend actively probing in the course, the less of my students’ time I take up with probes and the less of my own time I spend not knowing what is going on!
Oh well, the good news is that I think that there are only three more papers to write before the Mayan Apocalypse occurs and at least one of them will be on this. I’ll see if I can sneak in a picture of a fruit bat. 🙂
Ethics and Opinion: Please Stop Confusing My Students
Posted: November 14, 2012 Filed under: Education | Tags: advocacy, authenticity, community, education, ethics, feedback, Generation Why, grand challenge, higher education, in the student's head, learning, principles of design, reflection, resources, student perspective, teaching, teaching approaches, thinking Leave a commentOne of the sadly rather expected side benefits of the recent re-election of President Obama has been the predictable outpouring of racist sentiment. Of course, to listen to the people uttering racial slurs and unpleasant requests, they are not actually racists, they are just expressing their opinion. You know?
They’re just sayin’.
A woman is currently being investigated by the Secret Service for Tweeting a heavily charged racial epithet against the President, wrapped up in a paraphrased death threat, and appears puzzled about all of the fuss. After all, it’s just what she thinks and she’s not a racist. Australian former cricketer Greg Ritchie recently uttered some serious racial slurs that are highly inflammatory towards South Africans and can’t see what the big deal is either. He also managed to get in a joke about Muslims. When asked, however, Ritchie had this to say:
His joke, involving Muslims, is in his own words “just a little humourous joke to indicate that they’re not my favourite people of my choice.” Hey, Greg, guess what, when you’re trying to defend yourself against charges of discrimination, perhaps it’s best to do so in a way that is not actually discriminatory? Of course, we’ve been tolerating Ritchie’s antics for years, so it’s not surprising that he is now confused that we don’t find him funny. He, in blackface as pseudo-Indian Mahatma Coate, was a regular on the Australian Rules Football sports variety show “The Footy Show” for years. And, thus we crawl, inexorably, towards my point.
If you’re opinion is actually racism, then it’s a racist opinion. I can completely understand why people don’t want to be labelled as racists because we all know that’s bad but, and here’s the tricky thing, racists are people who believe and say racist things or act in a manner than discriminates against people based on their race. Calling someone a racial epithet because of the race that they belong to counts here and, before we get all ‘classification theory’ about this, there is a world of difference between any classifications of ethnicity that are scientific in nature and slurs. There is also a great deal of difference in how we use this information. The moment that you start saying things like “they’re not my favourite people of choice”, you are saying that you don’t like an entire group that is defined by a given characteristic and, wow, it’s not hard to see where that leads. (Now, no doubt, there is someone who is itching to leap and tell me that ‘aha – Muslims are not a race’. Spare me the sophistry, especially where the Muslims that appear to catch the most problems here are (surprise!) not Caucasian.)
Whenever anyone leaps in and says “statement – I’m just sayin'” or “statement that challenges movements that are egalitarian – playing devil’s advocate” then I really must wonder ‘why?’ I have heard a number of people trying to sneak in sexist comments based on poor evidence or by playing the “Devil’s Advocate” card. “Wow, but what if women aren’t as good at X as men, playing Devil’s advocate/just sayin’/just askin’.” You know, that’s a good question. But it’s not the one that you’re asking. The question that I’m hearing (and I apologise because I have weird ears) is “How can I make a sexist statement with plausible deniability because I am not yet convinced that women are equal?”
This is about fundamental human rights, not an opinion on whether Picard or Kirk would win in a jello-wrestling competition. The questions that we ask, however they are framed, reveal what it is that we believe to be true. And right. And, by extension, what we consider false or wrong.
My real problem with all of this is that my students are like big mobile sponges. They hear a whole heap of stuff before they come to me and, if most of it is opinionated nonsense that magically escapes classification, they will learn that this is how the world works and come to me with a head full of garbage. They’ll recite rubbish at me that they’ve picked up from the world, politics, media, television and their own families that has no place in a University environment. I don’t give a hoot how entitled you feel to have a racist, sexist or discriminatory opinion, it’s going to get called as one and you can argue until you’re blue in the face that saying discriminatory things doesn’t make you discriminatory but, important point, you are almost never as ironically funny as you think you are. (And, yes, we all have to be aware of that. To my shame, I have occasionally gone too far in trying to mock discrimination and I apologetically confess that I have on occasion been less than funny and just plain dumb.) The important thing to ask is why are you trying to set up the situation in the first place?
My students have to think about these things all the time. They cannot guess how people will react to their dumb jokes and supposed ‘irony’. Worse, as people who have had the benefits of more education, other people will look to them (explicitly or not) as thought leaders and the best of my students will have a very wide-ranging impact. I can’t stop people saying silly and hurtful things, but let’s stop the pretence that there are special “get out of jail free” textual containers that allow people to utter the phrasings of discrimination and, yet, mysteriously escape being labelled as such.
(And, for the record, the Internet indicates that Picard would most likely take the match, given that he has mud wrestling experience.)






