Education is not Music: A Long Winded Agreement with Aaron Bady
Posted: December 18, 2012 Filed under: Education | Tags: advocacy, blogging, community, curriculum, design, education, educational research, ethics, Generation Why, higher education, moocs, teaching, teaching approaches, thinking, universal principles of design Leave a commentMark Guzdial has been posting a great deal on MOOCs, as have we all although Mark is much easier to read than I am, and his recent comment on Aaron Bady’s response to Clay Shirky’s “Udacity is Napster” drew me to the great article by Bady and the following key quote inside Bady’s article:
“I think teaching is very different from music”
and I couldn’t agree more. Let me briefly list why I feel that a comparison to Napster has no real validity, to agree with Aaron that Clay Shirky’s argument is not well grounded for the discussion of education. What’s interesting is that I believe that Shirky identifies this point in his own essay, but doesn’t quite realise the full implications of what he’s saying:
Starting with Edison’s wax cylinders, and continuing through to Pandora and the iPod, the biggest change in musical consumption has come not from production but playback.
…
Those earlier inventions systems started out markedly inferior to the high-cost alternative: records were scratchy, PCs were crashy. But first they got better, then they got better than that, and finally, they got so good, for so cheap, that they changed people’s sense of what was possible.
The first thing we need to remember about music is that music is inherently fungible because, when viewed as a piece of work, you can replace it with another effectively identical item. Of course, here we need to be careful and define what we need by identical, because music, as it turns out, is almost never identical but it gets treated that way. If you doubt this, then go and review how much it costs to insert the song “Happy Birthday to You” into a movie or TV show. It doesn’t matter if it’s Homer Simpson yelling it drunkenly, or the Three Tenors singing it sotto voce as part of an Ally McBeal shower hallucination flashback, you will still be liable to fork out dollars to the company who claims to hold the copyright. If you understand the history of how we even made music small enough to send across the (much, much slower back then) Internet, we had to start with the MP3 format, which threw away enough ‘unneeded’ data from the original CD files to shrink the files to a little less than 10% of their original size. This is the technology that we needed before we could even get around the idea of Napster, because enough people had enough music on their hard drives (because we’d already dropped the size) to make file sharing useful. However, as Shirky also notes in his article, this lossy compression technique changes the way that music sounds and you can tell the difference if you listen carefully and know what to listen for. Yet, this is the same song and Napster got into trouble for sharing compressed artefacts of lower quality and perceptible difference from the CD originals, because music, as this kind of artefact, is fungible despite very different levels of quality. Identical, to an audiophile, means sounding precisely the same (or true to the source, really), but identical to the copyright owner is a representation that clearly indicates unauthorised use of copyright material – which is why George Harrison’s “My Sweet Lord” ended up begin described as sufficiently similar to “He’s So Fine”, despite it being a brand new recording and not just a compressed copy.
So, yes, Shirky’s original quotes are both true – we have improved playback and while MP3 is still very common, lossless and much higher quality reproductions are now available. However, the point that has been missed is that the vast majority of people do not care in the slightest. The average person will only notice a shift from MP3 to lossless if they suddenly discover that their iPod has dropped in capacity, when measured in number of songs, by a significant margin. If I listen to “Viva La Vida” by Coldplay, and yes, Joe Satriani fans, I picked that deliberately, then the effective difference in my enjoyment of the song, my ability to sing along tunelessly in the shower and the ability to recite the words if asked, has nothing to do with the quality. This is not true of certain pieces of classical music, where the compression artefacts start to have more of an effect, but these are not the core business of file sharers and those who trade in compressed artefacts. However, MP3 artefacts rarely sound like long scratches, dust on the record or a bad needle – yes, they can be irritating, but the electronic form, pre and post-compression, is generally protected from such things unless you get some serious cosmic ray action in your storage media and even then, you have to be very unlucky.
The Napster music argument, for me, falls down because the increase in quality does not have a direct connection to what the majority of the user base would have considered an acceptable product. Yes, it’s better now but, for most people, so what? Music sharing services are considered useful and valuable because they share songs that people want, where most people don’t think about the quality, they accept the name and the recognisable nature of the song as enough.
This is not at all true for education, because educational experiences vary wildly between lecturers, courses, institutions and eras to an extent that it is impossible to consider them in any way to be interchangeable – quality, here, is everything. If you have an international articulation program, you know that the first thing you have to do is to work out what has been taught, and how it has been taught, inside a course of the same name as one of yours. Even ‘name equivalence’ doesn’t mean anything here and we do not, or we should not, grant standing based on a coincidence of name for a course. There is no parallel guarantee that my low quality version of a course will give me the same ability to “sing in the shower” as the high quality course will – and this is, for me, an unassailable difference.
There is no doubt that the opportunities that might be offered by blended learning, full electronic offerings, and, yes, MOOCs (however they end up being defined) are something that we have to consider because, if they work, they allow us to educate the world, but claiming that this must occur because Udacity is like Napster completely ignores the core difference between education and music in terms of the consumer base and their focus on what it means for a service to meet their requirements. If students didn’t care about the perceived quality, then we wouldn’t have the notion of the ‘top schools’ or ‘low end schools’, so we know that this thinking exists. A student will happily put an MP3 on at a party, but it remains to be seen if they will constantly and out of design, not desperation, put a MOOC course on a job application, and expect a good result from it.
When Does Failing Turn You Into a Failure?
Posted: December 17, 2012 Filed under: Education, Opinion | Tags: advocacy, authenticity, blogging, ci2012, community, conventicle, curriculum, design, education, educational research, ethics, feedback, Generation Why, grand challenge, higher education, icer2012, in the student's head, learning, principles of design, reflection, research, resources, student perspective, teaching, teaching approaches, thinking, tools, workload Leave a commentThe threat of failure is very different from the threat of being a failure. At the Creative Innovations conference I was just at, one of the strongest messages there was that we learn more from failure than we do from success, and that failure is inevitable if you are actually trying to be innovative. If you learn from your failures and your failure is the genuine result of something that didn’t work, rather than you sat around and watched it burn, then this is just something that happens, was the message from CI, and any other culture makes us overly-cautious and risk averse. As most of us know, however, we are more strongly encouraged to cover up our failures than to celebrate them – and we are frequently better off not trying in certain circumstances than failing.
At the recent Adelaide Conventicle, which I promise to write up very, very soon, Dr Raymond Lister presented an excellent talk on applying Neo-Piagetian concepts and framing to the challenges students face in learning programming. This is a great talk (which I’ve had the good fortune to see twice and it’s a mark of the work that I enjoyed it as much the second time) because it allows us to talk about failure to comprehend, or failure to put into practice, in terms of a lack of the underlying mechanism required to comprehend – at this point in the student’s development. As part of the steps of development, we would expect students to have these head-scratching moments where they are currently incapable of making any progress but, framing it within developmental stages, allows us to talk about moving students to the next stage, getting them out of this current failure mode and into something where they will achieve more. Once again, failure in this case is inevitable for most people until we and they manage to achieve the level of conceptual understanding where we can build and develop. More importantly, if we track how they fail, then we start to get an insight into which developmental stage they’re at.
One thing that struck me with Raymond’s talk, was that he starts off talking about “what ruined Raymond” and discussing the dire outcomes promised to him if he watched too much television, as it was to me for playing too many games, and it is to our children for whatever high tech diversion is the current ‘finger wagging’ harbinger of doom. In this case, ruination is quite clearly the threat of becoming a failure. However, this puts us in a strange position, because if failure is almost inevitable but highly valuable if managed properly and understood, what is it about being a failure that is so terrible? It’s like threatening someone that they’ll become too enthusiastic and unrestrained in their innovation!
I am, quelle surprise, playing with words here because to be a failure is to be classed as someone for whom success is no longer an option. If we were being precise, then we would class someone as a perpetual failure or, more simply, unsuccessful. This is, quite usually, the point at which it is acceptable to give up on someone – after all, goes the reasoning, we’re just pouring good money after bad, wasting our time, possibly even moving the deck chairs on the Titanic, and all those other expressions that allow us to draw that good old categorical line between us and others and put our failures into the “Hey, I was trying something new” basket and their failures into the “Well, he’s just so dumb he’d try something like that.” The only problem with this is that I’m really not sure that a lifetime of failure is a guaranteed predictor of future failure. Likely? Yeah, probably. So likely we can gamble someone’s life on it? No, I don’t believe so.
When I was failing courses in my first degree, it took me a surprisingly long time to work out how to fix it, most of which was down to the fact that (a) I had no idea how to study but (b) no-one around me was vaguely interested in the fact that I was failing. I was well on my way to becoming a perpetual failure, someone who had no chance of holding down a job let alone having a career, and it was a kind and fortuitous intervention that helped me. Now, with a degree of experience and knowledge, I can look back into my own patterns and see pretty much what was wrong with me – although, boy, would I have been a difficult cuss to work with. However, failing, which I have done since then and I will (no doubt) do again, has not appeared to have turned me into a failure. I have more failings than I care to count but my wife still loves me, my friends are happy to be seen with me and no-one sticks threats on my door at work so these are obviously in the manageable range. However, managing failure has been a challenging thing for me and I was pondering this recently – how people deal with being told that they’re wrong is very important to how they deal with failing to achieve something.
I’m reading a rather interesting, challenging and confronting, article on, and I cannot believe there’s a phrase for this, rage murders in American schools and workplaces, which claims that these horrifying acts are, effectively, failed revolts, which is with Mark Ames, the author of “Going Postal” (2005). Ames seems to believe that everything stems from Ronald Reagan (and I offer no opinion either way, I hasten to add) but he identifies repeated humiliation, bullying and inhumane conditions as taking ordinary people, who would not usually have committed such actions, and turning them into monstrous killing machines. Ames’ thesis is that this is not the rise of psychopathy but a rebellion against breaking spirit and the metaphorical enslavement of many of the working and middle class that leads to such a dire outcome. If the dominant fable of life is that success is all, failure is bad, and that you are entitled to success, then it should be, as Ames says in the article, exactly those people who are most invested in these cultural fables who would be the most likely to break when the lies become untenable. In the language that I used earlier, this is the most awful way to handle the failure of the fabric of your world – a cold and rational journey that looks like madness but is far worse for being a pre-meditated attempt to destroy the things that lied to you. However, this is only one type of person who commits these acts. The Monash University gunman, for example, was obviously delusional and, while he carried out a rational set of steps to eliminate his main rival, his thinking as to why this needed to happen makes very little sense. The truth is, as always, difficult and muddy and my first impression is that Ames may be oversimplifying in order to advance a relatively narrow and politicised view. But his language strikes me: the notion of the “repeated humiliation, bullying and inhumane conditions”, which appears to be a common language among the older, workplace-focused, and otherwise apparently sane humans who carry out such terrible acts.
One of the complaints made against the radio network at the heart of the recent Royal Hoax, 2DayFM, is that they are serial humiliators of human beings and show no regard for the general well-being of the people involved in their pranks – humiliation, inhumanity and bullying. Sound familiar? Here I am, as an educator, knowing that failure is going to happen for my students and working out how to bring them up into success and achievement when, on one hand, I have a possible set of triggers where beating down people leads to apparent madness, and at least part of our entertainment culture appears to delight in finding the lowest bar and crawling through the filth underneath it. Is telling someone that they’re a failure, and rubbing it in for public enjoyment, of any vague benefit to anyone or is it really, as I firmly believe, the best way to start someone down a genuinely dark path to ruination and resentment.
Returning to my point at the start of this (rather long) piece, I have met Raymond several times and he doesn’t appear even vaguely ruined to me, despite all of the radio, television and Neo-Piagetian contextual framing he employs. The message from Raymond and CI paints failure as something to be monitored and something that is often just a part of life – a stepping stone to future success – but this is most definitely not the message that generally comes down from our society and, for some people, it’s becoming increasingly obvious that their inability to handle the crushing burden of permanent classification as a failure is something that can have catastrophic results. I think we need to get better at genuinely accepting failure as part of trying, and to really, seriously, try to lose the classification of people as failures just because they haven’t yet succeeded at some arbitrary thing that we’ve defined to be important.
Taught for a Result or Developing a Passion
Posted: December 13, 2012 Filed under: Education | Tags: advocacy, authenticity, blogging, Bloom, community, curriculum, design, education, educational problem, educational research, ethics, feedback, Generation Why, grand challenge, higher education, learning, measurement, MIKE, PIRLS, PISA, principles of design, reflection, research, resources, student perspective, teaching, teaching approaches, thinking, tools, universal principles of design, workload Leave a commentAccording to a story in the Australian national broadcaster, the ABC, website, Australian school children are now ranked 27th out of 48 countries in reading, according to the Progress in International Reading Literacy Study, and that a quarter of Australia’s year 4 students had failed to meet the minimum standard defined for reading at their age. As expected, the Australian government has said “something must be done” and the Australian Federal Opposition has said “you did the wrong thing”. Ho hum. Reading the document itself is fascinating because our fourth graders apparently struggle once we move into the area of interpretation and integration of ideas and information, but do quite well on simple inference. There is a lot of scope for thought about how we are teaching, given that we appear to have a reasonably Bloom-like breakdown on the data but I’ll leave that to the (other) professionals. Another international test, the Program for International School Assessment (PISA) which is applied to 15 year olds, is something that we rank relatively highly in, which measures reading, mathematics and science. (And, for the record, we’re top 10 on the PISA rankings after a Year 4 ranking of 27th. Either someone has gone dramatically wrong in the last 7 years of Australian Education, or Year 4 results on PIRLS doesn’t have as much influence as we might have expected on the PISA).We don’t yet have the results for this but we expect it out soon.
What is of greatest interest to me from the linked article on the ABC is the Oslo University professor, Svein Sjoberg, who points out the comparing educational systems around the globe is potentially too difficult to be meaningful – which is a refreshingly honest assessment in these performance-ridden and leaderboard-focused days. As he says:
“I think that is a trap. The PISA test does not address the curricular test or the syllabus that is set in each country.
Like all of these tests, PIRLS and PISA measure a student’s ability to perform on a particular test and, regrettably, we’re all pretty much aware, or should be by now, that using a test like this will give you the results that you built the test to give you. But one thing that really struck me from his analysis of the PISA was that the countries who perform better on the PISA Science ranking generally had a lower measure of interest in science. Professor Sjoberg noted that this might be because the students had been encouraged to become result-focused rather than encouraging them to develop a passion.
If Professor Sjoberg is right, then is not just a tragedy, it’s an educational catastrophe – we have now started optimising our students to do well in tests but be less likely to go and pursue the subjects in which they can get these ‘good’ marks. If this nasty little correlation holds, then will have an educational system that dominates in the performance of science in the classroom, but turns out fewer actual scientists – our assessment is no longer aligned to our desired outcomes. Of course, what it is important to remember is that the vast majority of these rankings are relative rather than absolute. We are not saying that one group is competent or incompetent, we are saying that one group can perform better or worse on a given test.
Like anything, to excel at a particular task, you need to focus on it, practise it, and (most likely) prioritise it above something else. What Professor Sjoberg’s analysis might indicate, and I realise that I am making some pretty wild conjecture on shaky evidence, is that certain schools have focused the effort on test taking, rather than actual science. (I know, I know, shock, horror) Science is not always going to fit into neat multiple choice questions or simple automatically marked answers to questions. Science is one of the areas where the viva comes into its own because we wish to explore someone’s answer to determine exactly how much they understand. The questions in PISA theoretically fall into roughly the same categories (MCQ, short answer) as the PIRLS so we would expect to see similar problems in dealing with these questions, if students were actually having a fundamental problem with the questions. But, despite this, the questions in PISA are never going to be capable of gauging the depth of scientific knowledge, the passion for science or the degree to which a student already thinks within the discipline. A bigger problem is the one which always dogs standardised testing of any sort, and that is the risk that answering the question correctly and getting the question right may actually be two different things.
Years ago, I looked at the examination for a large company’s offering in a certain area, I have no wish to get sued so I’m being deliberately vague, and it became rapidly apparent that on occasion there was a company answer that was not the same as the technically correct answer. The best way to prepare for the test was not to study the established base of the discipline but it was to read the corporate tracts and practise the skills on the approved training platforms, which often involved a non-trivial fee for training attendance. This was something that was tangential to my role and I was neither of a sufficiently impressionable age nor strongly bothered enough by it for it to affect me. Time was a factor and incorrect answers cost you marks – so I sat down and learned the ‘right way’ so that I could achieve the correct results in the right time and then go on to do the work using the actual knowledge in my head.
However, let us imagine someone who is 14 or 15 and, on doing the practice tests for ‘test X’ discovers that what is important is in hitting precisely the right answer in the shortest time – thinking about the problem in depth is not really on the table for a two-hour exam, unless it’s highly constrained and students are very well prepared. How does this hypothetical student retain respect for teachers who talk about what science is, the purity of mathematics, or the importance of scholarship, when the correct optimising behaviour is to rote-learn the right answers, or the safe and acceptable answers, and reproduce those on demand. (Looking at some of the tables in the PISA document, we see that the best performing nations in the top band of mathematical thinking are those with amazing educational systems – the desired range – and those who reputedly place great value in high power-distance classrooms with large volumes of memorisation and received wisdom – which is probably not the desired range.)
Professor Sjoberg makes an excellent point, which is that trying to work out what is in need of fixing, and what is good, about the Australian education system is not going to be solved by looking at single figure representations of our international rankings, especially when the rankings contradict each other on occasion! Not all countries are the same, pedagogically, in terms of their educational processes or their power distances, and adjacency of rank is no guarantee that the two educational systems are the same (Finland, next to Shanghai-China for instance). What is needed is reflection upon what we think constitutes a good education and then we provide meaningful local measures that allow us to work out how we are doing with our educational system. If we get the educational system right then, if we keep a bleary eye on the tests we use, we should then test well. Optimising for the tests takes the effort off the education and puts it all onto the implementation of the test – if that is the case, then no wonder people are less interested in a career of learning the right phrase for a short answer or the correct multiple-choice answer.
“You Will Never Amount to Anything!”
Posted: December 10, 2012 Filed under: Education | Tags: advocacy, authenticity, blogging, community, curriculum, education, educational research, ethics, feedback, Generation Why, grand challenge, higher education, in the student's head, learning, led zeppelin, measurement, principal skinner, principles of design, reflection, resources, simpsons, student perspective, teaching, teaching approaches, thinking, tools, universal principles of design, work/life balance, workload Leave a commentI am currently reading “When Giants Walked the Earth: A Biography of Led Zeppelin” by Mick Wall. I won’t go into much of the detail of the book but the message presented around the four members of the group is that most of them did not have the best experiences in school and that, in at least two cases, the statements written on their reports by their teachers were profoundly dismissive. Now, it is of course entirely possible the that the Led Zep lads were, at time of leaving school, incapable of achieving anything – except that this is a total nonsense as it is quite obvious that they achieved a degree of musical and professional success that few contemplate, let alone reach.
You’ll often read this kind of line in celebrity biographies – that semi-mythical reforging of the self after having been judged and found wanting. (From a narrative perspective, it’s not all that surprising as it’s an easy way to increase the tension.) But one of the reasons that it pops up is that such a statement is so damning that it is not surprising that a successful person might want to wander back to the person who said it and say “Really?” But to claim that such a statement is a challenge (as famously mocked in the Simpsons where Principal Skinner says that these children have not future and is forced to mutter, with false bonhomie, ‘Prove me wrong, kids, prove me wrong.’) is confused at best, disingenuous and misdirecting at worst. If you want someone to achieve something, provide a clear description of the task, the means to achieve that task and then set about educating and training. No-one has ever learned brain surgery by someone yelling “Don’t open that skull” so pretending that an entire life’s worth of motivation can be achieved by telling something that they have no worth is piffle. Possibly even balderdash.
The phrase “You Will Never Amount To Anything” is, in whatever form it is uttered, a truly useless sentiment. It barely has any meaning (isn’t just being alive being something and hence amounting to a small sort of anything?) but, of course, it is not stated in order to achieve an outcome other than to place the blame for the lack of engagement with a given system squarely at the feet of the accused. You have failed to take advantage of the educational opportunities that we have provided and this is such a terminal fault, that the remaining 90% of your life will be spent in a mobile block of amber, where you will be unable to affect any worthwhile interaction with the universe.
I note that, with some near misses, I have been spared this kind of statement but I do feel very strongly that it is really not anything that you can with any credibility or useful purpose. If you happen to be Death, the Grim Reaper, then you can stand at the end of someone’s life and say “Gosh, you didn’t do a great deal did you” (although, again, what does it mean to do anything anyway?) but saying it when someone is between the ages of 16 and 20? You might be able to depend upon the statistical reliability that, if rampant success in our society is only given to 1%, 99% of the time, everyone you say “You will not be a success” will accidentally fall into that category. It’s quite obvious that any number of the characteristics that are worthy of praise in school contribute nothing to the spectacular success enjoyed by some people, where these characteristics are “sitting quietly”, “wearing the correct uniform” or “not chewing gum”. These are excellent facets of compliance and will make for citizens who may be of great utility to the successful, but it’s hard to see many business leaders whose first piece of advice to desperate imitators is “always wear shiny shoes”.
If we are talking about perceived academic ability then we run into another problem, in that there is a great deal of difference between school and University, let along school and work. There is no doubt that the preparation offered by a good schooling system is invaluable. Reading, writing, general knowledge, science, mathematics, biology, the classics… all of these parts of our knowledge and our society can be introduced to students very usefully. But to say that your ability to focus on long division problems when you are 14 is actually going to be the grand limiting factor on your future contribution to the world? Nonsense.
Were you to look at my original degree, you might think “How on Earth did this man end up with a PhD? He appears to have no real grasp of study, or pathway through his learning.” and, at the time of the degree, you’d be right. But I thought about what had happened, learned from it, and decided to go back and study again in order to improve my level of knowledge and my academic record. I then went back and did this again. And again. Because I persevered, because I received good advice on how to improve and, most importantly, because a lot of people took the time to help me, I learned a great deal and I became a better student. I developed my knowledge. I learned how to learn and, because of that, I started to learn how to think about teaching, as well.
If you were to look at Nick Falkner at 14, you may have seen some potential but a worry lack of diligence and effort. At 16, you would have seen him blow an entire year of school exams because he didn’t pay attention. At 17 he made it into Uni, just, but it wasn’t until the wheels really started to fall off that he realised that being loquacious and friendly wasn’t enough. Scurrying out of Uni with a third-grade degree into a workforce that looked at the evidence of my learning drove home that improvements were to be made. Being unemployed for most of a year cemented it – I had set myself up for a difficult life and had squandered a lot of opportunities. And that is when serendipity intervened, because the man who has the office next to me now, and with whom I coffee almost every morning, suggested that I could come back and pursue a Masters degree to make up for the poor original degree, and that I would not have to pay for it upfront because it was available as a government deferred-payment option. (Thank you, again, Kevin!)
That simple piece of advice changed my life completely. Instead of not saying anything or being dismissive of a poor student, someone actually took the time to say “Well, here’s something you could do and here’s how you do it.” And now, nearly 20 years down the track, I have a PhD, a solid career in which I am respected as an educator and as a researcher and I get to inspire and help other students. There’s no guarantee that good advice will always lead to good outcomes (and we all know about the paving on the road to Hell) but it’s increasingly obvious to me that dismissive statements, unpleasant utterances and “cut you loose” curtness are far more likely to do nothing positive at all.
If the most that you can say to a student is “You’re never going to amount to anything”, it might be worth looking in a mirror to see exactly what you’ve amounted to yourself…
Brief Stats Update: Penultimate Word Count Notes
Posted: December 8, 2012 Filed under: Education | Tags: advocacy, authenticity, blogging, community, data visualisation, design, education, educational problem, educational research, higher education, student perspective, teaching, teaching approaches, thinking, tools, work/life balance, workload, writing Leave a commentI occasionally dump the blog and run it through some Python script deliciousness to find out how many words I’ve written. This is no measure of worth or quality, more a metric of my mania. As I noted in October, I was going to hit what I thought was my year target much earlier. Well, yes, it came and it went and, sure enough, I plowed through it. At time of writing, on published posts alone, we’re holding at around 1.2 posts/day, 834 words/post and a smidgen over 340,000 words, which puts me (in word count) just after Ayn Rand’s “The Fountainhead” (311,596) but well behind her opus “Atlas Shrugged” (561,996). In terms of Objectivism? Let’s just say that I won’t be putting any kind of animal into that particular fight at the moment.
Now, of course, I can plug in the numbers and see that this puts my final 2012 word count somewhere in the region of 362,000 words. I must admit, there is a part of me that sees that number and thinks “Well, we could make it an even 365,000 and that’s a neat 1000 words/day” but, of course, that’s dumb for several reasons:
- I have not checked in detail exactly how well my extraction software is grabbing the right bits of the text. There are hyperlinks and embellishments that appear to be taken care of, but we are probably only on the order of 95% accuracy here. Yes, I’ve inspected it and I haven’t noticed anything too bad, but there could be things slipping through. After all of this is over, I am going to drag it all together and analyse it properly but, let me be clear, just because I can give you a word count to 6 significant figures, doesn’t mean that it is accurate to 6 significant figures.
- Should I even be counting those sections of text that are quoted? I do like to put quotes in, sometimes from my own work, and this now means I’m either counting something that I didn’t write or I’m counting something that I did write twice!
- Should I be counting the stats posts themselves as they are, effectively, metacontent? This line item is almost above that again! This way madness lies!
- It was never about the numbers in the first place, it was about thinking about my job, my students, my community and learning and teaching. That goal will have been achieved whether I write one word/day from now on or ten thousand!
But, oh, the temptation to aim for that ridiculous and ultimately deceptive number. How silly but, of course, how human to look at the measurable goal rather than the inner achievement or intrinsic reward that I have gained from the thinking process, the writing, the refining of the text, the assembly of knowledge and the discussion.
Sometime after January the 1st, I will go back and set the record straight. I shall dump the blog and analyse it from here to breakfast time. I will release the data to interested (and apparently slightly odd) people if they wish. But, for now, this is not the meter that I should be watching because it is not measuring the progress that I am making, nor is it a good compass that I should follow.
AAEE 2012 – Yes, Another Conference
Posted: December 5, 2012 Filed under: Education | Tags: aaee2012, advocacy, ci2012, conventicle, education, educational research, feedback, Generation Why, higher education, in the student's head, learning, reflection, research, student perspective, teaching, teaching approaches, thinking, tools, universal principles of design 3 CommentsIn between writing up the conventicle (which I’m not doing yet), the CI Conference (which I’m doing slowly) and sleep (infrequent), I’m attending the Australasian Association for Engineering Education 2012 conference. Today, I presented a paper on e-Enhancing existing courses and, through a co-author, another paper on authentic teaching tool creation experiences.
My first paper gave me a chance to look at the Google analytics and tracking data for the on-line material I created in 2009. Since then, there have been:
- 11,118 page views
- 2.99 pages viewed/visit
- 1,721 unique visitors
- 3,715 visits overall
The other thing that is interesting is that roughly 60% of the viewers return to view the podcasts again. The theme of my talk was “Is E-Enhancement Worth It” and I had the pleasure of pointing out that I felt that it was because, as I was presenting, I was simultaneously being streamed giving my thoughts of computer networks to students in Singapore and (strangely enough) Germany. As I said in the talk and in the following discussion, the podcasts are far from perfect and, to increase their longevity, I need to make them shorter and more aligned to a single concept.
Why?
Because while the way I present concepts may change, because of sequencing and scaffolding changes, the way that I present an individual concept is more likely to remain the same over time. My next step is to make up a series of conceptual podcasts that are maybe 3-5 minutes in duration. Then the challenge is how to assemble these – I have ideas but not enough time.
One of the ideas raised today is the idea that we are seeing the rise of the digital native, a new type of human acclimatised to a short gratification loop, multi-tasking, and a non-linear mode of learning. I must be honest and say that everything I’ve read on the multi-tasking aspect, at least, leads me to believe that this new generation don’t multi-task any better than anyone else did. If they do two things, then they do them more slowly and don’t achieve the same depth: there’s no shortage of research work on this and given the limits of working memory and cognition this makes a great deal of sense. Please note, I’m not saying that I don’t believe that Homo Multiplexor can’t emerge, it’s just that I have not yet any strong scientific evidence to back up the anecdotes. I’m perfectly willing to believe that default searching activities have changed (storing ways of searching rather than the information) because that is a logical way to reduce cognitive load but I am yet to see strong evidence that my students can do two things at once well and without any loss of time. Either working memory has completely changed, which we should be able to test, or we risk confusing the appearance of doing two things at once with actually doing two things at once.
This is one of those situations that, as one of my colleagues observed, leaves us in that difficult position of being told, with great certainty, about a given student (often someone’s child) who can achieve great things while simultaneously watching TV and playing WoW. Again, I do not rule out the possibility of a significant change in humanity (we’re good at it) but I have often seen that familiar tight smile and the noncommittal nod as someone doesn’t quite acknowledge that your child is somehow the spearhead of a new parallelised human genus.
It’s difficult sometimes to express ideas like this. Compare this to the numbers I cited above. Everyone who reads this will look at those numbers and, while they will think many things, they are unlikely to think “I don’t believe that”. Yet I know that there are people who have read this and immediately snorted (or the equivalent) because they frankly disbelieve me o the multi-tasking, with no more or less hard evidence than that supporting the numbers. I’m actually expecting some comments on this one because the notion of the increasing ability of young people to multitask is so entrenched. If there is a definitive set of work supporting this, then I welcome it. The only problem is that all I can find supports the original work on working memory and associated concepts – there are only so many things you can focus on and beyond that you might be able to function but not at much depth. (There are exceptions, of course, but the 0.1% of society do not define the rule.)
The numbers are pasted straight out of my Google analytics for the learning materials I put up – yet you have no more reason to believe them than if I said “83% of internet statistics are made up”, which is a made up statistic. (If is is true, it is accidentally true.) We see again one of the great challenges in education: numbers are convincing, evidence that contradicts anecdote is often seen as wrong, finding evidence in the first place can be hard.
One more day of conference tomorrow! I can only wonder what we’ll be exposed to.
First Adelaide Computing Education Conventicle
Posted: November 27, 2012 Filed under: Education | Tags: advocacy, ALTA, authenticity, community, conventicle, education, educational research, higher education, Ingkarni Wardli, Kaurna, reflection, teaching approaches, thinking Leave a commentWell, my hosting duties are done and I’m relaxing at home, having hosted the first successful Adelaide Computing Education Conventicle! I’m absolutely exhausted and I have to jump on a plane very soon and so I crave your indulgence because today’s post is going to be a reposting of my welcoming speech to the Conventicle. My thanks to all of the guests, presenters and attendees – we started a new tradition well. I look forward to filling in the details over the next few days. Without any further ado, here is my speech:
“Welcome to the first Adelaide Computing Education Conventicle.
I would first like to acknowledge that we are meeting on the traditional country of the Kaurna people of the Adelaide plains, the original inhabitants of the land upon which the University of Adelaide was built, and who have shared with us a name for this building. Ingkarni Wardli means ‘place of learning’ or, my favourite, ‘the house of inquiry’ and is the first building in the University’s history to have a Kaurna name. I recognise and respect their cultural heritage, beliefs and relationship with the land, and I acknowledge that they are of continuing importance to the Kaurna people living today.
In the spirit of today’s events, I would like to share with you the history of the name of this building, to emphasise the importance of today’s meeting – a meeting of people who are dedicated to learning, to knowledge and to sharing what they know with other people. This building had a working name of “Innova21” but a new name was always sought and, after a great deal of discussion, the then-Dean, Professor Peter Dowd, decided to seek advice on a name from the Kaurna people.
It would have been very easy to look at what we, as outsiders, know of the Kaurna language and pick a name that seemed right – especially when the word for knowledge “Ingkarni” was so close to the word “Innova”. However, the Kaurna language is protected by its custodians, because of people with less than perfect understanding or, in some extreme cases, a desire to exploit by association, so we needed to seek approval before the naming. As it turns out, calling the building “Ingkarni” by itself would have been nonsensical and would have undone the intent of the namers, which was to recognise and respect the cultural traditions of the Kaurna, in their role as educators.
If you have ever had the good fortune to hear the Kaurna Elder, Uncle Lewis O’Brien, you will know that the Kaurna placed great value on education and were respected among the neighbouring communities as educators and conference leaders. When big decisions were being made, when important knowledge had to be shared, the Kaurna were generally to be consulted and would have an instrumental role in the process. What better name for a building that contains science and education than the name “House of Enquiry” from a people who were known for their knowledge and their importance in the sharing of wisdom?
Today, we gather to discuss our knowledge of education, to share our successes and to understand and to seek to address those areas where we are yet to succeeed. I would like to thank the Australian Council of Deans of ICT’s Learning and Teaching Academy, for funding both me and Simon under the Fellows program. I would like to thank the inimitable Simon for his encouragement to run this, and to thank our other interstate guest, Dr Raymond Lister, for being here today to share his research. I would also like to thank you all for agreeing to present, or to just show up and listen. It is far easier to ignore alternative approaches to learning and teaching than it is to sit in a room and prepare to discover that you might be able to do things differently, with greater effect. I welcome you all and I hope that this is the first of a long and fruitful cycle of Conventicles. It is now my pleasure to introduce Simon!”
Ebb and Flow – Monitoring Systems Without Intrusion
Posted: November 23, 2012 Filed under: Education | Tags: collaboration, community, curriculum, data visualisation, education, educational problem, educational research, ethics, feedback, Generation Why, higher education, in the student's head, learning, measurement, MIKE, principles of design, reflection, resources, student perspective, SWEDE, teaching, teaching approaches, thinking, tools Leave a commentI’ve been wishing a lot of people “Happy Thanksgiving” today because, despite being frightfully Antipodean, I have a lot of friends and family who are Thanksgiving observers in the US. However, I would know that something was up in the US anyway because I am missing about 40% of my standard viewers on my blog. Today is an honorary Sunday – hooray, sleep-ins all round! More seriously, this illustrates one of the most interesting things about measurement, which is measuring long enough to be able to determine when something out of the ordinary occurs. As I’ve already discussed, I can tell when I’ve been linked to a higher profile blog because my read count surges. I also can tell when I haven’t been using attractive pictures because the count drops by about 30%.

A fruit bat, in recovery, about to drink its special fruit smoothie. (Yes, this is shameless manipulation.)
This is because I know what the day-to-day operation of the blog looks like and I can spot anomalies. When I was a network admin, I could often tell when something was going wrong on the network just because of the way that certain network operations started to feel, and often well before these problems reached the level where they would trigger any sort of alarm. It’s the same for people who’ve lived by the same patch of sea for thirty years. They’ll look at what appears to be a flat sea on a calm day and tell you not to go out – because they can read a number of things from the system and those things mean ‘danger’.
One of the reasons that the network example is useful is because any time you send data through the network to see what happens, you’re actually using the network to do it. So network probes will actually consume network bandwidth and this may either mask or exacerbate your problems, depending on how unlucky you are. However, using the network for day-today operations, and sensing that something is off, then gives you a reason to run those probes or to check the counters on your networking gear to find out exactly why the hair on the back of your neck is going up.
I observe the behaviour of my students a lot and I try to gain as much information as I can from what they already give me. That’s one of the reasons that I’m so interested in assignment submissions, because students are going to submit assignments anyway and any extra information I can get from this is a giant bonus! I am running a follow-up Piazza activity on our remote campus and I’m fascinated to be able to watch the developing activity because it tells me who is participating and how they are participating. For those who haven’t heard about Piazza, it’s like a Wiki but instead of the Wiki model of “edit first, then argue into shape”, Piazza encourages a “discuss first and write after consensus” model. I put up the Piazza assignment for the class, with a mid-December deadline, and I’ve already had tens of registered discussions, some of which are leading to edits. Of course, not all groups are active yet and, come Monday, I’ll send out a reminder e-mail and chat to them privately. Instead of sending a blanket mail to everyone saying “HAVE YOU STARTED PIAZZA”, I can refine my contact based on passive observation.
The other thing about Piazza is that, once all of the assignment is over, I can still see all of their discussions, because that’s where I’ve told them to have the discussion! As a result, we can code their answers and track the development of their answers, classifying them in terms of their group role, their level of function and so on. For an open-ended team-based problem, this allows me a great deal of insight into how much understanding my students have of the area and allows me to fine-tune my teaching. Being me, I’m really looking for ways to improve self-regulation mechanisms, as well as uncovering any new threshold concepts, but this nonintrusive monitoring has more advantages than this. I can measure participation by briefly looking at my mailbox to see how many mail messages are foldered under a particular group’s ID, from anywhere, or I can go to Piazza and see it unfolding there. I can step in where I have to, but only when I have to, to get things back on track but I don’t have to prove or deconstruct a team-formed artefact to see what is going on.
In terms of ebb and flow, the Piazza groups are still unpredictable because I don’t have enough data to be able to tell you what the working pattern is for a successful group. I can tell you that no activity is undesirable but, even early on, I could tell you some interesting things about the people who post the most! (There are some upcoming publications that will deal with things along these lines and I will post more on these later.) We’ve been lucky enough to secure some Summer students and I’m hoping that at least some of their work will involve looking at dependencies in communication and ebb and flow across these systems.
As you may have guessed, I like simple. I like the idea of a single dashboard that has a green light (healthy course), an orange light (sick course) and a red light (time to go back to playing guitar on the street corner) although I know it will never be that easy. However, anything that brings me closer to that is doing me a huge favour, because the less time I have to spend actively probing in the course, the less of my students’ time I take up with probes and the less of my own time I spend not knowing what is going on!
Oh well, the good news is that I think that there are only three more papers to write before the Mayan Apocalypse occurs and at least one of them will be on this. I’ll see if I can sneak in a picture of a fruit bat. 🙂
Verbs and Nouns: Designing a Design
Posted: November 22, 2012 Filed under: Education | Tags: authenticity, community, curriculum, education, educational problem, educational research, ethics, feedback, Generation Why, higher education, in the student's head, principles of design, reflection, resources, student perspective, teaching, teaching approaches, thinking, tools Leave a commentWe have a very bad habit in Computing of ‘verbing the noun’, where we take a perfectly good noun and repurpose it as a verb. If, in the last few weeks, you’ve googled, face booked, photoshopped or IMed, then you know what I mean. (Coining new words like this, often genericised trademarks, is not new, as anyone who has hoovered the rug will tell you!) In some cases, we use the same word for the action (to design) as we do for the product (a design) and, especially in the case of design, this can cause trouble because it becomes very easy to ask someone for the product when what you want is the process.
Now, I realise that I do enjoy linguistic shenanigans (anyone who plays with which syllable to stress when saying interstices is spending too much time thinking about language) but this is not some syntactic mumbo jumbo, this is a genuine concern. If I ask a student to submit a design for their program, then I am usually assuming that the artefact submitted will be the product of the design process. However, I have to realise that a student must understand what the design process actually is in order for my instruction (give me a design) to be mapped into the correct action (undertake the design process). We’ve collected a lot of first-year student reflections on design and it is becoming increasingly apparent that there is not a clear link between the verb and noun forms of this very simple word. We can now start to understand why a student would feel frustrated if, when asked for a design, they submit what is effectively a re-writing of their final written program on a separate document with some arrows and we turn around and tell them that “this is not a design”. Well, what did we want? The student has given us a document with stuff on it and the word ‘design’ at the top – what did we expect?
The same is, more subtly, true of the word program. After all the practise of programming is the production of programs (and the consumption and elimination of problems but that’s another post). Hence, when I ask a student for a program, or for a solution, I am often not explicitly placing the written instructions into a form that clearly elucidates the process and, as a result, I may miss important constructive steps that could assist the student in understanding and applying the process.
Let’s face it, if you don’t know what you’re doing, or don’t understand that there is a process to follow (the verb form), then any instructions I give you “Make sure you use diagrams”, “clearly label your variables”, “use UML” are going to be perceived in a way that is grounded in the final product, not the steps along the way. If I can use neo-Piagetian terminology briefly, then we’re looking at the magical thinking that we’d normally associate with the pre-operational stage. Not only is the knowledge not sinking in but we will engender a cargo-cult like inclusion of features that are found in the artefact but have no connection back to the process at all. We have potentially reached the unpleasant point where students now think that we are deliberately, or unfairly, ignoring the work that they provided in direct accordance with our instructions!
Anyone who has ever looked at a design with the steady sinking feeling that comes from reading poorly translated programming language, marked with superfluous arrows and dogged, yet unnecessary, underlining of the obvious, will probably be feeling a pang of empathy at the moment.
So what to do? How do we address this problem? The first step is to remember how fiendishly ambiguous language actually is (if English were easy, we wouldn’t need constrained and artificial programming languages to unambiguously assign meaning for computers) and be precise about the separation between the process and the product. The design process, which we provide guidance and steps for, will produce a design document. We are luckier in programming because while you can program and produce a program, you cannot produce a programming! In this case, the clarification is that you have assigned a programming task in order to produce a program. In our heads, we are always clear about what we mean but it is still amazing how often we can resort to asking for a product that is the final stage of a long and difficult process, which we are intending to teach, without realising that we are describing the desirable characteristics of the end point without considering the road that must be travelled!
On reviewing my own teaching, I’m intending to add more process-based instructions, on the grounds that encouraging a certain behaviour in the production process is more likely to lead to a successful product, than specifying an end product and hoping that the path taken is the ‘right’ one. This isn’t exactly rocket science, it’s well established in how we should be constructing these activities, but it does require the educator to keep a clear head on whether we are discussing the product or process.
When a student has established enough understanding, and hopefully all will by the end of the process, then I can ease back on these linguistic scaffolds and expect a little more “this means that” in their everyday activity, but at the start of the educational process, it is probably better if I always try consider how I specify these potentially ambiguous noun/verb pairs. After all, if a student could pick this up by osmosis or plain exposure to the final product (or even by neurolinguistic programming through the mere mention of the name of the artefact) then I would be thoroughly unnecessary as an educator!
I strive to reduce ambiguity and this requires me to think, very carefully, about how my words are read by students who are not even in the foothills of mastery. Reorienting my own thinking to clearly separate product from process, and labelling and treating each clearly and separately, is an important reminder to me of how easy it is to confuse students.




