Good Design: Building In Important Features From the Start

The game “Deus Ex” is widely regarded as one of the best computer games that has been made so far. It has won a very large number of “best game” awards and regularly shows up in the top 5 of lists of “amazing games”. Deus Ex was released in 2000, designed and developed by Ion Storm under Warren Spector and Harvey Smith and distributed by Eidos. (I mentioned it before in this post, briefly.) Here is the description of this game from Wikipedia:

Set in a dystopian world during the year 2052, the central plot follows rookie United Nations Anti-Terrorist Coalition agent JC Denton, as he sets out to combat terrorist forces, which have become increasingly prevalent in a world slipping ever further into chaos. As the plot unfolds, Denton becomes entangled in a deep and ancient conspiracy, encountering organizations such as Majestic 12, the Illuminati, and the Hong Kong Triads throughout his journey.

Deus Ex had a cyberpunk theme, a world of shadowy corporations and many corruptions of the human soul, ranging from a generally materialistic culture to body implants producing cyborg entities that no longer had much humanity. While looking a lot like a First-Person Shooter (you see through the character’s eyes and kill things), the game also had a great deal of stealth play (sneaking around trying very hard not to get noticed, shot or both). However, what sets DE apart from most other games it that the choice of how you solved most of the problems was pretty much left up to you. This was no accident. The fact that you could solve 99% of the problems in the game by using different forms of violence, many forms of stealth or a combination of these was down to the way that the game was designed.

When I was at Game Masters at ACMI, Melbourne, over the weekend, I was able to read the front page of a document entitled “Just What IS Deus Ex” by Warren Spector. Now, unfortunately, they had a “no photographs” rule so I don’t have a copy of it (and, for what it’s worth, I also interpreted that to mean “no tiresome hand transcription onto the iPhone in order to make a replica” ) but one of the most obvious and important design features was that they wanted to be able to support player exploration: players’ actions had to have consequences and players needed to be able to make their plans, without feeling constrained by the world. (Fortunately, while not being the actual document, there is an article here where Warren talks about most of the important things. If you’re interested in design, have a look at it after you’ve finished this.) Because of this, a number of the items in the game can be used in a number of quite strange ways and, while it appears that this is a bug, suddenly you’ll run across an element of the game that makes you realise that the game designers knew that this was possible.

Do not climb if red lights active!

For example, in the Triad-run Hong Kong of 2052, there is a very tall tower on one edge of the explorable area. There are grenades (LAMs)in the game that adhere ‘magnetically’ to walls and then explode if armed and someone enters their proximity. However, it is possible to use these grenades to climb up walls, assuming you don’t arm them of course, by sticking them to walls, getting close enough to hop up, placing another grenade above you and then doing the same thing. With patience, you can climb quite high. Sounds like a bug, right? Yeah, well, that’s what I thought until I climbed to the top of the tower in Hong Kong and found a guy, one of the Non-Player Characters, standing on top.

This was a surprise but it shouldn’t have been. I’d already realised that there was always more than one way to do things and, because the game was designed to make it is as easy as possible for me to try many paths to achieve success, the writer had put in early hints designed to discourage a ‘blow everything up’ approach. The skill system makes it relatively easy for you to make your life a lot easier by working with what is already in the environment rather than trying to do it all yourself.

In terms of the grenades, rather than just being pictures on a wall, they became real world objects when placed and were as solid as any other element. This allowed them to be climbed and the designers/programmers recognised this by putting a guy on top of a tower that you had no other way to get to (without invoking cheats). The objects in Deus Ex were designed to be as generally usable as possible. The sword could open crates as well (Ok, well much better) than a crowbar could and reduced the need to carry two things. Many weapons came with multiple ammunition types, allowing you to customise your load out to the kind of game you wanted to play. Other nice features included the fact that there very few situations of ‘spontaneous creation’, where monsters appeared at some point in a scripted scene, which would have enforced a certain approach. If you were crawling in somewhere from completely the wrong side, everything would be there and ready, rather than all spontaneously reappearing when you happened to approach from the ‘triggering’ side.

In short, it felt like a real world. (With the usual caveat regarding it being a real world where you are a killer cyborg in 2052.)

The big advantage of this is that you feel a great deal of freedom in your planning and implementation and, combined with the fact that the game reacts and changes to the decisions that you make, this makes the endings of the game feel very personal – when you finally choose between the three possible endings, you do so feeling like the game is actually going along with the persona that you have set up. This increases the level of engagement, achievement and enjoyment.

One of Mark Guzdial’s recent posts talked about the importance of good design when it comes to constructing instructional materials and I couldn’t agree more. Good design at the start, with a clear idea of what you’re trying to achieve, allows you to build a consistent experience that will allow you and your students to achieve your objectives. Deus Ex is, in my opinion, considered one of the best games of the 21st century because it started from a simple and clear design document that was set out to maximise the degree of influence that the player could feel in the game – everyone who plays Deus Ex takes their own path through it, has their own experience and gets something slightly different out of it.

I’m not saying it’s that easy for educational design as a global issue, but it is a very good reminder of why we should be doing good design at the very beginning of our courses!


Puppet on a String: A Summary of My Corruption by Extrinsic Rewards

I recently posted that I was thinking about my own contributions and asking what, if anything, would denote something that could be recognised as my mastery of my discipline. On thinking about this, I realised that, once again, I was asking someone else to value my work. For those of you who are educational specialists, rather than a discipline researcher who is on his way to becoming an educational researcher within the discipline, this is probably somewhat amusing, given I keep talking about the need to reduce extrinsic motivation in my students.

I have changed career several times and, if you look at why I’ve done this, a pattern quickly emerges. I tend to leave at the point where I have become competent enough that other people start to tell me that what I am doing is useful, valuable and start trying to reward me. Yet, I go into jobs seeking that kind of recognition and reward. I am corrupted in my intent, by the rewards, and then my intrinsic reward mechanisms become compromised and, after becoming deeply unhappy, I leave.

I realised, over the weekend, that I was becoming so pre-occupied with external approval that it was making me extremely vulnerable to criticism and it was corrupting me in trying to do something that is, whether I like it or not, very important and that I also happen to be good at.

Right now, I am in the middle of trying to work out how to divorce myself from the external rewards that I, irritatingly, crave and that, ultimately, then reduce the joy I take in doing things for my own reasons. It’s not surprising that the tasks that I enjoy the most at the moment are the big challenges, the ones where I’m working several levels above my pay grade or the usual expectations of someone of my level. I’m doing these things because they’re important and, because I’m doing it ‘out of cycle’ so to speak, I can’t be externally rewarded for them – I can just do a good job.

It’s in this same mode of thinking that I’ve decided not to spend any time applying for any local teaching and excellence awards. (I was about to comment on my potential eligibility but this is just another quest for a pat on the head – so I’ve deleted it.) I am either doing my job in the way that I should, and the expectations should be of a satisfactory performance that provides students with an excellent experience, or I should receive guidance, counselling and remedial assistance from my employer. Ultimately, if I don’t meet the standards then I should probably be fired. But if I’m doing well, then that is my job and I don’t need a piece of paper or a cheque to make things better. In fact, that money and time (in deciding upon the awards or writing the applications) should be directed to people who need the improvement, not people who are excelling. I have a meeting with my boss on Friday week and he will tell me whether I’m meeting standard or not.

Now there is a great deal of difference between writing a long application for an award (which is probably not the best investment of time and is seeking extrinsic recognition) and being sent on a course that might be useful because you’ve demonstrated an ability to do something (providing you with useful skills and the ability to develop further). As a general principle, skill development is going to be more useful than a pat on a head. Skill development also works for everyone, it’s just that the courses you use for development vary from person to person.

But this is, of course, completely at odds with the extensive systems of measurement that are now being placed on academics. We are (with widely varying levels of accuracy) measured extensively in terms of learning and teaching, research and administration. By not applying for these awards, I may be significantly altering my possibility of later promotion and opportunity. And, yet, I have to ask myself if I really need to be promoted? What does it mean? I’ve already discovered that people are happy to let you do a wide range of jobs without the requisite ‘academic level’ if you can demonstrate enough aptitude. Sure, it would mean I’d never be able to do certain jobs but, having a look at those jobs, I’m not sure that’s such a bad thing. 🙂

This is a strange time for me. I can now see the strings around me and how they’ve pulled me around for all of my life. Because I am such a strong believer in being as honest as possible with my students, it has forced me to be honest with myself, as I tear apart the framework I teach within to see how I can improve it and help my students to become self-regulated, intrinsically motivated and happy. Authenticity is the core for me and it is why I can teach with passion.

I was looking at Facebook recently and thinking about the “Like” button. I use it to mean “I am happy about this” or “I support you” but, rather than telling someone this, I hit the “Like” button. I’ve recently noticed that there are “Like” levels in WordPress and as I’ve hit, arbitrary, milestones I’ve received insincere automated badges.

Some of my readers (thank you, again) have been letting me know how they have been using the stuff from here and that has been really helpful for me. I realise that, in this community, “Like” generally means “I agree” or “Nicely written thoughts that ring true” but getting an actual account of how someone has used something that I said turned out to be really powerful. (Unsurprisingly, given how much Kohn I’m reading at the moment!)

So – where to from here? The first thing is to keep to my 40-45 hour working week. That has allowed me to get enough reflection time to get to this stage. I suspect the next is to keep plugging away at everything. This is most definitely not the time to throw everything in the air and meditate in a field. I’ve been trying to think about the advice that I would give to a student in a similar situation and I think I would tell them to keep doing everything and set some time aside over the next couple of weeks to identify the key issues, then start stripping away clutter until they were able to get a clear view of how they could achieve what was important to them. It will, at least, be a start.


Wrath of Kohn: Well, More Thoughts on “Punished by Rewards”

Yesterday, I was discussing my reading of Alfie Kohn’s “Punished by Rewards” and I was talking about a student focus to this but today I want to talk about the impact on staff. Let me start by asking you to undertake a quick task. Let’s say you are looking for a new job, what are the top ten things that you want to get from it? Write them down – don’t just think about them, please – and have them with you. I’ll put a picture of Kohn’s book here to stop you looking ahead. 🙂

It’s ok, I’ll wait. Written your list?

How far up the list was “Money”? Now, if you wrote money in the top three, I want you to imagine that this new job will pay you a fair wage for what you’re going to do and you won’t have any money troubles. (Bit of a reach, sometimes, I know but please give it a try.) With that in mind, look at your list again.

Does the word “excellent incentive scheme” or “great bonus package” figure anywhere on that list? If it does, is it in the top half or the bottom half? If Money wasn’t top three, where was it for you?

According to Kohn, very few people actually to make money the top of their list – it tends to be things like ‘type of work’, ‘interesting job’, ‘variety’, ‘challenge’ and stuff like that. So, if that’s the case, why do so many work incentive schemes revolve around giving us money or bonuses as a reward if, for the majority of the population, it’s not the thing that we want? Well, of course, it’s easy. Giving feedback or mentoring is much harder than a $50 gift card, a $2,000 bonus or 500 shares. What’s worse is, because it’s money, it has to be allocated in an artificial scarcity environment or it’s no longer a bonus, it’s an expectation. If you didn’t do this, then the company might go bankrupt.

What if, instead, when you did something really good, you received something that made it easier for you to do all of your work as a recognition of the fact that you’re working a lot? Of course, this would require your manager to have a really good idea of what you were doing and how to improve it, as well as your company being willing to buy you that backlit keyboard with the faux-mink armrest that will let you write reports without even a twinge of arm strain. Some of this, obviously, is part of minimum workplace standards but the idea is that you get something that reflects that your manager understands what you’ve done and is trying to help you to develop further. Carefully selected books, paid trips to useful training, opportunities to further display your skill – all of these are probably going to achieve more of the items on your 10-point list than money will. To quote Kohn, quoting Gruenberg (1980), “The Happy Worker: An Analysis of Educational and Occupational Differences in Determinants of Job Satisfaction”, American Journal of Sociology, 86, pp 267-8:

“Extrinsic rewards become an important determinant of overall job satisfaction only among workers for whom intrinsic rewards are relatively unavailable.”

There are, Kohn argues, many issues with incentive schemes as reward and one of these is the competitive environment that it fosters. I discussed this yesterday so I’ll move to one of the other, which is focusing on meeting the requirements for reward at the expense of quality and in a way that is as safe as possible. Let me give you an example that I recently encountered outside of work: Playing RockBand or SingStar (music games that score your performance). Watch me and my friends who actually sing playing a singing game: yes, we notice the score, but we don’t care about the score. We interpret, we mess around, we occasionally affect the voices of the Victorian-era female impersonator characters from Little Britain. Then watch other groups of people who are playing the game to make the highest score. They don’t interpret. They don’t harmonise spontaneously. In many cases, they barely even sing and focus on making the minimum tunefully accurate noise possible at exactly the right time, having learned the sequence, to achieve the highest score. The quality of the actual singing is non-existent, because this isn’t singing, it’s score-maximisation. Similarly, risk taking has been completely removed. (As an aside, I have excellent pitch and, to my ears, most people who try to maximise their score sound out of tune because they are within the tolerances that the game accepts, but by choosing not to actually sing, there is no fundamental thread of musicality that runs through their performance. I once saw a professional singer deliver a fantastic version of a song, only to be rated as mediocre by the system,)

On Saturday, my wife and I went to the Melbourne-based Australian Centre for the Moving Image (ACMI) to attend the Game Masters gaming exhibition. It was fantastic, big arcade section and tons of great stuff dedicated to gaming. (Including the design document for Deus Ex!) There were lots of games to play, including SingStar (Scored karaoke), RockBand (multi-instrument band playing with feedback and score) and some dancing games. Going past RockBand, Katrina pointed out how little fun the participants appeared to be having and, on looking at it, it was completely true. The three boys in there were messing around with pseudo-musical instruments but, rather than making a loud and joyful noise, they were furrowed of brow and focused on doing precisely the right things at the right times to get positive feedback and a higher score. Now, there are many innovations emerging in this space and it is now possible to explore more and actually take some risks for innovation, but from industry and from life experience, it’s pretty obvious that your perception of what you should be doing and where the reward is going to come from make a huge difference.

If your reward is coming from someone/something else, and they set a bar of some sort, you’re going to focus on reaching that bar. You’re going to minimise the threats to not reaching that bar by playing it safe, colouring inside the lines, trying to please the judge and then, if you don’t get that reward, you’re far more likely to stop carrying out that activity, even if you loved it before. And, boy, if you don’t get that reward, will you feel punished.

I’m not saying Kohn is 100% correct, because frankly I don’t know and I’m not a behaviourist, but a lot of this rings true from my own experience and his use of the studies included in his book, as well as the studies themselves, are very persuasive. I look forward to some discussion on these points!


A (Confusingly) Rewarding Read: Reading Kohn’s Punished By Rewards

I’ve been flying a lot and, as the electronic gadgets have to be off for a while, I’ve been carrying books to read. The one that held my interest on the flight from Adelaide to Darwin was Kohn’s “Punished by Rewards: The Trouble with Gold Stars, Incentive Plans, As, Praise, and Other Bribes.” This is not a discipline text by any stretch of the imagination and, both as it is written for someone who isn’t very familiar with behaviourist terminology and is fairly critical of what it defines as behaviourism, it’s always important to be reserved in taking texts like this without reading around, looking for earlier critiques and being a little skeptical to start with. However, with that said, there’s a lot to think about in here.

Kohn’s fundamental thesis is that incentive schemes that are designed to manipulate or implicitly coerce us into ‘desirable’ behaviour tend to have the opposite effect. He presents a wide range of studies, unfortunately from a perspective that is fairly anti “behaviourism-of-the-60s-to-early-90s”, but his overall findings and reports are very interesting.

I’ve talked about how setting up extrinsic reward structures always runs the risk of making people optimise their behaviour for the reward, without regard to the desired behavioural change, and this, combined with a difficulty in quantifying what it is that people actually do in any way that assesses quality, tends to make people focus on doing the minimum possible to achieve the reward. In other words, pay people a bonus for producing the most letter boxes a day and, chances are, the person who gets the bonus may have made the worst letter boxes because they were focused on quantity and not quality. The other, and to me very counterintuitive, finding was that associating a reward with something that you previously found desirable can have the unintended consequence of making you value it less, either because if someone has to bribe you to do it, it can’t be that great, or because, like most people, you don’t like being manipulated and your intrinsic motivations are swamped by negative associations with the new extrinsic motivator.

Praise, itself, comes under the microscope as well, as it always carries the risk of making someone focus on pleasing you, rather than doing the job correctly. Praise is also often used as a manipulation tool to enforce compliance (Isn’t Johnny a good boy for sitting so quietly! Why, I think he’s the quietest boy in the room!) and this often leads to resentment, as well as the obvious divisions that occur when you praise one person/group and not other.

One of the most interesting points from this book, which we all know but often don’t consider, is that in an environment where praise is given, the absence of praise can be as negative as punishment because, by definition, if you’re not being praised then you’re not good enough. Rather than leading to some invisible-hand-led revolution into productivity and compliance, all too often this leads to resentment, defiant semi-compliance and disengagement.

Kohn discusses feedback, rather than praise, and focusing on the objective, rather than the subjective. This is not to say that he completely condemns praise, or for that matter reward-as-incentive, but he is strongly opposed to the widespread use that we see today. Yes, the interpretation of praise varies across people and age groups and it’s often  impossible to strip all emotional content from good feedback, but he suggests that being aware of it allows us to be less prone to over-praising, being seen as over-praising and focusing on the essential person (which is largely immutable) rather than a skill or practice that cam be enhanced with feedback. His specific suggestions, including his examples, are:

  1. Don’t praise the person, praise what they do: “That’s a good story” is a good way to discuss good work, rather than saying “You’re such a good writer”, which (especially with children) can be seen as insincere or patronising, especially if the child is aware of the divide between their works and those of others. Personal, rather than activity-driven, praise can lead to a loss of interest in the activity.
  2. Make praise as specific as possible. Focus on the act and call attention to the specific components that are innovative, as an example, or otherwise worthy of notice. “That’s a really nice story” says one thing but by saying “The ending is good where you leave the main character confused as to what happened to him” the student then can see what your standards are and contextualise your feedback.
  3. Avoid phony praise. If you’re genuinely thrilled by something, then (obviously) let people know, but Kohn advises against employing false praise when you catch someone in the act of doing something that you want them to do (behavioural reinforcement). Especially if you use that Glinda the Good Witch voice that most of us remember from our childhood, which is about as genuine and warming as a three dollar bill.
  4. Avoid praise that sets up a competition. Kohn suggests that saying “You’re the best in the class/school/department” in public has just divided the group into One Person and The Rest. Praising someone like this in public leads to competitive behaviour, which will inhibit cooperation, collaboration and all of the educational benefits that you could have obtained had you read your Vygotsky.

The sinister thing about item 4 is that praise handed out in this way gives a lot of power to the rating body. If you, as an individual educator, pick someone out as being the most well-behaved or quietest child, then you have told everyone in the room that they have to please YOU in order to get the nice praise reward. No one is actually reflecting on being quiet or well-beheaved, they’re thinking about what they have to do (most likely the minimum) in order to get that nice warm feeling from you.

Don’t believe me? When someone picks up a mistake in a presentation and suggests a correction, then if they are praised (maybe given a small prize, a jelly bean) Kohn’s thesis suggests that, if you have a subsequent error, more people will spot that mistake because they have switched their behaviour from learning from or listening to you to scanning the notes for mistakes in order to achieve extrinsic reward. I’ve certainly seen that behaviour in class and, worse, I can remember doing that in school when the ‘smart’ kids would get personally praised in class for picking up errors on the blackboard.

I’ll write some more on Kohn for tomorrow. I still have to finish the last of the book and then read through all of the critiques, I’ve read a couple, so I hope to write a later post on this from an opposing viewpoint.


The Fisher King: Achievement as Journey, rather than Objective

(There are spoilers for the 1991 movie “The Fisher King” contained within, so proceed forewarned.)

It is sometimes hard for students to understand why undertaking a particular piece of work, in a certain way and at a certain time, is so important to us. For us, as educators, knowledge is developed and constructed through awareness, practice, understanding and application, as well as the further aspects of higher-level intellectual development. When we teach something, doing the assigned homework or assignment is an important reinforcing step. We can regard these assignments in two ways: formative (where we provide feedback and use it to guide improvement) and summative (where we measure the degree to which the students have achieved the standard required, compared to some benchmarks that are important to the course). Summative activities tend to be at the end of instructional units and formative tend to be throughout, for the obvious reasons, but, more pertinently to the discussion at hand, summative activities are often seen as “high-stakes”, where formative are seen as “low”.

The problem with a high-stakes activity is that we can inadvertently encourage behaviour, such as copying, plagiarism or cheating, because students feel so much pressure to achieve and they don’t feel that there is sufficient possibility of redemption in the face of not achieving the required standard. (And, yes, from a previous post, some people start out with the intention to cheat but I shall ignore them for all of the reasons that I have previously stated.)

Ultimately, all of our assignments contribute to the development of knowledge – or they should. The formative ones, as we know, should be placed to encourage the exchange of views between student and teacher, allowing us to guide and shape in an ongoing way, where the summative ones allow us to draw a line and say “Knowledge attained, now we can move on.” Realistically, however, despite the presence of so many summative assessments during and at the end of each course, the journey through University is just that – a journey – and I sometimes present it in this light to those students who have difficulty understanding the “why” of the assignments. I try never to resort to “because I say so”, as this really exchanges no knowledge, but I’m too honest to tell that I’m not at least tempted to say this sometimes!

One of my favourite movies is the 1991 Terry Gilliam film “The Fisher King“, with Robin Williams, Jeff Bridges, Mercedes Ruehl and Amanda Plummer. This is loosely based on legend of The Fisher King, from the often contradictory and complicated stories that have arisen around the Holy Grail over the last few hundred years, and I don’t have the time to go into detail on that one here! But the core is quite simple. One man, through a thoughtless and cruel act, causes a chain of events that leads to the almost total destruction of another’s world. Meeting each other, when both are sorely wounded by their troubles, they embark upon a journey that offers redemption to the first and healing to the second. (This is perhaps the most vague way to tell a fantastic story. I strongly recommend this movie!)

The final aspect of the movie is Jack’s quest to retrieve a simple cup that Parry has identified as the Holy Grail, and that Parry has been seeking since his descent into madness. After a beating that leaves Parry comatose in hospital, Jack dons Parry’s anachronistic garb and breaks into the house of a famous architect to retrieve the simple cup. When there, he also manages to save the architect’s life, redeeming himself through both his desire to challenge his own boundaries to seek the cup for Parry and by counter-balancing his previous cruelty with an act of life-saving kindness. The cup is, of course, still a cup but it is the journey that has brought Jack back to humanity and, as he hands the simple cup to Parry who lies unseeing in a hospital bed, it is the journey that transforms the cup into the grail for long enough that Parry wakes up.

We are all on a journey, one that we set out on when we were born and one that will finish when we breathe our last, but I think our reactions to the high-stakes events in our lives are so often a reflection of those who taught us, seen through the lens of our own personality. That’s why I like to talk to students about the requirements for the constant challenges, the quests, the moments that are high-stakes, in the context of their wider journey – in the quest for knowledge, rather than the meeting of requirements for a degree.

Are you just after the piece of paper for your degree? Need the credits? Then cheating is, in some ways of thinking, a completely valid option if you can rationalise it.

Are you on a journey to develop knowledge? Need to understand everything? Then cheating is no longer an option.

Knowledge is transforming. There is no doubt about this. We learn something new and it changes the world, or us, or both! When we learn something well enough, we can create new knowledge or share our knowledge with new people. There is no doubt that the journey transforms the mundane around us into something magical, occasionally something mystical, but it is important to see it as a journey that will help us to build our achievements, rather than a set of objectives that we tick off to achieve something that is used as a placeholder for the achievement.

As I always say to my students, “If you have the knowledge, then you’re really likely to pass the course and do well. If you just try and study for the exam, then you’re not guaranteed to have the knowledge.” Formative or summative, if you regard everything we’re doing as steps to increase your knowledge, and we construct our teaching in order to do that, the low stakes and the high stakes have similar benefit, even if one isn’t so much constructed for direct feedback. If we also make sure that we are not dismissive in our systems and can even offer redemption in cases of genuine need, then our high stakes become less frightening and there is no Red Knight stalking our moments of peace and happiness, forcing us into dark and isolated pathways.


The Big Picture and the Drug of Easy Understanding: Part II (Eclectic Boogaloo)

In yesterday’s post, I talked about the desire to place work into some sort of grand scheme, referring to movies and films, and illustrating why it’s hard to guarantee consistency from a sketch of your strategy unless you implement everything before you make it available to people. While building upon previous work is very useful, as I’m doing now, if you want to keep later works short by referring back to a shared context established in a previous work, it does make you susceptible to inconsistency if a later work makes you realise that assumptions in a previous work were actually wrong. As I noted in yesterday’s post, I’m actually writing these posts side by side and scheduling them for later, to ensure that I don’t make any more mistakes than I have to, which I can’t easily correct because the work is already displayed.

Some strategies are easier to imagine than others.

Strategic approaches to the construction of long term and complex works are essential, but a strategic plan needs to be sufficiently detailed in order to guide the works produced from it. You might get away with an abstract strategy if you produce all of the related works at one time and view them together. But, assuming that works are so long term that they can’t be produced in one sitting, you don’t want to have to seriously revise previous productions or, worse, change the strategy. This is particularly damaging when you are working with students because any significant change to the knowledge construction that you’ve been working with is going to cost you a lot of credibility and risk a high level of disengagement. Students will tolerate an amount of honest mistake, assuming that you are honest and that it is a mistake, but they tend to be very judgmental regarding poor time planning and what they perceive as laziness.

And that, in my opinion, is completely fair because we tend not to allow them poor time planning either. Going into an examination with a misunderstanding of the details of the overlying strategy will result in a non-negotiable fail, not extended understanding from the marking groups who are looking at examination performance. For me, this is an issue of professional ethics in that a consistent and fair delivery of teaching materials will facilitate learning, firstly by keeping the knowledge pathways ‘clean’ but also by establishing a relationship that you are working as hard to be fair to the student as you can, hence their effort is not wasted and you establish a bond of trust.

Now while I would love to say that this means that I have written every lecture completely before starting a new course, this would not be the truth. But this does mean that my strategic planning for new works and knowledge is broken down to a fairly fine grain plan before I start the course running. I wrote a new course last semester and the overall course had been broken up by area, sub-area, learning outcome and was built with all practicals, tutorials and activities clearly indicated. I had also spent a long time identifying the design of the overall course and the focus that we would be taking throughout, down to the structure of every lecture. When it came to writing the lectures themselves, I knew which lectures would contain ‘achievement’ items (the drug aspect where students get a buzz from the “A-ha!” moment), I knew where the pivotal points were and I’d also spent some time working out which skills I could expect in this group, and which skills later courses would expect from them.

We do have a big picture for teaching our students, in that they are part of a particular implementation of a degree that will qualify them in such-and-such a discipline. We can see the discipline syllabi, current learning and teaching practices, our local requirements and the resources that we have to carry all of this out. But this is no longer a strategy and, the more I worked with things, the more I realised that I had produced a tactical (or operational) plan for each week of the lectures – and I had to be diligent about this because one third of my lectures were being given by someone who was a new lecturer. So, on top of all the planning, every lecture had to be self-contained and instructionally annotated so that a new lecturer, with some briefing from me, could carry it out. And it all had to fit together so that structurally, semantically and stylistically, it all looked like one smooth flow.

Had I left the strategic planning to one side, in either not pursuing it or in leaving it too late, or had I not looked at all of the strategic elements that I had to consider, then my operational plan for each week would have been ad hoc or non-existent. Worse, it may have been an unattainable plan; a waste of my time and the students’ efforts. We have far less excuse than George Lucas does for pretending that Star Wars was part of some enormous nine movie vision – although, to be fair, it doesn’t mean that this wasn’t somewhere in his head, but it obviously wasn’t sufficiently well plotted to guarantee a required level of consistency to make us really believe that statement.

The Big Picture is a framing that helps certain creative works drag you in and make more money, whereas in other words it is a valid structure that supports and develops consistency within a shared context. Our work as educators fits squarely into the final category. Without a solid plan, we risk making short-sighted decisions that please us or the student with ‘easy’ reward activities or the answers that come to hand at the time.

I’m not saying that certain elements have to be left out of our teaching, or that we have to be rigid in an inflexible structure, but consistency and reliability are two very important aspects of gaining student trust and, if holding it together over six serial instalments is too hard for Stephen King, then trying to achieve this, without some serious and detailed planning, over 36 lectures spanning four months is probably too much for most of us. The Big Picture, for us, is something that I believe we can find and use very effectively to make our teaching even better, effectively reducing our workload throughout the semester because we don’t have to carry out massive revisions or fixes, with a little more investment of time up front.

(Afterthought: I had no idea that Dr Steele has released an album called “Eclectic Boogaloo”. I was riffing on the old “Breakin’ 2: Electric Boogaloo” thing. In my defence, it was the 80s and we all looked like this:

This is considered one of the worst movies ever made. Yes, even when you take Gigli into account.

)


The Big Picture and the Drug of Easy Understanding: Part I

There is a tendency to frame artistic works such as films and books inside a larger frame. It’s hard to find a fantasy novel that isn’t “Book 1 of the Mallomarion Epistemology Cycle” or a certain type of mainstream film that doesn’t relate to a previous film (as II, III or higher) or as a re-interpretation of a film in the face of another canon (the re-re-reboot cycle). There are still independent artistic endeavours within this, certainly, but there is also a strong temptation to assess something’s critical success and then go on to make another version of it, in an attempt to make more money. Some things were always multi-part entities in the planning and early stages (such as the Lord of the Rings books and hence movies), some had multiplicity thrust upon them after unlikely success (yes, Star Wars, I’m looking at you, although you are strangely similar to Hidden Fortress so you aren’t even the start point of the cycle).

From a commercial viewpoint, selling something that only sells itself is nowhere near as interesting as selling something that draws you into a consumption cycle. This does, however, have a nasty habit of affecting the underlying works. You only have to look at the relative length of the Harry Potter books, and the quality of editing contained within, to realise that Rowling reached a point where people stopped cutting her books down – even if that led to chapters of aimless meandering in a tent in later books. Books one to three are, to me, far, far better than the later ones, where commercial influence, the desire to have a blockbuster and the pressure of producing works that would continue to bring in more consumers and potentially transfer better to the screen made some (at least for me) detrimental changes to the work.

This is the lure of the Big Picture – that we can place everything inside a grand plan, a scheme laid out from the beginning, and it will validate everything that has gone before, while including everything that is yet to come. Thus, all answers will be given, our confusion will turn to understanding and we will get that nice warm feeling from wrapping everything up. In many respects, however, the number of things that are actually developed within a frame like this, and remain consistent, is very small. Stephen King experimented with serial writing (short instalments released regularly) for a while, including the original version of “The Green Mile”. He is a very talented and experienced writer and he still found that he had made some errors in already published instalments that he had to either ignore or correct in later instalments. Although he had a clear plan for the work, he introduced errors to public view and he discovered them in later full fleshings of the writing. He makes a note in the book of the Green Mile that one of the most obvious, to him, was having someone scratch their nose with their hand while in a straitjacket. Not having all of the work to look at leaves you open to these kinds of errors, even where you do have a plan, unless you have implemented everything fully before you deploy it.

So it’s no surprise that we’re utterly confused by the prequels to Star Wars, because (despite Lucas’ protestations), it is obvious that there was not even a detailed sketch of what would happen. The same can be said of the series “Lost” where any consistency that was able to be salvaged from it was a happy accident, as the writers had no idea what half of the early things actually were – it just seemed cool. And, as far as I’m concerned, there is no movie called Highlander 2.

Seriously, this is just someone attempting Photoshop. Anything else is untrue.

(I should note that this post is Part 1 of 2, but I am writing both parts side by side, to try and prevent myself from depending in Part 2 upon something that I got wrong in Part 1.)

To take this into an educational space, it is tempting to try and construct learning from a sequence of high-reward moments of understanding. Our students are both delighted and delightful when they “get” something – it’s a joy to behold and one of the great rewards of the teacher. But, much like watching TED talks every day won’t turn you into a genius, it is the total construction of the learning experience that provides something that is consistent throughout and does not have to endure any unexpected reversals or contradictions later on. We don’t have a commercial focus here to hook the students. Instead, we want to keep them going throughout the necessary, but occasionally less exciting, foundation work that will build them up to the point where they are ready to go, in Martin Gardner’s words, “A-ha!”

My problem arises if I teach something that, when I develop a later part of the course, turns out to not provide a complete basis, reinterprets the work in a way that doesn’t support a later point or places an emphasis upon the wrong aspect. Perhaps we are just making the students look at the wrong thing, only to realise later that had we looked at the details, rather than our overall plan, we would have noticed this error. But, now, it is too late and the wrong message is out there.

This is one of the problems of gamification, as I’ve referred to previously, in that we focus on the drug of understanding as a fiero (fierce joy) moment to the exclusion of the actual education experience that the game and reward elements should be reinforcing. This is one of the problems of stating that something is within a structure when it isn’t: any coincidence of aims or correlation of activities is a happy accident, serendipity rather than strategy.

In tomorrow’s post, I’ll discuss some more aspects of this and the implications that I believe it has for all of us as educators.


HERDSA 2012: Final Keynote, “Connecting with the Other: Some ideas on why Black America likes to sing Bob Dylan”, Professor Liz McKinley

I’ve discussed this final talk in outline but it has had such an impact on me that I wanted to share it in its own post. This also marks the end of my blogging from HERDSA, but I’m sure that you’ve seen enough on this so that’s probably a good thing. (As a note, the next conference that I’ll be at is ICER, in September, so expect some more FrenetoBlogging (TM) then.)

Professor Elizabeth (Liz) McKinley has a great deal of experience in looking at issues of otherness, from her professional role in working with Māori students and postgraduates, and because she is of Ngāti Kahungunu ki Wairarapa and Ngāi Tahu descent herself. She began her talk with a long welcome and acknowledgement speech in an indigenous language (I’m not sure which one it was and I haven’t been able to find out), which she then repeated in English, along with an apology to the local indigenous peoples for her bad pronunciation of some of their words.

She began by musing on Bob Dylan, poet, protest song writer, and why his songs, especially “Blowing in the Wind”, were so popular with African Americans. Dylan’s song, released at a turbulent time in US History, asked a key question: “How many roads must a man walk down, before you call him a man?” At a time when African Americans were barely seen as people in some quarters, despite the Constitutional Amendments that had been made so long before, these lyrics captured the frustrations and aspirations of the Black people of the US and it became, in Professor McKinley’s opinion, anthemic in the civil rights movement because of this. She then discussed how many of Bob Dylan’s other songs had been reinterpreted, repurposed, and moved into the Black community, citing “Mr Tambourine Man” as covered by Con Funk Shun as an example of this. (I have been unable to locate this on Youtube or my usual sources but, I’ve been told, it’s not the version that you’re used to and it has an entirely new groove.)

Reinterpretation pays respect to the poet but we rediscover new aspects about the work and the poet and ourselves when we work with another artist. We learn from each other when we share and we see each other’s way of doing things. These are the attributes that we need to adopt if we want to bring in more underrepresented and disadvantaged students from outside of our usual groups – the opportunities to bring their talents to University to share them with us.

She then discussed social justice education in a loose overview: the wide range of pedagogies that are designed to ameliorate the problems caused by unfair practices and marginalisation. Of course, to be marginalised and to be discriminated against, we must have a dominant (or accepted) form, and an other. It is the Other that was a key aspect of the rest of the talk.

The Other can be seen in two very distinct ways. There is the violent Other, the other that we are scared of, that physically repels us, that we hide from and seek to destroy, sideline or ignore. This is drive by social division and inequity. When Gil Scott-Heron sang of the Revolution that wouldn’t be televised, he was speaking to his people who, according to people who look like me, were a violent and terrifying Otherness that lived in the shadows of every city in America. People are excluded when they don’t fit the mainstream thinking, when we’re scared of them – but we can seek to understand the other’s circumstances, which are usually a predicament, to understand their actions and motivations so that we can ameliorate or remedy them.

But there is also the non-violent Other, a philosophical separation, independent of social factors. We often accept this Other, letting it be different and even seeking knowledge from this unknowable other and, rather than classify it as something to be shunned or feared, we defer our categorisation. My interpretation of this non-violent other is perhaps that of those who seek religious orders, at the expense of married life, even small possessions or a personal life within a community that they control. In many regards this is very much an Otherness but we have tolerated and welcomed the religiously Other into our lives for millennia. It has only been reasonably recently that aspects of this, for certain religious orders, has now started to associate a violent Otherness with the mystical and philosophical Otherness that we would usually associate with clerics.

Professor McKinley went on to identify some of the Others in Australia and New Zealand: the disadvantaged, those living in rural or remote areas, the indigenous peoples. Many of the benchmarks for these factors are set against nations like the UK, the US and Canada. She questioned why, given how different our nations are, we benchmarked ourselves against the UK but identified that all of this target setting, regardless of which benchmarks were in use, were set against majority groups that were largely metropolitan/urban and non-indigenous. In New Zealand, the indigenous groups are the Māori and the Pacific Islanders (PI), but there is recognition that there is a large degree of co-location between these peoples and the lower socio-economic status groups – a double whammy as far as Otherness goes compared to affluent white culture.

Professor McKinley has been heavily involved and leading three projects, although she went to great lengths to thank the many people who were making it all work while she was, as she said, running around telling everyone about it. These three projects were the Starpath Project, the Māori and Indigenous (MAI) Doctoral Programme, and the Teaching and Learning in the Supervision of Māori PhD students (TLRI).

The Starpath Project was designed to undertake research and develop and evaluated evidence-based initiatives, designed to improve educational participation and achievement of students from groups currently under-represented in degree level education. This focuses on the 1st decile schools in NZ, those who fall into the bottom 10%, which includes a high proportion of Māori and PI students. The goal was to increase the number of these students who went into Uni out of school, which is contrary to the usual Māori practice of entering University as mature age students when they have a complexity in their life that drives them to seek University (Liz’s phrase, which I really like).

New Zealand is trying to become a knowledge economy, as they have a small population on a relatively small country, and they want more people in University earlier. While the Pākehā, those of European descent, make up most of those who go to Uni, the major population growth is the  Māori and PI communities. There are going to be increasingly large economic and social problems if these students don’t start making it to University earlier.

This is a 10-year project, where phase 1 was research to identify choke points and barriers in to find some intervention initiatives, and phase 2 is a systematic implementation, transferable, sustainable, to track students into Uni. This had a strong scientific basis with emphasis on strong partnerships, leading to relationships with nearly 10% of the secondary schools in New Zealand, focused on the low decile groups that are found predominantly around Auckland. The partnerships were considered to be essential here and the good research was picked up and used to form good government policy – a fantastic achievement.

Another key aspect, especially from the indigenous perspective, was to get the families on board. By doing this, involving parents and family, guardian participation in activities shot up from 20% to 80% but it was crucial to think beyond the individual, including writing materials for families – parents and children. Families are the locus of change in these communities. Part of the work here involved transitions support for students to get from school to uni, supported by scholarships to show both the students and the community that they can learn and achieve to the same degree as any other student.

One great approach was that, instead of targeting the disadvantaged kids for support, everyone got the same level of (higher) support which normalised the student support and reduced the Otherness in this context.

The next project, the MAI programme, was a challenge to Māori researchers to develop a doctoral programme and support that didn’t ignore the past while still conforming to the academic needs of the present. (“Decolonizing methodologies: Research and Indigenous Peoples” by Linda Tuhiwai Smith, 1999, was heavily referenced throughout this.) Māori students have cultural connections and associations that can make certain PhD work very difficult: consider a student who is supposed to work with human flesh samples, where handling dead tissue is completely inappropriate in Māori culture. It is profoundly easy, as well as lazy, to map an expectation of conformity over the top of this (Well, if you’re doing our degree then you follow our culture) but this is the worst example of a colonising methodology and this is exactly what MAI was started to address.

MAI works through communities, meeting regularly. Māori academics, students and cultural advisors meet regularly to alleviate the pressures of cross-cultural issues and provide support through meetings and retreats.

The final project, the Māori PhD project, was initiated by MAI (above) to investigate indigenous students, to understand why they were carrying out their PhDs. Students were having problem, as with the tissue example above, so the project also provided advice to institutions and to students, encouraging Pākehā supervisors to work with Māori students, as well as the possibility of Māori supervision if the student needed to feel culturally safe. This was a bicultural project, with five academics across four institutions.

From Smith, 1997, p203, “educational battleground for Māori is spatial. It is about theoretical spaces, pedagogical spaces, structural spaces.” From this project there were differences in what the students were seeking and the associated pedagogies. Some where seeking difference from their own basis, an ancestral Māori basis. Some were Māori but not really seeking that culture. Some, however, were using their own thesis to regain their lost identity as Māori.

The phrase that showed up occasionally was a “colonised history” – even your own identity is threatened by the impact of the colonists on the records, memories and freedoms of your people. We had regularly seen colonists move to diminish and reduce the Other, as a perceived threat, where they classify it as a violent other. The third group of students, above, are trying to rebuild what it meant to be Māori for them, in the face of New Zealand’s present state as a heavily colonised country, where most advantage lies with the Pākehā and Asian communities. They were addressing a sense of loss, in the sense of their loss of what it meant to be Māori. This quest for Māori identity was sometimes a challenge to the institution, hence the importance of this project to facilitate bicultural understanding and allow everyone to be happy with the progress and nature of the study.

At this point in my own notes I wrote “IDENTITY IDENTITY IDENTITY” because it became clearer and clearer to me that this was the key issue that is plaguing us all, and that kept coming up at HERDSA. Who are we? Who is my trusted group? How do I survive? Who am I? While this issues, associated with Otherness in the indigenous community, are particularly significant for low SES groups and the indigenous, they affect all of us in this times of great change.

An issue of identity that I have touched on, and that Professor McKinley brought up in her talk, was how we establish the identity of the teacher, in order to identify who should be teaching. In Māori culture, there are three important aspects: Matauranga (Knowledge), Whakapapa (ancestral links) and Tikanga (cultural protocols and customs). But this raises pedagogical issues, especially when two or more of these clash. Who is the teacher and how can we recognise them? There are significant cultural issues if we seek certain types of knowledge from the outside, because we run headlong into Tikanga. These knowledge barriers may not be flexible at all, which is confronting to western culture (except for all of the secret barriers that we choose not to acknowledge). The teachers may be parents, elders, grandparents – recognising this requires knowledge, time and understanding. And, of course, respect.

Another important aspect is the importance of the community. If you, as a Māori PhD student, go to a community and ask them to answer some questions, at some stage in the future, they’ll expect you back to help out with something else. So, time management becomes an issue because there is a spirit of reciprocity that requires the returned action – this is at odds with restricted time for PhDs and the desire for timely completion if you have to disappear for 2 weeks to help build or facilitate something.

Professor McKinley showed a great picture. A student, graduating with PhD gown surmounted by the sacred cloak of the Māori people. They have to have a separate graduation ceremony, as well as the small ‘two tickets maximum’ one in the hall, because community and family pride is strong – two tickets maximum won’t accommodate the two busloads of people who showed up to see this particular student graduate.

The summary of the Other was that we have two views:

  • The Other as a consequence of social, economic and/or political disaffiliation (Don’t pathologise the learning by diagnosing it as a problem and trying to prescribe a remedy.)
  • As an alterity that is independent of social force. (Welcoming the other on their own terms. A more generous form but a scarier form for the dominant culture.)

What can we learn from the other? My difference matters to my institution. We need to ensure that we have placed our ethics into social justice education – this stance allows us how to frame ethics across the often imposed barriers of difference.

Professor McKinley then concluded by calling up some of her New Zealand colleagues to the stage, to close the talk with a song. An unusual (for me) end to an inspiring and extremely thought-provoking talk. (Sadly, it wasn’t Bob Dylan, but it was in Māori so it may have secretly been so!)


HERDSA 2012: Final general talk – that tricky relationship, University/School

When working in Higher Education, you fairly quickly discover that there is not actually a genuine continuum between the school level and the University level. School curricula are set, with some input from the higher ed sector, mostly by school and government, but they have little-to-no voice at the Higher Education level. We listen to our peers across the water and around our country, adopting ACM and IEEE curricula suggestions, but while we have an awareness of what the different sectors are doing (in terms of local school and University) it’s certainly not a strong, bi-directional relationship.

That’s where the Australian government reforms of 2009, designed to greatly improve participation in University, get interesting. We’ve been told to increase participation from lower SES groups who hadn’t previously considered Higher Education. We, that is ‘we the university’, have been told this. Ok. Great. Now some people will (flippantly) start ranting about how we’ll have to drop quality standards to do this – an argument that I feel is both incorrect and somewhat unpleasant in its tone. Given that we haven’t gone out of our way to try and form a continuum before, well some people have but with limited success, we can certainly address some of the problem by identifying higher education as a destination to students who may not have been aware that it was even an option for them.

This is where the work of Dr Karma Pearce comes in, won “Building community, educational attainment and university aspirations through University-School mentoring partnerships”. Dr Pearce’s research was based on developing student aspirations from traditionally disadvantaged regions in South Australia. The aim was to look at the benefits of a University/High School mentoring program conducted in a University setting, targeting final year secondary school students from the low SES schools in the area.

We are all aware of the problems that disadvantaged schools face and the vicious circularity of some of these problems. Take Chemistry. To teach chemistry properly, you need teachers and lab resources, including consumables. It’s not like a computer lab that can be run on oldish equipment in a room somewhere – chemistry labs have big technical and safety requirements, and old chemicals either don’t work or get consumed in reactions. If your lab is bad, your numbers drop because the teaching suffers. If the numbers drop below a certain level for schools in South Australia – the class gets cancelled. Now you have a Chem teacher and no students. Therefore, repurposed teacher or, shortly, no teacher. (Of course, this assumes that you can even get a chemistry teacher.)

The University of South Australia had recently build new chemistry labs in another campus, leaving their old labs (which are relatively near to several traditionally disadvantaged areas) free. To the researcher’s and University’s credit (I’m serious, kudos!) they realised that they could use these labs to support 29 secondary school students from schools that had no chem labs. The school students participated in weekly lecture, tutorial and practical chemistry classes at Mawson Lakes campus, with the remaining theory conducted in their own schools. There were two High School teachers based in two of the schools, with a practical demonstrator based at Mawson Lakes. To add the mentoring aspect, four final year undergraduate students were chosen to be group mentors. The mentors required a minimum of credit (B) level studies for three chemistry courses. The mentor breakdown, not deliberately selected, was three women and one man, with two from private (fee-paying) schools and two from regional state schools. Mentors had transport provided, a polo shirt with logo, were paid for their time and received a significant amount of mentor training as well as a weekly meeting with a University coordinator.

The mentors assisted throughout the 26 week program and, apart from helping with chemistry, shared their experiences of University as they worked with the students. Of the 20 secondary students who completed the program (10 F, 10 M), they indicated in surveys that they thought they now understand what Uni life was going to be like but, more importantly to me, that they thought it was achievable for them. From that group, 35% of them had family who had been to University, but all of the secondary participants who made it to the end of the program had enrolled to go to Uni by the end of their Year 12 studies.

In discussion, a couple of points did emerge, especially regarding the very high teacher/student ratio, but overall the message from the research is pretty positive. Without having to change anything at the actual University level, a group of students, who didn’t come from a “university positive” environment and who were at some of the most disadvantaged schools in the state, now thought that University was somewhere that they could go – their aspirations now included University. What a fantastic result!

One side note, at the end, that I found a little depressing was that some students had opted to go to another University, not UniSA, and at least one gave the reason that they had been lured there by the free iPad that was being issued if you enrolled in a Bachelor of Science. Now, in the spirit of full honesty, that’s my University that they’re talking about and I know enough about the amazing work done by Bob Hill, Simon Pyke and Mike Seyfang (as well as a cast of hundreds) to completely rebuild the course to a new consistent standard, with a focus on electronic (and free) textbooks, to know that the iPad is the icing on the cake (so to speak). But, to a student from a disadvantaged school, one where a student going into medicine (and being the first one in the 50 year history of the school) is Page 3 news in the main state newspaper, an iPad is a part of a completely different world. If this student is away at a camp with students from more privileged background, this device is not about electronic delivery or lightening the text book burden or interactive science displays and instant communication – it’s about fitting in.

I found this overall talk very interesting, because it gave an excellent example of how we can lead educationally by sharing our resources while sharing the difficulties of the high school/University transition, but it also made me think about how students see the things that we do to improve their education. Where I see a lab full of new computers, do students see a sign of stability and affluence that convinces them that we’ll look after them or do they see “ho hum” because they’re only 21″ screens and not the i7 processor?

Once again, when I look at things from my view, what do my students see?


When the Stakes are High, the Tests Had Better Be Up to It.

(This is on the stronger opinion side but, in the case of standardised testing as it is currently practised, this will be a polarising issue. Please feel free to read the next article and not this one.)

If you make a mistake, please erase everything from the worksheet, and then leave the room, as you have just wasted 12 years of education.

A friend on FB (thanks, Julie!) linked me to an article in the Washington Post that some of you may have seen. The article is called “The Complete List of Problems with High-Stakes Standardised Tests” by Marion Brady, in the words of the article. a “teacher, administrator, curriculum designer and author”. (That’s attribution, not scare quotes.)

Brady provides a (rather long but highly interesting) list of problems with the now very widespread standardised testing regime that is an integral part of student assessment in some countries. Here. Brady focuses on the US but there is little doubt that the same problems would exist in other areas. From my readings and discussions with US teachers, he is discussing issues that are well-known problems in the area but they are slightly intimidating when presented as a block.

So many problems are covered here, from an incorrect focus on simplistic repetition of knowledge because it’s easier to assess, to the way that it encourages extrinsic motivations (bribery or punishment in the simplest form), to the focus on test providers as the stewards and guides of knowledge rather than the teachers. There are some key problems, and phrases, that I found most disturbing, and I quote some of them here:

[Teachers oppose the tests because they]

“unfairly advantage those who can afford test prep; hide problems created by margin-of-error computations in scoring; penalize test-takers who think in non-standard ways”

“wrongly assume that what the young will need to know in the future is already known; emphasize minimum achievement to the neglect of maximum performance; create unreasonable pressures to cheat.”

“are open to massive scoring errors with life-changing consequences”

“because they provide minimal to no useful feedback”

This is completely at odds with what we would consider to be reasonable education practice in any other area. If I had comments from students that identified that I was practising 10% of this, I would be having a most interesting discussion with my Head of School concerning what I was doing – and a carpeting would be completely fair! This isn’t how we should teach and we know it.

I spoke yesterday about an assault on critical thinking as being an assault on our civilisation, short-sightedly stabbing away at helping people to think as if it will really achieve what (those trying to undermine critical thinking) actually wanted. I don’t think that anyone can actually permanently stop information spreading, when that information can be observed in the natural world, but short-sightedness, malign manipulation of the truth and ignorance can certainly prevent individuals from gaining access to information – especially if we are peddling the lie that “everything which needs to be discovered is already known.”

We can, we have and we probably (I hope) always will work around these obstacles in information, these dark ages as I referred to them yesterday, but at what cost of the great minds who cannot be applied to important problems because they were born to poor families, in the ‘wrong’ state, in a district with no budget for schools, or had to compete against a system that never encouraged them to actually think?

The child who would have developed free safe power, starship drives, applicable zero-inflation stable economic models, or the “cure for cancer” may be sitting at the back of a poorly maintained, un-airconditioned, classroom somewhere, doodling away, and slowly drifting from us. When he or she encounters the standardised test, unprepared, untrained, and tries to answer it to the extent of his or her prodigious intellect, what will happen? Are you sufficiently happy with the system that you think that this child will receive a fair hearing?

We know that students learn from us, in every way. If we teach something in one way but we reward them for doing something else in a test, is it any surprise that they learn for the test and come to distrust what we talk about outside of these tests? I loathe the question “will this be in the exam” as much as the next teacher but, of course, if that is how we have prioritised learning and rewarded the student, then they would be foolish not to ask this question. If the standardised test is the one that decides your future, then, without doubt, this is the one that you must set as your goal, whether student, teacher, district or state!

Of course, it is the future of the child that is most threatened by all of this, as well as the future of the teaching profession. Poor results on a standardised test for a student may mean significantly reduced opportunity, and reduced opportunity, unless your redemptive mechanisms are first class, means limited pathways into the future. The most insidious thread through all of this is the idea that a standardised test can be easily manipulated through a strategy of learning what the answer should be, to a test question, rather than what it is, within the body of knowledge. We now combine the disadvantaged student having their future restricted, competing against the privileged student who has been heavily channeled into a mode that allows them to artificially excel, with no guarantee that they have the requisite aptitude to enjoy or take advantage of the increased opportunities. This means that both groups are equally in trouble, as far as realising their ambitions, because one cannot even see the opportunity while the other may have no real means for transforming opportunity into achievement.

The desire to control the world, to change the perception of inconvenient facts, to avoid hard questions, to never be challenged – all of these desires appear to be on the rise. This is the desire to make the world bend to our will, the real world’s actual composition and nature apparently not mattering much. It always helps me to remember that Cnut stood in the waves and commanded them not to come in order to prove that he could not control the waves – many people think that Cnut was defeated in his arrogance, when he was attempting to demonstrate his mortality and humility, in the face of his courtiers telling him that he had power above that of mortal men.

How unsurprising that so many people misrepresent this.