The Extrinsic Reward: As Seen in the Wild.
Posted: July 20, 2012 Filed under: Education, Opinion | Tags: community, curriculum, design, education, educational problem, higher education, in the student's head, principles of design, reflection, research, teaching, teaching approaches, thinking Leave a comment“Why should I do it? What’s in it for me?”
How many times have you heard, said or thought the above sentiment, in one form or another? I go to a lot of meetings so I get to hear this one a lot. Reanalysing my interactions with people over the past 12 months or so, it has become apparent how many people are clearly focused on the payoff, and this is usually not related to their intrinsic reward mechanisms.
We get it from students when they ask “Will this be on the test?” (Should I study this? What’s in it for me?) We get it from our colleagues when they look at a new suggestion and say “Well, no-one’s going to do that.” (Which usually means “I wouldn’t do it. What’s in it for me?”) We get it from ourselves when we don’t do something because something else becomes more important – and this is very interesting as it often gives an indicator of where you sit on the work/life balance scale. Where I work, there are a large number of occasions where the rewards mechanisms used can result in actions and thinking patterns that, as an observer, I find both interesting and disturbing.
Let me give you some background on how research funding works in Australia (very brief). You have a research idea or are inside a group that has some good research ideas. You do research. You discover something. You write it up and get it published in conferences and journals. Repeat this step until you have enough publications to have a credible track record. You can now apply for funding from various bodies, so you spend 3-4 weeks writing a grant and you write up your great grant idea, write it up really well, attach your track record evidence as part of your CV, and then wait. In my discipline, ICT, our success rate is very low, and very few of the people who apply for Australian Research Council Discovery Grants get their grants. Now this is, of course, not a lottery – this is a game of skill! Your grant is rated by other people, you get some feedback, you can respond to this feedback (the rejoinder), and the ratings that you originally received, plus your rejoinder, go forward to a larger panel. Regrettably, there is not much money to go around (most grants are only funded at the 50% level of the 22% of grants that get through across the board), so an initial poor rating means that your grant is (effectively) dead.
This makes grants scarce and intrinsically competitive, as well as artificially inflated in their perceived value. Receiving a grant will also get you public congratulations, the money and gear (obviously) and an invitation to the best Christmas cocktail party in the University – the Winner’s Circle, in effect. The same is true if you bring in a heap of research cash of any other kind – public praise, money and networking opportunities.
Which, if you think about it, is rather curious because you have just been given a wodge (technical term) of cash that you can use to hire staff and buy gear, travel to conferences, and basically improve your chances of getting another grant – but you then get additional extrinsic rewards, including the chance to meet the other people who have risen to this level. This is, effectively, a double reward and I suppose I wouldn’t have much of a problem with it, except that we start to run into those issues of extrinsic motivation again which risks robbing people of their inclination to do research once those extrinsic rewards dry up. I note that we do have a scheme to improve the grant chances of people who just missed out on getting Australian Research Council (ARC) funding but it is literally for those people who just missed out.
Not getting a grant can be a very negative result, because the absence of success is also often accompanied by feedback that will force you to question the value of your performance to date, rather than just the work that has been submitted.
When an early career researcher looks at the ARC application process and thinks “What’s in it for me?” – the answer is far more likely to be “an opportunity to receive feedback of variable quality for the investment of several weeks of your life, from people with whom you are actively competing” rather than an actual grant. So this is obviously a point where mentoring, support and (yes) seed funding to be able to improve become very important – as it provides an ability to develop skill, confidence and (hopefully) the quality of the work, leading to success in the future. The core here, however, is not to bribe the person into improving, it’s to develop the person in order that they improve. Regrettably, a scheme that is (effectively) rewarding the rewarded does not have a built-in “and lifting up those who aren’t there” component. In fact, taking on a less experienced researcher is far more likely to hinder a more capable applicant’s chances. When a senior researcher looks at assisting a more junior researcher, under the current system, “What’s in it for me?” is mostly “Reduced chance of success.” Given that this may also cut you out of the Winner’s Circle, as funds dry up, as you are no longer successful, as it then gets harder to do the research and hence get grants, combined with the fact that you can only apply for these once a year… it’s a positive disincentive to foster emerging talent, unless that talent is so talented that it probably doesn’t need that much help!
So the extrinsic manipulation here has a built-in feedback loop and is, regrettably, prone to splitting people into two groups (successful and not) very early on, at the risk of those groups staying separated for some time to come.
If the large body of work in the area is to be believed, most people don’t plan with the long term outcomes in mind (hence, being told that if you work hard you might get a grant in five years is unlikely to change anyone’s behaviour) and on top of that, as Kohn posits, praising a successful person is more likely to cause envy and division than any real improvement. How does someone else being praised tell you how to improve from your current position?
So what does all of this hot air mean for my students?
I have just finished removing all ‘attendance-based’ incentive schemes from my courses – there are no marks being given just for showing up in any form, marks are only achieved when you demonstrate that you have acquired knowledge. Achievement will not generate any additional reward – the achievement will be the reward. Feedback is crucial but, and this will be challenging, everything I say or do must provide the students with a way to improve, without resorting to the more vague areas of general praise. I will be interested to see if this appears to have any (anecdotal) effect upon the number of times someone asks “What’s in it for me?”
Intervention and Risk: An Anonymised Anecdote
Posted: July 19, 2012 Filed under: Education | Tags: advocacy, authenticity, community, design, education, educational problem, educational research, ethics, feedback, higher education, in the student's head, middleware, reflection, student perspective, teaching, teaching approaches, thinking Leave a commentYesterday morning, we found some students sleeping in one of our computing labs. This isn’t that uncommon, especially during the crunch times, but it is uncommon to see people disrobed and obviously moved in, with food, clothes and the like. The initial reactions are almost always “Argh, what are you doing in here?” and “Grr, have you been getting in the way of other students.” However, and I can’t go into too much detail, as the story unfurled, with the intervention of some excellent staff members who managed to get the students talking, what appeared to be students taking advantage of our resources quickly turned out to be a situation where one student in extremis was being watched and cared for by another student – while both students were dealing with other, far more serious, problems.
To put it simply, one student had almost run out of hope and places to be. When you think about it, you’re not going anywhere good when you end up hiding in the corner of a lab that’s going through software rebuild and, hence, has no-one in it. The initial problem that we had was that, for mainly cultural reasons, the students had a great deal of difficulty talking to the first people to contact them – because we were lecturers and there is a great deal of potential embarrassment for certain people in admitting to problems in front of us. Fortunately, many heads knocked together to look at the problem, someone managed to start the students talking, we got more information and, as of this morning, a number of key problems have been solved. The major issue (stress regarding study) has been dealt with and the intervention to address other problems continues.
Reflecting upon this situation, I was reminded again of the burden that is placed upon the relationship between student and staff member when there is a cultural gap, especially one involving academic staff. I tried to talk to the students but, having been set up into fixed roles (in their heads), we couldn’t communicate. It was only once someone outside of the academic hierarchy got involved that information started to flow. Yes, there were linguistic issues but, ultimately, it didn’t come down to language, it came down to willingness to talk and these students didn’t want to open up. After they were reached, then the vast array of helpful resources that we do have were suddenly available to them.
As was noted at HERDSA recently, students don’t look at the ‘where to go for help’ slides early on in a course because they don’t need help. If students do need help, but can’t ask for it or don’t know where to go, then all of our helpful and assistive systems just won’t be able to help. But, of course, expecting students to know when they need help does give us a convenient ‘out’. Given that we can see their marks, and to a large extent their academic performance in courses that we administer, we should be able to see students who are heading towards crisis points. (We do look at this in our Faculty but more on that later.)
My own research, to be presented at ICER in September, talks about the amount of information that appears to be contained in the first submission that a student makes. But let’s say that all I can see is a semester of Fail grades – given that performance like that wouldn’t have got them into my course, I’m looking at a problem. Now, we can and we do redirect students to our (very good) Transitions and Advisory Service but this is a manual step. I’ve been looking at automated solutions to this for some time, and I’m looking forward to talking to people in more detail about AWE (the Wellness Engine) at University of New England, because I should not have to use myself as a processing element in order to achieve something that can be done better by a computer.
A colleague and friend of mine was describing middleware to some people at the University. If you don’t know what it means, middleware is software that connects two or more other systems together. Rather than writing one big piece that does everything, or two pieces that fit together like a jigsaw, middleware allows you to bring together lots of different systems that weren’t necessarily designed to work with each other. Probably the example that you’ve seen, and not realised, is using a database through a web-page. The underlying data (like Amazon’s store) is one system. Your web browser is another. Middleware allows you to exchange data with the data store and buy books. Middleware sounds great, right? It is – but here comes the catch.
Dave’s killer question on this is “Why are we using our staff as middleware?”
He’s right, of course. We take data from our marking of assignments, put into another system (by changing format and restructuring it), then we put that into another system (with manual intervention and checking) and this is then finally made available to students. Now if I want to see how the students are doing, I need to remember to manually request that a search be made, showing me all students who have failed anything – and then give me their GPA for this semester. I note that we already do this at the Faculty level using a mechanism called the Unsatisfactory Academic Progress process, which has identified a lot of at-risk students and helped a lot of people back, but how is it done? People acting as middleware.
What I want is a system that alerts me to problems automatically. If I have to search, it takes time and (worse) it becomes a task to be prioritised because there many not always be problems. If I am contacted when there is a problem, the task is automatically high priority. That requires a good set of middleware that spans all of a University’s systems and can bring that data together, then get in touch with the right people when there’s a problem. We’re actually not that far away from it – the systems are all there, we just need to streamline some processes. Fewer people acting as middleware means more people doing the things that we actually pay them for, especially when it’s academics!
There are lots of things that can get in the way of a good working relationship between educator and student. We don’t have to be friends, but we do have to be willing and able to talk to each other. Taking that further, it would be nice if the systems all talked to each other as well, including yelling at us when a student hits a mark where we might be able to intervene and do something useful, sooner.
Puppet on a String: A Summary of My Corruption by Extrinsic Rewards
Posted: July 16, 2012 Filed under: Education, Opinion | Tags: authenticity, blogging, education, educational problem, educational research, ethics, feedback, fiero, higher education, reflection, thinking, work/life balance, workload 3 CommentsI recently posted that I was thinking about my own contributions and asking what, if anything, would denote something that could be recognised as my mastery of my discipline. On thinking about this, I realised that, once again, I was asking someone else to value my work. For those of you who are educational specialists, rather than a discipline researcher who is on his way to becoming an educational researcher within the discipline, this is probably somewhat amusing, given I keep talking about the need to reduce extrinsic motivation in my students.
I have changed career several times and, if you look at why I’ve done this, a pattern quickly emerges. I tend to leave at the point where I have become competent enough that other people start to tell me that what I am doing is useful, valuable and start trying to reward me. Yet, I go into jobs seeking that kind of recognition and reward. I am corrupted in my intent, by the rewards, and then my intrinsic reward mechanisms become compromised and, after becoming deeply unhappy, I leave.
I realised, over the weekend, that I was becoming so pre-occupied with external approval that it was making me extremely vulnerable to criticism and it was corrupting me in trying to do something that is, whether I like it or not, very important and that I also happen to be good at.
Right now, I am in the middle of trying to work out how to divorce myself from the external rewards that I, irritatingly, crave and that, ultimately, then reduce the joy I take in doing things for my own reasons. It’s not surprising that the tasks that I enjoy the most at the moment are the big challenges, the ones where I’m working several levels above my pay grade or the usual expectations of someone of my level. I’m doing these things because they’re important and, because I’m doing it ‘out of cycle’ so to speak, I can’t be externally rewarded for them – I can just do a good job.
It’s in this same mode of thinking that I’ve decided not to spend any time applying for any local teaching and excellence awards. (I was about to comment on my potential eligibility but this is just another quest for a pat on the head – so I’ve deleted it.) I am either doing my job in the way that I should, and the expectations should be of a satisfactory performance that provides students with an excellent experience, or I should receive guidance, counselling and remedial assistance from my employer. Ultimately, if I don’t meet the standards then I should probably be fired. But if I’m doing well, then that is my job and I don’t need a piece of paper or a cheque to make things better. In fact, that money and time (in deciding upon the awards or writing the applications) should be directed to people who need the improvement, not people who are excelling. I have a meeting with my boss on Friday week and he will tell me whether I’m meeting standard or not.
Now there is a great deal of difference between writing a long application for an award (which is probably not the best investment of time and is seeking extrinsic recognition) and being sent on a course that might be useful because you’ve demonstrated an ability to do something (providing you with useful skills and the ability to develop further). As a general principle, skill development is going to be more useful than a pat on a head. Skill development also works for everyone, it’s just that the courses you use for development vary from person to person.
But this is, of course, completely at odds with the extensive systems of measurement that are now being placed on academics. We are (with widely varying levels of accuracy) measured extensively in terms of learning and teaching, research and administration. By not applying for these awards, I may be significantly altering my possibility of later promotion and opportunity. And, yet, I have to ask myself if I really need to be promoted? What does it mean? I’ve already discovered that people are happy to let you do a wide range of jobs without the requisite ‘academic level’ if you can demonstrate enough aptitude. Sure, it would mean I’d never be able to do certain jobs but, having a look at those jobs, I’m not sure that’s such a bad thing. 🙂
This is a strange time for me. I can now see the strings around me and how they’ve pulled me around for all of my life. Because I am such a strong believer in being as honest as possible with my students, it has forced me to be honest with myself, as I tear apart the framework I teach within to see how I can improve it and help my students to become self-regulated, intrinsically motivated and happy. Authenticity is the core for me and it is why I can teach with passion.
I was looking at Facebook recently and thinking about the “Like” button. I use it to mean “I am happy about this” or “I support you” but, rather than telling someone this, I hit the “Like” button. I’ve recently noticed that there are “Like” levels in WordPress and as I’ve hit, arbitrary, milestones I’ve received insincere automated badges.
Some of my readers (thank you, again) have been letting me know how they have been using the stuff from here and that has been really helpful for me. I realise that, in this community, “Like” generally means “I agree” or “Nicely written thoughts that ring true” but getting an actual account of how someone has used something that I said turned out to be really powerful. (Unsurprisingly, given how much Kohn I’m reading at the moment!)
So – where to from here? The first thing is to keep to my 40-45 hour working week. That has allowed me to get enough reflection time to get to this stage. I suspect the next is to keep plugging away at everything. This is most definitely not the time to throw everything in the air and meditate in a field. I’ve been trying to think about the advice that I would give to a student in a similar situation and I think I would tell them to keep doing everything and set some time aside over the next couple of weeks to identify the key issues, then start stripping away clutter until they were able to get a clear view of how they could achieve what was important to them. It will, at least, be a start.
Wrath of Kohn: Well, More Thoughts on “Punished by Rewards”
Posted: July 16, 2012 Filed under: Education | Tags: education, educational problem, feedback, games, higher education, in the student's head, measurement, principles of design, reflection, student perspective, teaching, teaching approaches, thinking, universal principles of design, work/life balance, workload 1 CommentYesterday, I was discussing my reading of Alfie Kohn’s “Punished by Rewards” and I was talking about a student focus to this but today I want to talk about the impact on staff. Let me start by asking you to undertake a quick task. Let’s say you are looking for a new job, what are the top ten things that you want to get from it? Write them down – don’t just think about them, please – and have them with you. I’ll put a picture of Kohn’s book here to stop you looking ahead. 🙂
It’s ok, I’ll wait. Written your list?
How far up the list was “Money”? Now, if you wrote money in the top three, I want you to imagine that this new job will pay you a fair wage for what you’re going to do and you won’t have any money troubles. (Bit of a reach, sometimes, I know but please give it a try.) With that in mind, look at your list again.
Does the word “excellent incentive scheme” or “great bonus package” figure anywhere on that list? If it does, is it in the top half or the bottom half? If Money wasn’t top three, where was it for you?
According to Kohn, very few people actually to make money the top of their list – it tends to be things like ‘type of work’, ‘interesting job’, ‘variety’, ‘challenge’ and stuff like that. So, if that’s the case, why do so many work incentive schemes revolve around giving us money or bonuses as a reward if, for the majority of the population, it’s not the thing that we want? Well, of course, it’s easy. Giving feedback or mentoring is much harder than a $50 gift card, a $2,000 bonus or 500 shares. What’s worse is, because it’s money, it has to be allocated in an artificial scarcity environment or it’s no longer a bonus, it’s an expectation. If you didn’t do this, then the company might go bankrupt.
What if, instead, when you did something really good, you received something that made it easier for you to do all of your work as a recognition of the fact that you’re working a lot? Of course, this would require your manager to have a really good idea of what you were doing and how to improve it, as well as your company being willing to buy you that backlit keyboard with the faux-mink armrest that will let you write reports without even a twinge of arm strain. Some of this, obviously, is part of minimum workplace standards but the idea is that you get something that reflects that your manager understands what you’ve done and is trying to help you to develop further. Carefully selected books, paid trips to useful training, opportunities to further display your skill – all of these are probably going to achieve more of the items on your 10-point list than money will. To quote Kohn, quoting Gruenberg (1980), “The Happy Worker: An Analysis of Educational and Occupational Differences in Determinants of Job Satisfaction”, American Journal of Sociology, 86, pp 267-8:
“Extrinsic rewards become an important determinant of overall job satisfaction only among workers for whom intrinsic rewards are relatively unavailable.”
There are, Kohn argues, many issues with incentive schemes as reward and one of these is the competitive environment that it fosters. I discussed this yesterday so I’ll move to one of the other, which is focusing on meeting the requirements for reward at the expense of quality and in a way that is as safe as possible. Let me give you an example that I recently encountered outside of work: Playing RockBand or SingStar (music games that score your performance). Watch me and my friends who actually sing playing a singing game: yes, we notice the score, but we don’t care about the score. We interpret, we mess around, we occasionally affect the voices of the Victorian-era female impersonator characters from Little Britain. Then watch other groups of people who are playing the game to make the highest score. They don’t interpret. They don’t harmonise spontaneously. In many cases, they barely even sing and focus on making the minimum tunefully accurate noise possible at exactly the right time, having learned the sequence, to achieve the highest score. The quality of the actual singing is non-existent, because this isn’t singing, it’s score-maximisation. Similarly, risk taking has been completely removed. (As an aside, I have excellent pitch and, to my ears, most people who try to maximise their score sound out of tune because they are within the tolerances that the game accepts, but by choosing not to actually sing, there is no fundamental thread of musicality that runs through their performance. I once saw a professional singer deliver a fantastic version of a song, only to be rated as mediocre by the system,)
On Saturday, my wife and I went to the Melbourne-based Australian Centre for the Moving Image (ACMI) to attend the Game Masters gaming exhibition. It was fantastic, big arcade section and tons of great stuff dedicated to gaming. (Including the design document for Deus Ex!) There were lots of games to play, including SingStar (Scored karaoke), RockBand (multi-instrument band playing with feedback and score) and some dancing games. Going past RockBand, Katrina pointed out how little fun the participants appeared to be having and, on looking at it, it was completely true. The three boys in there were messing around with pseudo-musical instruments but, rather than making a loud and joyful noise, they were furrowed of brow and focused on doing precisely the right things at the right times to get positive feedback and a higher score. Now, there are many innovations emerging in this space and it is now possible to explore more and actually take some risks for innovation, but from industry and from life experience, it’s pretty obvious that your perception of what you should be doing and where the reward is going to come from make a huge difference.
If your reward is coming from someone/something else, and they set a bar of some sort, you’re going to focus on reaching that bar. You’re going to minimise the threats to not reaching that bar by playing it safe, colouring inside the lines, trying to please the judge and then, if you don’t get that reward, you’re far more likely to stop carrying out that activity, even if you loved it before. And, boy, if you don’t get that reward, will you feel punished.
I’m not saying Kohn is 100% correct, because frankly I don’t know and I’m not a behaviourist, but a lot of this rings true from my own experience and his use of the studies included in his book, as well as the studies themselves, are very persuasive. I look forward to some discussion on these points!
The Fisher King: Achievement as Journey, rather than Objective
Posted: July 11, 2012 Filed under: Education, Opinion | Tags: advocacy, authenticity, education, educational problem, educational research, ethics, feedback, Generation Why, higher education, learning, principles of design, reflection, student perspective, teaching, teaching approaches 1 Comment(There are spoilers for the 1991 movie “The Fisher King” contained within, so proceed forewarned.)
It is sometimes hard for students to understand why undertaking a particular piece of work, in a certain way and at a certain time, is so important to us. For us, as educators, knowledge is developed and constructed through awareness, practice, understanding and application, as well as the further aspects of higher-level intellectual development. When we teach something, doing the assigned homework or assignment is an important reinforcing step. We can regard these assignments in two ways: formative (where we provide feedback and use it to guide improvement) and summative (where we measure the degree to which the students have achieved the standard required, compared to some benchmarks that are important to the course). Summative activities tend to be at the end of instructional units and formative tend to be throughout, for the obvious reasons, but, more pertinently to the discussion at hand, summative activities are often seen as “high-stakes”, where formative are seen as “low”.
The problem with a high-stakes activity is that we can inadvertently encourage behaviour, such as copying, plagiarism or cheating, because students feel so much pressure to achieve and they don’t feel that there is sufficient possibility of redemption in the face of not achieving the required standard. (And, yes, from a previous post, some people start out with the intention to cheat but I shall ignore them for all of the reasons that I have previously stated.)
Ultimately, all of our assignments contribute to the development of knowledge – or they should. The formative ones, as we know, should be placed to encourage the exchange of views between student and teacher, allowing us to guide and shape in an ongoing way, where the summative ones allow us to draw a line and say “Knowledge attained, now we can move on.” Realistically, however, despite the presence of so many summative assessments during and at the end of each course, the journey through University is just that – a journey – and I sometimes present it in this light to those students who have difficulty understanding the “why” of the assignments. I try never to resort to “because I say so”, as this really exchanges no knowledge, but I’m too honest to tell that I’m not at least tempted to say this sometimes!
One of my favourite movies is the 1991 Terry Gilliam film “The Fisher King“, with Robin Williams, Jeff Bridges, Mercedes Ruehl and Amanda Plummer. This is loosely based on legend of The Fisher King, from the often contradictory and complicated stories that have arisen around the Holy Grail over the last few hundred years, and I don’t have the time to go into detail on that one here! But the core is quite simple. One man, through a thoughtless and cruel act, causes a chain of events that leads to the almost total destruction of another’s world. Meeting each other, when both are sorely wounded by their troubles, they embark upon a journey that offers redemption to the first and healing to the second. (This is perhaps the most vague way to tell a fantastic story. I strongly recommend this movie!)
The final aspect of the movie is Jack’s quest to retrieve a simple cup that Parry has identified as the Holy Grail, and that Parry has been seeking since his descent into madness. After a beating that leaves Parry comatose in hospital, Jack dons Parry’s anachronistic garb and breaks into the house of a famous architect to retrieve the simple cup. When there, he also manages to save the architect’s life, redeeming himself through both his desire to challenge his own boundaries to seek the cup for Parry and by counter-balancing his previous cruelty with an act of life-saving kindness. The cup is, of course, still a cup but it is the journey that has brought Jack back to humanity and, as he hands the simple cup to Parry who lies unseeing in a hospital bed, it is the journey that transforms the cup into the grail for long enough that Parry wakes up.
We are all on a journey, one that we set out on when we were born and one that will finish when we breathe our last, but I think our reactions to the high-stakes events in our lives are so often a reflection of those who taught us, seen through the lens of our own personality. That’s why I like to talk to students about the requirements for the constant challenges, the quests, the moments that are high-stakes, in the context of their wider journey – in the quest for knowledge, rather than the meeting of requirements for a degree.
Are you just after the piece of paper for your degree? Need the credits? Then cheating is, in some ways of thinking, a completely valid option if you can rationalise it.
Are you on a journey to develop knowledge? Need to understand everything? Then cheating is no longer an option.
Knowledge is transforming. There is no doubt about this. We learn something new and it changes the world, or us, or both! When we learn something well enough, we can create new knowledge or share our knowledge with new people. There is no doubt that the journey transforms the mundane around us into something magical, occasionally something mystical, but it is important to see it as a journey that will help us to build our achievements, rather than a set of objectives that we tick off to achieve something that is used as a placeholder for the achievement.
As I always say to my students, “If you have the knowledge, then you’re really likely to pass the course and do well. If you just try and study for the exam, then you’re not guaranteed to have the knowledge.” Formative or summative, if you regard everything we’re doing as steps to increase your knowledge, and we construct our teaching in order to do that, the low stakes and the high stakes have similar benefit, even if one isn’t so much constructed for direct feedback. If we also make sure that we are not dismissive in our systems and can even offer redemption in cases of genuine need, then our high stakes become less frightening and there is no Red Knight stalking our moments of peace and happiness, forcing us into dark and isolated pathways.
The Big Picture and the Drug of Easy Understanding: Part I
Posted: July 9, 2012 Filed under: Education, Opinion | Tags: authenticity, education, educational problem, feedback, fiero, games, Generation Why, higher education, measurement, principles of design, reflection, student perspective, teaching, teaching approaches, thinking, tools, universal principles of design Leave a commentThere is a tendency to frame artistic works such as films and books inside a larger frame. It’s hard to find a fantasy novel that isn’t “Book 1 of the Mallomarion Epistemology Cycle” or a certain type of mainstream film that doesn’t relate to a previous film (as II, III or higher) or as a re-interpretation of a film in the face of another canon (the re-re-reboot cycle). There are still independent artistic endeavours within this, certainly, but there is also a strong temptation to assess something’s critical success and then go on to make another version of it, in an attempt to make more money. Some things were always multi-part entities in the planning and early stages (such as the Lord of the Rings books and hence movies), some had multiplicity thrust upon them after unlikely success (yes, Star Wars, I’m looking at you, although you are strangely similar to Hidden Fortress so you aren’t even the start point of the cycle).
From a commercial viewpoint, selling something that only sells itself is nowhere near as interesting as selling something that draws you into a consumption cycle. This does, however, have a nasty habit of affecting the underlying works. You only have to look at the relative length of the Harry Potter books, and the quality of editing contained within, to realise that Rowling reached a point where people stopped cutting her books down – even if that led to chapters of aimless meandering in a tent in later books. Books one to three are, to me, far, far better than the later ones, where commercial influence, the desire to have a blockbuster and the pressure of producing works that would continue to bring in more consumers and potentially transfer better to the screen made some (at least for me) detrimental changes to the work.
This is the lure of the Big Picture – that we can place everything inside a grand plan, a scheme laid out from the beginning, and it will validate everything that has gone before, while including everything that is yet to come. Thus, all answers will be given, our confusion will turn to understanding and we will get that nice warm feeling from wrapping everything up. In many respects, however, the number of things that are actually developed within a frame like this, and remain consistent, is very small. Stephen King experimented with serial writing (short instalments released regularly) for a while, including the original version of “The Green Mile”. He is a very talented and experienced writer and he still found that he had made some errors in already published instalments that he had to either ignore or correct in later instalments. Although he had a clear plan for the work, he introduced errors to public view and he discovered them in later full fleshings of the writing. He makes a note in the book of the Green Mile that one of the most obvious, to him, was having someone scratch their nose with their hand while in a straitjacket. Not having all of the work to look at leaves you open to these kinds of errors, even where you do have a plan, unless you have implemented everything fully before you deploy it.
So it’s no surprise that we’re utterly confused by the prequels to Star Wars, because (despite Lucas’ protestations), it is obvious that there was not even a detailed sketch of what would happen. The same can be said of the series “Lost” where any consistency that was able to be salvaged from it was a happy accident, as the writers had no idea what half of the early things actually were – it just seemed cool. And, as far as I’m concerned, there is no movie called Highlander 2.
(I should note that this post is Part 1 of 2, but I am writing both parts side by side, to try and prevent myself from depending in Part 2 upon something that I got wrong in Part 1.)
To take this into an educational space, it is tempting to try and construct learning from a sequence of high-reward moments of understanding. Our students are both delighted and delightful when they “get” something – it’s a joy to behold and one of the great rewards of the teacher. But, much like watching TED talks every day won’t turn you into a genius, it is the total construction of the learning experience that provides something that is consistent throughout and does not have to endure any unexpected reversals or contradictions later on. We don’t have a commercial focus here to hook the students. Instead, we want to keep them going throughout the necessary, but occasionally less exciting, foundation work that will build them up to the point where they are ready to go, in Martin Gardner’s words, “A-ha!”
My problem arises if I teach something that, when I develop a later part of the course, turns out to not provide a complete basis, reinterprets the work in a way that doesn’t support a later point or places an emphasis upon the wrong aspect. Perhaps we are just making the students look at the wrong thing, only to realise later that had we looked at the details, rather than our overall plan, we would have noticed this error. But, now, it is too late and the wrong message is out there.
This is one of the problems of gamification, as I’ve referred to previously, in that we focus on the drug of understanding as a fiero (fierce joy) moment to the exclusion of the actual education experience that the game and reward elements should be reinforcing. This is one of the problems of stating that something is within a structure when it isn’t: any coincidence of aims or correlation of activities is a happy accident, serendipity rather than strategy.
In tomorrow’s post, I’ll discuss some more aspects of this and the implications that I believe it has for all of us as educators.
Other views on HERDSA – Katrina’s Blog
Posted: July 8, 2012 Filed under: Education, Opinion | Tags: blogging, education, higher education, reflection, research, resources Leave a commentA very quick one here. I tend to write long, somewhat editorial and personalised, posts on conferences and I realise that this approach is not for everyone. Katrina’s blog has a (generally) much briefer, to the point, style that comes with a reading list so that you can look at the core of the presentation and then go and explore it a bit more for yourself. I realise I’ve linked to it before but often at the end of long posts so you may have missed it as your eyes glaze over. 🙂
It’s another view of HERDSA and educational research that I find really helpful, especially as she puts in far more links than I do! (I’m trying to fix this in my own posts.) Hope that you find it useful as well.
(Edit: The original link was wrong and the link has now been fixed. Apologies!)
A Brief Note on the Blog
Posted: July 8, 2012 Filed under: Education | Tags: blogging, education, measurement, reflection, resources, tools, work/life balance, workload, writing 1 CommentMy posts recently have been getting longer and longer and I think I’m hitting the point where ‘prolix’ is an eligible adjective: I’m at risk of using so many words that people may not finish or start reading, or risk being bored by the posts. Despite the fact that I write quickly, it does take some time to write 2,000 words. I want to write the number of words to carry the point across and make the best of your time and my time.
I’m going to experiment with posts that are as informative/useful but that are slightly shorter, aiming for 1,000 words as an upper bound and splitting posts thematically where possible to keep to this. At the end of July, assuming I remember, I’m going to review this to see how it’s going. (The risk, of course, is that editing to keep inside this frame will consume far more time than just writing. Believe me, I’m aware of that one!)
As always, feedback is very welcome and I reserve the right to completely forget about this and start writing 10,000 word megaposts again because I’ve become carried away. Thanks for reading!
How Do We Recognise Mastery? What Is My Masterpiece?
Posted: July 8, 2012 Filed under: Education | Tags: education, higher education, identity, in the student's head, journeyman, mastery, reflection, resources, student perspective, teaching approaches, thinking, tools, universal principles of design 1 CommentA few posts ago, and my goodness that’s a lot of words, I posted on issues of identity and examined the PhD in the light of it being a journeyman qualification, one that indicates the end of an apprenticeship and a readiness to go out into the world. That, however, is only half of the overall story of the apprentice, because there is a level above journeyman and that is, in all of its gendered glory, “master”. In the world of the trade and craft guilds, the designation of Mastery was only given when a journeyman applied to the guild and provided a piece of work that demonstrated their mastery of the appropriate craft. These works, if accepted, paved the way for journeyman to become Master, to become capable of training more apprentices and retaining their own journeymen, and were referred to as “Masterpieces”.
We use the term a bit more loosely these days, especially when coupled with the word “theatre”, but the sense remains. A Masterpiece is a piece of work that demonstrates your mastery of the craft and any sensible group of experts within your discipline would recognise it as such and declare you worthy to join them.
On reflection, after my last post on identity, I realised that I had placed the PhD into a very specific place, based on the PhD culture of my own discipline and my own experience. There are people who work their way up through a discipline for years, advancing steadily through their craft via diploma, recognition of prior learning and finally degree. Finally, having functioned as practitioner, they move into the academy in order to make their definitive contribution and it is as practitioner-academics that they create their final thesis which, in some regard, has more than a hint of the mastery of the craft about it and is far more likely to be a masterpiece than, say, my three year musing on big systems and XML. I regard myself more as an academic-practitioner as while I have previous knowledge, my research work began afresh and my PhD formed the basis of my qualification for entry into the profession of academic (journeyman) rather than the condensation of my life’s contribution as a practitioner, placed within the academic sphere to change teaching, research and policy (masterpiece).
However, this really doesn’t clear the issue up at all, all it does is emphasise that it is the recognition of the masterpiece that determines one’s mastery, which in turn requires that we have strong “guilds” or their equivalent in order to be able to clearly state when something has been produced to a level that we have met this particular skill battier.
Now, in terms of supervising other PhD students, I can do that now but, until my first student completes successfully (fingers crossed for December), I cannot be a principal supervisor. I am apprenticed, again, in effect until I have demonstrated sufficient mastery. So my PhD qualification is, again, rendered at the journeyman level. If I still had my network certifications from my previous life, I could instruct people in networking within certain corporate frameworks, but I (again) only had journeyman qualifications here. I have a friend who has achieved mastery in the networking discipline and the difference in our skill levels is amazing but, rather sadly, he has no masterpiece to show for his efforts. He worked to solve some difficult problems, and sat some very hard exams, and provided that he repeats this performance every 2 years, he will make lots of money doing interesting things involving networks. There is not, however, a single artefact of his that he can point to, which asserts that from that point on, he had mastery of a certain set of skills.
And this is very much the way of modern mastery. Why does my friend have to resit his exams? Because things are changing very quickly these days and, because of the Internet, we can propagate those changes almost immediately. A master craftsman of the 17th Century would learn new techniques, certainly, but having achieved mastery, he would enjoy maybe 20-30 more years of relatively low change until he died of some unspeakable disease or a falling giraffe. These days, while master craftsman certainly exist and are recognised as such, in many scientific disciplines, we tend to award this towards the end of someone’s life, at a time when their practical life is relatively close to over and I wonder if that is to stop the embarrassment of a recognised master who knows nothing about what has happened in the field because it has all moved on.
How do we recognise mastery in science, literature or academia? Well, there are significant Fellowships (the Royal Society springs to mind), important prizes (the Nobel, the Pulitzer) and awards (the Turing and the like). Of course, there is one award that recognises early achievement, the Fields Medal in mathematics, which may only be awarded to someone who is not yet 40, specifically to try and encourage the recipients to go further and do more. A lot of these awards and prizes, however, allow the luxury of a Masterpiece, especially those awards which are given for a specific piece of work. But which of J. M. Coetzee’s works was the definitive masterpiece that granted him the Nobel in Literature, the one that tipped the balance? Where is the specific masterpiece that I can pass to other guild members (not that I am one) and admire, wish that I had created, and learn from? Even where we have the books, we still don’t have a clear notion of what we are looking at. (I realise that Coetzee’s skills were clearly identified in the award, as well as his focus, and I am certainly not disputing the validity – but which is the book I give to someone to explain why he is a master?)
It is much harder to see where we give our students the ability to produce master works of any kind, even within our capstone courses. The works produced under capstone are more likely to be fit-for-purpose, complete but unremarkable, and therefore fit to judge for the end of apprenticeship, but no further. If they then progress to Honours, Masters or PhD, they do not so much have an opportunity to produce a masterpiece, what they are doing is conducting an apprenticeship for a new trade. (This varies by profession and intent. I can quite happily see that a PhD in Creative Writing has a masterpiece component attached to it, whereas a PhD in other disciplines may not.)
But, given that the international recognition of mastery is in a highly refined atmosphere and can, at most, accommodate a very small number of people, how do we even recognise those few masterpieces that will occur outside of the defining masterworks of a generation? For me, as a personal reflection, I am coming to terms with the fact that any masterpiece that I do produce, a work of great import or even a student (in some respects) that goes on to change the world, may have a very short shelf-life compared to other crafts. I also have to accept that the guild that accepts it as master work may never even contact me to tell me what they think – I’ll just have to watch my citation index go up and use it to get myself promoted.
I don’t have a complete answer to this, and I know that there’s a lot more thinking to do, but are we looking at the end of masterpieces or do we just have to adopt a different lens for seeing them, as well as a different group for judging them?
HERDSA 2012: Final Keynote, “Connecting with the Other: Some ideas on why Black America likes to sing Bob Dylan”, Professor Liz McKinley
Posted: July 7, 2012 Filed under: Education | Tags: advocacy, authenticity, blogging, collaboration, community, design, education, educational problem, educational research, ethics, feedback, Generation Why, herdsa, higher education, identity, in the student's head, measurement, mr tambourine man, principles of design, protest song, reflection, resources, student perspective, teaching, teaching approaches, thinking 2 CommentsI’ve discussed this final talk in outline but it has had such an impact on me that I wanted to share it in its own post. This also marks the end of my blogging from HERDSA, but I’m sure that you’ve seen enough on this so that’s probably a good thing. (As a note, the next conference that I’ll be at is ICER, in September, so expect some more FrenetoBlogging (TM) then.)
Professor Elizabeth (Liz) McKinley has a great deal of experience in looking at issues of otherness, from her professional role in working with Māori students and postgraduates, and because she is of Ngāti Kahungunu ki Wairarapa and Ngāi Tahu descent herself. She began her talk with a long welcome and acknowledgement speech in an indigenous language (I’m not sure which one it was and I haven’t been able to find out), which she then repeated in English, along with an apology to the local indigenous peoples for her bad pronunciation of some of their words.
She began by musing on Bob Dylan, poet, protest song writer, and why his songs, especially “Blowing in the Wind”, were so popular with African Americans. Dylan’s song, released at a turbulent time in US History, asked a key question: “How many roads must a man walk down, before you call him a man?” At a time when African Americans were barely seen as people in some quarters, despite the Constitutional Amendments that had been made so long before, these lyrics captured the frustrations and aspirations of the Black people of the US and it became, in Professor McKinley’s opinion, anthemic in the civil rights movement because of this. She then discussed how many of Bob Dylan’s other songs had been reinterpreted, repurposed, and moved into the Black community, citing “Mr Tambourine Man” as covered by Con Funk Shun as an example of this. (I have been unable to locate this on Youtube or my usual sources but, I’ve been told, it’s not the version that you’re used to and it has an entirely new groove.)
Reinterpretation pays respect to the poet but we rediscover new aspects about the work and the poet and ourselves when we work with another artist. We learn from each other when we share and we see each other’s way of doing things. These are the attributes that we need to adopt if we want to bring in more underrepresented and disadvantaged students from outside of our usual groups – the opportunities to bring their talents to University to share them with us.
She then discussed social justice education in a loose overview: the wide range of pedagogies that are designed to ameliorate the problems caused by unfair practices and marginalisation. Of course, to be marginalised and to be discriminated against, we must have a dominant (or accepted) form, and an other. It is the Other that was a key aspect of the rest of the talk.
The Other can be seen in two very distinct ways. There is the violent Other, the other that we are scared of, that physically repels us, that we hide from and seek to destroy, sideline or ignore. This is drive by social division and inequity. When Gil Scott-Heron sang of the Revolution that wouldn’t be televised, he was speaking to his people who, according to people who look like me, were a violent and terrifying Otherness that lived in the shadows of every city in America. People are excluded when they don’t fit the mainstream thinking, when we’re scared of them – but we can seek to understand the other’s circumstances, which are usually a predicament, to understand their actions and motivations so that we can ameliorate or remedy them.
But there is also the non-violent Other, a philosophical separation, independent of social factors. We often accept this Other, letting it be different and even seeking knowledge from this unknowable other and, rather than classify it as something to be shunned or feared, we defer our categorisation. My interpretation of this non-violent other is perhaps that of those who seek religious orders, at the expense of married life, even small possessions or a personal life within a community that they control. In many regards this is very much an Otherness but we have tolerated and welcomed the religiously Other into our lives for millennia. It has only been reasonably recently that aspects of this, for certain religious orders, has now started to associate a violent Otherness with the mystical and philosophical Otherness that we would usually associate with clerics.
Professor McKinley went on to identify some of the Others in Australia and New Zealand: the disadvantaged, those living in rural or remote areas, the indigenous peoples. Many of the benchmarks for these factors are set against nations like the UK, the US and Canada. She questioned why, given how different our nations are, we benchmarked ourselves against the UK but identified that all of this target setting, regardless of which benchmarks were in use, were set against majority groups that were largely metropolitan/urban and non-indigenous. In New Zealand, the indigenous groups are the Māori and the Pacific Islanders (PI), but there is recognition that there is a large degree of co-location between these peoples and the lower socio-economic status groups – a double whammy as far as Otherness goes compared to affluent white culture.
Professor McKinley has been heavily involved and leading three projects, although she went to great lengths to thank the many people who were making it all work while she was, as she said, running around telling everyone about it. These three projects were the Starpath Project, the Māori and Indigenous (MAI) Doctoral Programme, and the Teaching and Learning in the Supervision of Māori PhD students (TLRI).
The Starpath Project was designed to undertake research and develop and evaluated evidence-based initiatives, designed to improve educational participation and achievement of students from groups currently under-represented in degree level education. This focuses on the 1st decile schools in NZ, those who fall into the bottom 10%, which includes a high proportion of Māori and PI students. The goal was to increase the number of these students who went into Uni out of school, which is contrary to the usual Māori practice of entering University as mature age students when they have a complexity in their life that drives them to seek University (Liz’s phrase, which I really like).
New Zealand is trying to become a knowledge economy, as they have a small population on a relatively small country, and they want more people in University earlier. While the Pākehā, those of European descent, make up most of those who go to Uni, the major population growth is the Māori and PI communities. There are going to be increasingly large economic and social problems if these students don’t start making it to University earlier.
This is a 10-year project, where phase 1 was research to identify choke points and barriers in to find some intervention initiatives, and phase 2 is a systematic implementation, transferable, sustainable, to track students into Uni. This had a strong scientific basis with emphasis on strong partnerships, leading to relationships with nearly 10% of the secondary schools in New Zealand, focused on the low decile groups that are found predominantly around Auckland. The partnerships were considered to be essential here and the good research was picked up and used to form good government policy – a fantastic achievement.
Another key aspect, especially from the indigenous perspective, was to get the families on board. By doing this, involving parents and family, guardian participation in activities shot up from 20% to 80% but it was crucial to think beyond the individual, including writing materials for families – parents and children. Families are the locus of change in these communities. Part of the work here involved transitions support for students to get from school to uni, supported by scholarships to show both the students and the community that they can learn and achieve to the same degree as any other student.
One great approach was that, instead of targeting the disadvantaged kids for support, everyone got the same level of (higher) support which normalised the student support and reduced the Otherness in this context.
The next project, the MAI programme, was a challenge to Māori researchers to develop a doctoral programme and support that didn’t ignore the past while still conforming to the academic needs of the present. (“Decolonizing methodologies: Research and Indigenous Peoples” by Linda Tuhiwai Smith, 1999, was heavily referenced throughout this.) Māori students have cultural connections and associations that can make certain PhD work very difficult: consider a student who is supposed to work with human flesh samples, where handling dead tissue is completely inappropriate in Māori culture. It is profoundly easy, as well as lazy, to map an expectation of conformity over the top of this (Well, if you’re doing our degree then you follow our culture) but this is the worst example of a colonising methodology and this is exactly what MAI was started to address.
MAI works through communities, meeting regularly. Māori academics, students and cultural advisors meet regularly to alleviate the pressures of cross-cultural issues and provide support through meetings and retreats.
The final project, the Māori PhD project, was initiated by MAI (above) to investigate indigenous students, to understand why they were carrying out their PhDs. Students were having problem, as with the tissue example above, so the project also provided advice to institutions and to students, encouraging Pākehā supervisors to work with Māori students, as well as the possibility of Māori supervision if the student needed to feel culturally safe. This was a bicultural project, with five academics across four institutions.
From Smith, 1997, p203, “educational battleground for Māori is spatial. It is about theoretical spaces, pedagogical spaces, structural spaces.” From this project there were differences in what the students were seeking and the associated pedagogies. Some where seeking difference from their own basis, an ancestral Māori basis. Some were Māori but not really seeking that culture. Some, however, were using their own thesis to regain their lost identity as Māori.
The phrase that showed up occasionally was a “colonised history” – even your own identity is threatened by the impact of the colonists on the records, memories and freedoms of your people. We had regularly seen colonists move to diminish and reduce the Other, as a perceived threat, where they classify it as a violent other. The third group of students, above, are trying to rebuild what it meant to be Māori for them, in the face of New Zealand’s present state as a heavily colonised country, where most advantage lies with the Pākehā and Asian communities. They were addressing a sense of loss, in the sense of their loss of what it meant to be Māori. This quest for Māori identity was sometimes a challenge to the institution, hence the importance of this project to facilitate bicultural understanding and allow everyone to be happy with the progress and nature of the study.
At this point in my own notes I wrote “IDENTITY IDENTITY IDENTITY” because it became clearer and clearer to me that this was the key issue that is plaguing us all, and that kept coming up at HERDSA. Who are we? Who is my trusted group? How do I survive? Who am I? While this issues, associated with Otherness in the indigenous community, are particularly significant for low SES groups and the indigenous, they affect all of us in this times of great change.
An issue of identity that I have touched on, and that Professor McKinley brought up in her talk, was how we establish the identity of the teacher, in order to identify who should be teaching. In Māori culture, there are three important aspects: Matauranga (Knowledge), Whakapapa (ancestral links) and Tikanga (cultural protocols and customs). But this raises pedagogical issues, especially when two or more of these clash. Who is the teacher and how can we recognise them? There are significant cultural issues if we seek certain types of knowledge from the outside, because we run headlong into Tikanga. These knowledge barriers may not be flexible at all, which is confronting to western culture (except for all of the secret barriers that we choose not to acknowledge). The teachers may be parents, elders, grandparents – recognising this requires knowledge, time and understanding. And, of course, respect.
Another important aspect is the importance of the community. If you, as a Māori PhD student, go to a community and ask them to answer some questions, at some stage in the future, they’ll expect you back to help out with something else. So, time management becomes an issue because there is a spirit of reciprocity that requires the returned action – this is at odds with restricted time for PhDs and the desire for timely completion if you have to disappear for 2 weeks to help build or facilitate something.
Professor McKinley showed a great picture. A student, graduating with PhD gown surmounted by the sacred cloak of the Māori people. They have to have a separate graduation ceremony, as well as the small ‘two tickets maximum’ one in the hall, because community and family pride is strong – two tickets maximum won’t accommodate the two busloads of people who showed up to see this particular student graduate.
The summary of the Other was that we have two views:
- The Other as a consequence of social, economic and/or political disaffiliation (Don’t pathologise the learning by diagnosing it as a problem and trying to prescribe a remedy.)
- As an alterity that is independent of social force. (Welcoming the other on their own terms. A more generous form but a scarier form for the dominant culture.)
What can we learn from the other? My difference matters to my institution. We need to ensure that we have placed our ethics into social justice education – this stance allows us how to frame ethics across the often imposed barriers of difference.
Professor McKinley then concluded by calling up some of her New Zealand colleagues to the stage, to close the talk with a song. An unusual (for me) end to an inspiring and extremely thought-provoking talk. (Sadly, it wasn’t Bob Dylan, but it was in Māori so it may have secretly been so!)





