Your Mission, Should You…

Posted: April 14, 2012 | Author: | Filed under: Education, Opinion | Tags: , , , , , , , , , | Leave a comment

The ALTA meeting of the last two days has been really interesting. My role as an ALTA Fellow has been much better defined after a lot of discussions between the Fellows, the executive and the membership of ALTA. Effectively, if you’re at a University in Australia and reading this, and you’re interested in finding out about what’s going on in our planning for Information and Communications Technology (ICT) Learning and Teaching, contact me and I’ll come out to talk to your school, faculty or University. I’m concentrating on engagement and dissemination – trying to bring the diverse groups in ICT education in Australia (38 organisations, 686 separate ICT-related programs) into a more cohesive group so that we can achieve great things.

To say that this is going to be exciting is an understatement. To omit the words ‘challenging’ and ‘slightly frightening’ would also be an understatement. But I always love a slightly frightening and exciting challenge – that’s why I eat durian.

ICT education in Australia does not have the best image at the moment. That information is already out there. A lot of people have no idea what we even mean by ICT. But let’s be inclusive. It’s Computer Science, Computing, Information Systems, Information Science, Communications Science, Information Technology… everything else where we would be stronger standing together than apart.

There are important questions to be answered. Are we a profession or professions? Are we like engineering (core competencies with school-based variation) or more like science (core concepts and very different disciplines)? How do we improve the way that people see us? How do we make 13 year olds realise that they are suited for our profession – and that our profession is more than typing on a keyboard?

How do we change the world’s perception so that the first picture that people put on an article about computing does not feature someone who is supposed to be perceived as unattractive, socially inept, badly dressed and generally socially unacceptable?

If you are at an Australian University and want to talk about this, get in touch with me. My e-mail address is available by looking for my name at The University of Adelaide – sorry, spambots. If you’re from overseas and would like to offer suggestions or ask questions, our community can be global and, in many respects, it should be global. I learn so much from my brief meetings with overseas experts. As an example, I’ll link you off to Mark Guzdial’s blog here because he’s a good writer, an inspiring academic and educator, and he links to lots of other interesting stuff. I welcome the chance to work with other people whenever I can because, yes, my focus is Australia but my primary focus is “Excellence in ICT education”. That’s a global concern. My dream is that we get so many students interested in this that we look at ways to link up and get synergies for dealing with the vast numbers that we have.

The world is running on computers, generates vast quantities of data, and needs our profession more than ever. Its time to accept the mission and try to raise educational standards, perceptions and expectations across the bar so that ICT Education (or whatever we end up calling it) becomes associated with the terms ‘world-leading’, ‘innovative’, ‘inspiring’ and ‘successful’. And our students don’t have to hide between their brave adoption of semi-pejorative isolating terms or put up with people being proud that they don’t know anything about computers, as if that knowledge is something to be ashamed of.

We need change. Helping to make that happen is now part of my mission. I’m looking for people to help me.

The Classroom of 2020

Posted: April 14, 2012 | Author: | Filed under: Education | Tags: , , , , , | Leave a comment

There were many lively debates at yesterday’s ALTA forum. (ALTA is the Australian Council of Deans of ICT’s Learning and Teaching Academy and is concerned with raising the quality and perception of ICT higher ed courses across the country. No pressure. 🙂 ) When you get 40 or so academics in a room then, if they’re even vaguely engaged, you’re going to have a pretty free and frank exchange of views. And one of the great things about ALTA is that we are all very engaged!

There was a lot of discussion on the rise in on-line learning and what impact it would have on the physical presence of students on campus. What does the classroom of 2020 look like?

Is it a room full of computers with students lined up facing them? (If so, how? Rows? Islands? Back to back? Face to face? Suspended from the ceiling? Embedded in desks?)

20120414-072958.jpg

Is it a room full of people without a computer in sight? (If so, how is that room set up? Traditionally? For collaboration? Random group formation?)

20120414-073230.jpg

Is it somewhere between the two, much as it is now?

Or is the bricks-and-mortar University a ghost town? Giant empty lecture theatres repurposed as server rooms, cooling conduits snaking through the old desks and chairs, with the students sitting, by themselves, wherever they happen to be, hooked into our remote on-line systems?

(I found it too depressing a thought to put a picture of this in here. The coming together of our students has so many benefits that I really hope it never goes away.)

As always, rather than adapting education to space, our best bet is to look at what we want to achieve and adjust the space accordingly. A linear layout computer lab is great for getting code written but lousy for group formation and collaboration. A low density island style suite is great for groups and collab but doesn’t support a more tutorial style with only one lecturer because of line-of-sight and group focus issues. A traditional lecture theatre is often unsuited to heavy computerisation because of simple things like power requirements. Getting above the space, what is a classroom? What will the mix be of classrooms, between physical, virtual, ad hoc and all of the other subtleties? Delivery, content, methodology – so many variables and so much room for passionate debate to try and share what works and make things better across all of our students.

I think we already have a good idea of what works for at least some of this and it’s pretty obvious that the mix of mobile, on-line and traditional learning, which we refer to as blended learning, is becoming increasingly popular and providing some excellent results, as well as a number of challenges. The debate continues on what the proportions of the blend will be – does this mean that we have accepted blended learning or is there a fourth, or fifth, component that will appear and change everything by 2020?

So, We Have to Have the Talk?

Posted: April 13, 2012 | Author: | Filed under: Education | Tags: , , , , , , , | Leave a comment

I’m currently at the Australian Council of Deans of ICT’s Learning and Teaching Academy forum meeting and, across the group, we span Computer Science, Information Systems, Information Technology, Informatics, Computing, Computing and Information Systems – and several other areas besides. It’s great that we’re all together because, face to face, we discover how much we have in common across all of our diverse universities and schools.

But, after this, when we all go back to our schools of one name or another – will we all be working together or will the old boundaries creep in?

Is it time that we had the talk? The one that reminds us all that computers are the tools of our trade, and not our trade? The one that reminds us that IT, IS, CS, CIS, I, C all have more in common than they have differences?

If we, inside the discipline, can’t work out what we’re called and create artificial divisions then we can’t stand together to fight for the important things – the recognition as education inside our discipline as a field that is actually discipline research. Does that matter? Yes, in these days of metrics and contributions to research centres, it matters because that is how we are measured.

If we don’t know what to call ourselves, as a group of professions, who else will know? The student who plays a lot of World of Warcraft – hey, that’s computer use… well, no, it’s not for most of our purposes. That’s part of the talk – working out what goes where and being honest about it. Computers are the tool of computer science, the platform for applications, an implementation point for information systems – but they are never the whole of any of these disciplines.

If we’re going to have the talk, what are the questions? I think we should be asking what our parent field is called – what is the container for all of our names? How can we clearly state which schools do what? How can we tell students what they should know, what they should expect, what they’ll be doing and where they might be working?

Where do we go? Who do we talk to? What do we ask? How do we clarify what it is that we do, how people can join us, and – importantly – what it is that we don’t do.

Managing Failure, Avoiding Failure: Learning From Our Mistakes.

Posted: April 12, 2012 | Author: | Filed under: Education | Tags: , , , , , , | 3 Comments

One thing that really identifies the best of my students is their willingness to try – they’ll take what they’ve learnt and throw themselves into unknown situations and see what happens.

Of course, to be willing to do this you either know what it is to fail and have learned not to be scared of it – or you’ve never failed before. I don’t think anyone’s defined by their first reaction to failure. Or their second…or their third… of course, all of this assuming that they were genuinely trying and preparing and (with any luck) learning and improving.

Let’s be honest – failure sucks. It’s more than the absence of success, because it’s the fact that you actually tried to succeed. Right now, I am failing in my attempt to be the first man to walk on Mars, but I’m really not all that upset because I haven’t spent all that much time on it. It’s not really a goal for me so I’m not invested in it. I’ve got some stuff that I am invested in and, if I fail at that, then that is going to suck but I’ll try to learn as much as I can from it.

I’m lucky, I’ve failed a lot but at times and in ways that haven’t wiped me out. It took me a long time to learn how to manage failure and an even longer time to work out how lucky I was that the nature of failure I experienced was so benign. So, reading this, keep in mind that I’m talking about academic marks, not ‘making a bad decision, killing two people and ending up in jail for the rest of my life’. It’s important to keep this in perspective, sometimes.

A lot of my students have a pretty good run on their way to my class. Top of their school classes, relatively comfortable background, low-crime environment, nice weather. Some of my students will encounter their first major failure while they’re with me. For some students, this is going to be shattering. This isn’t a matter of “it’s a bad report card”, it could be ‘your degree will take another 12 months.” The worst case is “you can’t study with us anymore” – but that’s a very serious proposition that’s only reached after years of underperformance.

I understand this because my first major failures happened when I hit Uni. Suddenly I had to study, I had to do things, I couldn’t get by. It took me a while to get my head around it but, in doing so, I really learnt the difference between those lecturers who could help me and those who couldn’t. I went on to succeed but I also went on to keep trying, even when I was reaching higher and my risk of failure became more severe. Here’s a sort list of the things that I try to pass on but there’s a lot more I could say on this:

  1. Don’t just say “I should have done more” identify what you should have done.
    “I will work harder” is meaningless – you’ll work harder at what? “I will start my assignments 1 week earlier” is a clear statement of what you need to do but is secretly composed of so many other assumptions. “I will review my assignments on the day I get them and add them to my assignment plan (see point 2)” starts the process but, well, it’s a rabbit hole that varies from person to person in its depth. Don’t know what you should have done? Find someone you trust, ask them and then listen to the answer (see point 4). A clear statement of what you need to do will help you to focus and, with work and luck, achieve a better result next time. It also gives you something to direct your energies towards – work out those negative vibes!
  2. Not all tasks are equal in importance, opportunity or consequence. 
    Want a degree? Then, at times, your coursework is more important that anything else. Want good marks? Then you’re going to have to move other tasks aside to make time to study for the exam. To do this, you’re going to need to plan and get stuff sorted out far enough in advance that you’re not wasting all of your spare time (that you’re trying to make) running around trying to free up the spare time (that you now don’t have). There are many platitudes around planning, and its importance, but planning properly is generally the first requirement for success. Practice it, get good at it – it almost always makes things better.
  3. Sleep isn’t optional.
    Caffeine is amazing but sleep is the real thing. Very few of us can get by with little sleep and high-level mental activity generally needs the right amount of sleep, on a regular basis. Not sleeping for ages and taking caffeine tablets just makes you jittery and stupid. Believe me, I know. Sleep makes you less grumpy, more mentally agile, happier and lets you see your real problems in their proper size. Why, I’m sleeping as I type this!
  4. Find the right person to ask about how you can improve.
    Everyone has an opinion. Some people have the right opinion. You have to work out the right people to speak to, who have the knowledge you need and can present it in a way that you can then absorb. This combination of message+medium will vary from person to person. Some people who have never failed have great empathy and can help you anyway. Some people, well, let’s just say that some people will look at you like you’re some kind of alien and how on Earth could you fail something but I guess I could suggest that you work harder because it’s important – seriously? Forget them. Mentors, role models and guides are real people with real lessons to share – find someone authentic. Not everyone has to have feet of clay – but a little dust on their wings won’t go amiss.
  5. Be firm but fair with yourself.
    Yes, you failed something. Did you actually try? No? Why not? Don’t say “It’s ok because I didn’t try” – if you don’t want to try, don’t play. Do something else that you really care about. Being magnificent somewhere else is always a good option! If you did try – what happened? (See point 1) Yes, you failed – don’t beat yourself but, at the same time, don’t forget it straight away either. Remember what it was that tripped you up and try to stop it from happening again. If you find yourself waking up at night, sweating, thinking about it: you’re not being fair to yourself. Obsession isn’t fair to yourself. At the same time, saying “Meh” and going round in unproductive cycles isn’t that fair either – unless that’s what makes you happy and you have the money to burn. In which case, well, have fun but try not to drag anyone else down with you because most people in your course want to pass and I’d rather that they didn’t pick up those habits from you. Nothing personal but passing students is what I try to do. 🙂

So much more I could write here but I don’t want to go on too much. Hope that this is interesting for you.

A Dangerous Precedent: Am I Expecting Too Much of My Students?

Posted: April 11, 2012 | Author: | Filed under: Education | Tags: , , , , , , , | 2 Comments

Anyone with a pulse is aware that there is a lot of discussion at the moment in some important areas of Science. If we scratch the surface of the climate and vaccination debates, we find a roiling frenzy of claim and counter-claim – facts, fallacies and fury all locked in a seething ball. We appear to have reached a point where there is little point in trying to hold a discussion because we have reached a point of dogmatic separation of the parties – where no discussion can bridge the divide. This is the dangerous precedent I’m worried about – not that we have contentious issues, but that we have contentious issues where we build a divide that cannot be bridged by reasonable people with similar backgrounds and training. This is a sad state of affairs, given the degree to which we all observe the same universe.

I don’t teach politics in the classroom and I try not to let my own politics show but I do feel free to discuss good science with my students. Good science is built on good science and, ultimately, begets more good science. Regrettably, a lot of external interest has crept in and it’s easy to see places where good science has been led astray, or published too early, or taken out of context. It’s also easy to see where bad science has crept in under the rug disguised as good science. Sometimes, bad science is just labelled good science and we’re supposed to accept it.

I’m worried that doubt is seen as weakness, when questioning is one of the fundamental starting points for science. I’m worried that a glib (and questionable) certainty is preferred to a complex and multi-valued possibility, even where the latter is correct. I’m worried that reassessment of a theory in light of new evidence is seen as a retrograde step.

I have always said that I expect a lot of my students and that’s true. I tell my research students that will work hard when they’re with me, and that I expect a lot, but that I will work just as hard and that I will try to help them achieve great things. But, along with this, I expect them to be good scientists. I expect them to read a lot across the field and at least be able to make a stab at separating good, replicable results from cherry-picking and interest-influenced studies. That’s really hard, of course, especially when you read things like 47 of the most significant 53 cancer studies can’t be replicated. We can, of course, raise standards to try and address this but, if we’re talking about this in 2012, it’s more than a little embarrassing for the scientific community.

What I try to get across to my students is that, in case of pressure, I expect them to be ethical. I try to convey that a genuine poor (or null) submission is preferable to an excellent piece of plagiarised work, while tracking and encouraging them to try and stay out of that falsely dichotomous zone. But, my goodness, look at the world and look at some of the things we’ve done in the name of Science. Let’s look at some of those in the 20th century with something approaching (semi)informed consent. The Tuskegee Syphilis Experiment. Milgram’s experiment. The Stanford Prison Experiment. I discuss all of these with my students and a number of them think I’m making it up. Until they go looking.

Now, as well as unethical behaviour to contend with, we have divisive behaviour – people trying to split the community for their own purposes. We always had it, of course, but the ease of self-publishing and the speed with which information can be delivered means that it takes days to spread information that used to percolate through doubt filters and peer review. Bad science can often travel faster than good science because it bypasses the peer review process – which has been unfairly portrayed in certain circles as an impediment to innovation or a tool of ‘Big Science’. The appeal to authority is always dangerous, because there is no guarantee that peer review is flawless, but as we have seen with the recent “Faster than the speed of light/ oh, wait, no it’s not” the more appropriately trained eyes you have on your work, the more chance we have of picking up mistakes.

So I expect my students to be well-read, selective, ethical, inclusive and open to constructive criticism as they work towards good or great things.

I still believe that there is a strong and like-minded community out there for them to join – but some days, reading the news, that’s harder to believe than others.

The Student of 2040

Posted: April 10, 2012 | Author: | Filed under: Education | Tags: , , , , , , | 1 Comment

On occasion, I wonder about where students and teachers will be towards the end of my teaching career. Let us be optimistic and say that I’ll still be teaching in 2040 – what will my students look like? (I’m not sure that teaching at that age is considered optimistic but bear with me!)

A person with electrodes on their head.

Right now we’re having to adapt to students who can sit in lectures and, easily and without any effort, look things up on wireless or 3G connections to the Internet – searching taking the role of remembering. Of course, this isn’t (and shouldn’t be) a problem because we’re far more than recitation and memorisation factories. There are many things that Wikipedia can’t do. (Contrary to what at least a few of my students believe!)

But what of the future? What of implanted connections that can map entire processes and skills into the brain? What of video overlays that are invisibly laid over the eye? Very little of what we use today to drive thinking, retrieval, model formation and testing will survive this kind of access.

It would be tempting to think that constant access to the data caucus would remove the need for education but, of course, it only gives you answers to questions that have already been asked and answers that have already been given – a lot of what we do is designed to encourage students to ask questions in new areas and find new answers, including questioning old ones. Much like the smooth page of Wikipedia gives the illusion of a singularity of intent over a sea of chaos and argument, the presence of many answers gives the illusion of no un-answered questions. The constant integration of information into the brain will no more remove the need for education than a library, or the Internet, has already done. In fact, it allows us to focus more on the important matters because it’s easier to see what it is that we actually need to do.

And so, we come back to the fundamentals of our profession – giving students a reason to listen to us, something valuable when they do listen and a strong connection between teaching and the professional world. If I am still teaching by the time I’m in my 70s then I can only hope that I’ve worked out how to do this.

Sitting Alone in a Crowd Just Like You: The Isolated Student

Posted: April 9, 2012 | Author: | Filed under: Education | Tags: , , , , , , , | 6 Comments

I’ve posted a number of things about the importance of training people to use all the techniques and technologies that we have – which applies to us teaching as much as it ever applies to the student. The best way to training and education to happen is, unsurprisingly, provide the best environment in which this can happen – resources, buildings, rooms and, above all, community. One of the big benefits of the traditional lecture is that we get the whole student community for a course into the one room, several times a week. What isn’t guaranteed is that we will actually get a proper community forming – we may just have a big room full of people, none talking to each other, no-one interacting. At that stage, of course, we have the traditional lecture at it’s potential worst.

I’m writing a series of short stories at the moment around the theme of isolation and there are many excellent examples in literature of the notion of being alone while in the company of others. Whether it’s the isolation of the protagonist in Bashevis Singer’s The Slave, separated from the community by his religion and status, or the isolation of the reader from the world and characters from Philip K. Dick, a wonderful example of umwelt, we see the same notion over and over again – the presence of other people, even like-minded people, does not guarantee any protection from isolation because of issues with perception, background and expectations.

There are many reasons that a student can feel that they can’t reach out to their community and handling this is one of the big issues that we have in dealing with the transition into a new course of studies. We spend a lot of time with (very useful) mentoring schemes, networking among our students with supporting BBQs and meet-ups – but the things we actually do in lectures are also very helpful. If you have a group activity, or a talk-to-your-neighbour, exercise in the first week, you can be setting up small communities and networks that will survive for the rest of the student’s career. If the lecture space is also a community space, a meeting place and something that people look forward to, then we start to work on the many possible issues that can lead to isolation.

If someone isn’t making progress then, rather than focus on what they’re not doing and giving them a relatively tired lecture on keeping up effort and putting in the hours, it can sometimes help to ask who they’re working with, whether they have any friends in the course and, if not, direct the student to your support system. For students who have more serious problems, at our University we have a Transitions Service who provide a shopfront to the other services we have, ranging from friendly chats over tea to introductions to our counselling service. This is, however, a little bit of overkill in most cases – a chat, some activity in lectures and a BBQ or two can address at least some of the problems.

Educational Software Systems: What are our requirements?

Posted: April 8, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , | 1 Comment

My recent evaluation of strategic IT issues in my faculty brought one thing very clearly to my attention. If we assume that the content that I (or a student or any other academic) creates should continue to be available to me, unless I assign my rights to someone else, then we have a problem if the storage mechanism used is closed and fee-based. If it’s closed (proprietary formats possibly with deliberate obfuscation or encryption, or remote storage with access controls) then I can’t easily get it out of the system unless the software provider lets me. If this whole arrangement (licensing or access) is based on a fee, the the worst possible situation is that, in order to access old materials/data/whatever, I have to continue to pay largish sums on money to keep using something that I created. So that got me thinking – what else do I expect (naively or not) of the systems that we use for education? I’m talking mostly about Learning Management Systems (LMS) here because that’s my current focus. Here are some cut down versions of my current thoughts.

  1. Modular: Not all schools, even in the same college, are the same. Some are big, some are small. Some need essays checked for plagiarism when submitted. Some just need a place to drop the assignments. Some need interactive quizzes! Some just need web pages. If we have a system that’s built out of modules then I can get the modules that I need and (if money is involved) match investment to requirement. Even in the open source community, there are issues of performance, management burden and complexity in the modules that you choose so customisation here is useful. Modularity also isolates the impact of faults. Well-designed modules are like water-tight doors on a ship – one module failing doesn’t sink the ship.
  2. Extensible: There are always going to be requirements particular to your school or college. If your system can be extended then you can adjust the system to meet your specific needs. If not, then you have to work around it. (You could also call this mutable but I prefer the improvement implicit in extensible). Now I’m not saying who should be doing these changes because that’s a whole other argument – the fact that it can be done is what’s important here.
  3. Open Storage: Whatever I create, I should be able to get to, export, import it back from other systems and hang onto – especially if we migrate to a different system and shut the old one down. I’m a great believer in keeping formats open and then, if your product is excellent, I’ll happily use it. If, at the start of our relationship, you say “Well, you give me your data and you’re going to have to pay us if you want to get it out, and pay us every year you want access to it.” then you are pretty much going to have to be the only game in town because I have no power or control in that relationship – and I’m the one who should be in control here. (Most people are getting really good about this now, which is good to see, but there are far too many examples of software where the same producer couldn’t maintain compatibility across two versions.)
  4. Efficient: Using these kinds of systems should save you time. Something I’ve created should be able to be re-used easily, live or die as quickly as I want and survive between upgrades. There should be a definite advantage to doing this – if not, why are we using this system?
  5. Robust: It should be strong. Students attack in waves and I have beautiful graphs to show that the day before an assignment is due it’s “STOP, Hammer time”, and weak or delicate systems will fail under this kind of load. Any system designer who has assumed an average and hardened the system up to 70% concurrent usage had better step back and add about 40% to that number to count for multiple accesses, dangling connections, staff use… Even more importantly, if I make a change to something (add an assignment, undertake an assignment, change a mark) it needs to stay CHANGED. Finally, I need to be able to undo things when and if they go wrong. Because things go wrong.
  6. Invisible: Ultimately, I shouldn’t notice the system, and nor should my students. I use it to create things but I focus on creation, not your system. My students use it to access things and perform actions but they should never notice the system itself. If you look out a window, you should never notice cracked panes, dirty glass, rotting wood or the accidental sandwiching of a bird between the double-glazed panes.

I realise that there is a lot of debate on Open versus Proprietary systems in the community and I have no wish to open that can of worms – for myself, I use a Mac (mostly on the FreeBSD side) and do my analysis work in R, not S, but then I use Illustrator, not the Gimp, for final touch-ups. I’m the poster boy for using stuff that works so I have no wish to force people to choose open or closed, or ‘whatever is in between’. But I’d be really interested to see what else belongs (or what doesn’t belong) on this list – what do you think?

How the Internet Works: For You and On You

Posted: April 7, 2012 | Author: | Filed under: Education | Tags: , , , , , , | 1 Comment

I would link to a recent April 1st post on Randall Munroe’s XKCD (it’s http://www.xkcd.com/1037/ if you need to know) but I can’t because I’m not sure what you’ll see when you get there and some of the possible images are not safe for work. The theme of his post is umwelt, the notion that your perception of your own world is highly personal, influenced by your previous experiences and the lens that you have on your environment.

This is the image I see now – using my default browser. It is, very much, what you make of it. (I attribute the image to XKCD, but I can’t link to it for obvious reasons.)

A well? The Ring? The Sun? Your perception of what this mean depends on your senses, your experiences and your world to date.

Some people saw images of unlikely earthquakes. Some saw images of groups being stalked by velociraptors – but only when they elongated their screens enough to see everything on the page. Serving military saw a supportive post that encouraged them to keep an eye on the missiles. Panels adjusted based on who you were, which browser you used, where you were, even what size screen you used.

How did this work? Your browser provides a great deal of information as to what it is, to allow sites to adjust for browser variation. At the same time, the Internet Protocol (IP) address of your computer, the address that other computers use to get to it, gives away your location and your organisation. That’s why students at MIT got MIT jokes and people in Israel got an XKCD comic in Hebrew.

I can’t think of a better way to introduce students to the idea that gazing into the abyss also involves the abyss gazing into you. There are two great summary pages here (Reddit) and here (Google document).

This is the Internet and it’s ubiquitous. This is a great way to discuss the amount of information that is being sent back by every browser, from every platform. The amount of information that can be obtained by underlying systems that most people are unaware of.

For me, what I found most amusing is that a friend sent the link of the image to me saying “Hey, Voight Kampf test” (from Blade Runner) and I saw a picture of something completely different and thought my friend was mad. That’s something else to talk about – what it would mean if information itself mutated depended on who you were and where you were.

Putting the pieces together: Constructive Feedback

Posted: April 6, 2012 | Author: | Filed under: Education | Tags: , , , , , , , | Leave a comment

Over the last couple of days, I’ve introduced a scenario that examines the commonly held belief that negative reinforcement can have more benefit than positive reinforcement. I’ve then shown you, via card tricks, why the way that you construct your experiment (or the way that you think about your world) means that this becomes a self-fulfilling prophecy.

Now let’s talk about making use of this. Remember this diagram?

This shows what happens if, when you occupy a defined good or bad state, you then redefine your world so that you lose all notion of degree and construct a false dichotomy through partitioning. We have to think about the fundamental question here – what do we actually want to achieve when we categorise activities as good or bad?

Realistically, most highly praiseworthy events are unusual – the A+. Similarly, the F should be less represented across our students than the P and the “I’ve done nothing, I don’t care, give me 0” should be as unlikely as the A+. But, instead of looking at outcomes (marks), let’s look at behaviours. Now I’m going to construct my feedback to students to address the behaviour or approach that they employed to achieve a certain outcome. This allows me to separate the B+ of a gifted student who didn’t really try from the B+ of a student who struggled and strived to achieve it. It also allows me to separate the F of someone who didn’t show up to class from the F of someone who didn’t understand the material because their study habits aren’t working. Finally, this allows me to separate the A+ of achievement from the A+ of plagiarism or cheating.

Under stress, I expect people to drop back down in their ability to reason and carry out higher-level thought. We could refer to Maslow or read any book on history. We could invoke Hick’s Law – that time taken to make decisions increases as function of the number of choices, and factor in pilot thresholds, decision making fatigue and all of that. Or we could remember what it was like to be undergraduates. 🙂

Let me break down student behaviours into unacceptable, acceptable and desirable behaviours, and allocate the same nomenclature that I did for cards. So the unacceptable are now the 2,3,4, the acceptable and 5-10, and the desirable are J-K. (The numbers don’t matter, I’m after the concept.) When I construct feedback for my students, I want to encourage certain behaviours and discourage others. Ideally, I want to even develop more of certain behaviours (putting more Kings in the deck, effectively). But what happens if I don’t discourage the unacceptable behaviours?

Under stress, under reduced cognitive function and reduced ability to make decisions, those higher level desirable behaviours are most likely going to suffer. Let us model the student under stress as a stacked deck, where the Q and K have been removed. Not only do we have less possibility for praise but we have an increased probability of the student making the wrong decision and using a 2,3,4 behaviour. It doesn’t matter that we’ve developed all of these great new behaviours (added Kings), if under stress they all get thrown out anyway.

So we also have to look at removing or reducing the likelihood of the unacceptable behaviours. A student who has no unacceptable behaviour left in their deck will, regardless of the pressure, always behave in an acceptable manner. If you can also add desirable behaviours then they have an increase chance of doing well. This is where targeted feedback comes in at the behavioural level. I don’t need to worry about acceptable behaviours and I should be very careful in my feedback to recognise that there is an asymmetric situation where any improvement from unacceptable is great but a decline from desirable to acceptable may be nowhere near as catastrophic. Moderation, thought and student knowledge are all very useful concepts here. But we can also involve the student in useful and scaleable ways.

Raising student awareness of how their own process works is important. We use reflective exercises midway through our end-of-first year programming course to develop student process awareness: what worked, what didn’t work, how can you improve. This gives students a framework for self-assessment that allows them to find their own 2s and their own Kings. By getting the students to do it, with feedback from us, they develop it in their own vocabulary and it makes it ideal for sharing with other students at a similar level. In fact, as the final exercise, we ask students to summarise their growth in their process awareness during the course and ask them for advice that they would give to other students about to start. Here are three examples:

Write code. Go beyond your practicals, explore the language, try things out for yourself. The more you code, the better you’ll get, so take every opportunity you can. 

If I could give advice to a future … student, I would tell them to test their code as often as possible, while writing it. Make sure that each stage of your code is flawless before going onto the next stage. 

If I could give one piece of advice to students …, it would be to start the coding early and to keep at it. Sometimes you can have a problem that you just can’t work out how to fix but if you start early you leave yourself time to be able to walk away and come back later. A lot of the time when you come back you will see the problem very quickly and wonder why you couldn’t see it before. 

There are a lot of Kings in the above advice – in fact, let’s promote them and call them Aces, because these are behaviours that, with practice, will become habits and they’ll give you a K at the same time as removing a 2. “Practise your coding skills” “Test your code thoroughly” “Start early” Students also framed their lessons in terms of what not to do. As one student reflected, he knew that it would take him four days to write the code, so he was wondering why he only started two days out – you could read the puzzlement in the words as he wrote them. He’d identified the problem and, by semester’s end, had removed that 2.

I’m not saying anything amazing or controversial here, but I hope that this has framed a common situation in a way that is useful to you. And you got to shout at cards, too. Bonus!

← Older Entries
Newer Entries →