Let Me Eat Some Humble Pie First.

I’m, once again, sitting in an airport lounge and about to fly to Melbourne to discuss a challenging transition project. I have a very strange job in some ways. If you ask me what I am doing today it can vary from ‘teaching’ to ‘research’ (which says everything and nothing) or ‘flying to a meeting to look at something interesting’, because higher education is a damn funny beast in many ways.

Two days ago, however, what I was doing was “making an ass of myself”. Fortunately, the impact of this was that I ended up looking over-reactive and foolish, rather than any real damage, but this is something that I want to share with all of you because I am constantly aware of the aura of competence that we ascribe to the people in our societies who can communicate well. I regularly state (and it’s on my about page) that I expose my thinking processes in order to educate but there is something more than this, in that dissecting my own activities and reactions allows me to learn from myself.

I have read a great deal of literature on trying to bring change to areas that are steeped in tradition and burdened by history and, if you ask me, I can tell you that trying to force people to change won’t work. The best way to enact change is to provide an environment in which change can occur, providing pathways and good examples and by not wasting your time and effort bashing away at the unchanging stone faces of the looming statuary. The problem is, when you believe that you’re doing the right thing, that you get caught up in your own rhetoric. Worse, if you’ve been fighting these battles for years, you build up two highly destructive emotions: frustration, which then can lead to anger.

Two days ago, I let accumulated frustration out and I snapped at someone when, to be honest, I should have basically ignored it or, more positively, interpreted it generously and then guided the discussion towards the more generous interpretation. Instead of doing this, where I could have been positive, I took a negative stance and, boy, did I look like a schmuck when the dust settled.

And rightly so! I was a schmuck! The important thing now is for me to remember that my role is not to assume some level of authoritarian control over everything – I am not the evidence or the work of experts, I am a conduit that can help other people become more educated about these things. I tried to take control of something that not only could I not control but that it was not my job to control. Let’s call this a failure of humility – a hubris issue – and I shall make a delightful pie from it.

That’s “Pahh” for some of you.

The night of the aftermath and yesterday were very, very difficult for me because I had to review where I had gone wrong, how I could have handled it and what it meant for me in terms of ongoing relationships with people. I spent a lot of time in e-mail looking at constructive ways forward, with a lot of discussion and thought, and I believe that all the good avenues of dialog are open and, once again I’m still a schmuck, but no long term damage is done.

In the end, however, I have to apply the same spirit to myself that I apply to my students. I have to determine why I acted as I did (and, ultimately, it was over-protectiveness combined with fatigue). I have to work out how I could have done it better. I have to explain, in detail, to myself how I can change it and put steps in place to make sure that I change it. Then I move forward, with a new perspective and (I hope) a better way of dealing with things.

I am concerned with some of the information that has surfaced during this issue, as I am now worried that I am seriously out of step with some of my colleagues – a lot of what I’m trying to do revolves around how much mental adjustment someone can make and it is now obvious that there are far fewer usable foundations in some areas than I had hoped. This does not mean that I should become strident, shrill and militant because it won’t work. It does mean that I have some rethinking to do, a time to regroup and consider how I can go forward with the same message (educational research is useful, scientific and essential for our future) in a way that works for an even wider range of people.

Yes, if I had a time machine, I’d probably try and go back to not initiate the problems of two days ago. I prefer not to look like a raving idiot. But it’s not the end of the world and, as long as I’m learning from it, it’s a valuable reminder of how much more I have to learn, how much thinking is required to make good change happen and the fact that sometimes we all make mistakes.


Enhancing the Reputation of Australian IT Research – by giving it away?

(Update: Gernot has responded to this blog and has found fault with both it and the original article. I have responded to him. You can read his article here and my comment below that, or just look at the comments on this post. Thanks again, Gernot, for the clarifications.)

(Update 2: Gernot has put a further discussion of the points raised both in the previous post and this one, which you can find here. In this one, Gernot clearly explains why approaches were taken the way they were, how NICTA is benefiting from the ongoing work (as are we) and further identifies that the original article didn’t manage to capture a lot of the detail of what had happened. My thanks again to Professor Heiser for taking the time to respond to this so thoroughly and so patiently!

As I noted on his blog post, the article took a tone that I responded to and, with additional information, I can clearly see both the benefit as expressed and the reasons behind such a decision. I have left this and the follow-up posts intact, with these updates, to show the evolution of the discussion. Please make sure that you read both Parts 1 and 2 of Gernot’s response if you’re going to read this!)

I stumbled across this article in the Australian (Australia’s national newspaper) inside their AustralianIT section. In it, it was announced that the Australian research body National ICT Australia had sold “groundbreaking technologies” to a US company, for virtualisation security software that was used on 1.6 billion mobile devices worldwide. The spun-off company that was sold, Open Kernel (OK) Labs, was sold in its entirety and with no provision of royalties back to NICTA. Now, before we go any further, let’s talk about NICTA. NICTA is Australia’s Information and Communication Technology Research Centre of Excellence, employing about 700 people and funded by the Australian government. One of NICTA’s primary goals is to apply the high-impact research it develops to create national benefit and wealth for Australia. Remember this, it’s important.

Now let’s go back to the sale of OK Labs and, if you read the article carefully, you’ll see that there is some serious non-discussion of how much money changed hands and whether the Australian government, or NICTA, would receive any payment back at all from the sale. The former CTO and co-founder, Professor Gernot Heiser, has stated that while he couldn’t reveal the cost of the technology, it was about 25 person years of development. He then goes on to point out that the original micro-kernel was open source and hence no royalties accrued, but they had received some payments for it. (In the past, I think?) The second kernel was developed after the original OK Labs had been spun off, with NICTA retaining a minority share, but that NICTA didn’t have any share or role in its development, hence that had transferred wholesale to the new US owner and, again, no royalties. The third micro-kernel was a research outcome from NICTA but hadn’t been deployed commercially – but this was moot as OK Labs had received an exclusive licence to use it, then purchased it outright and NICTA had obtained some equity without cash in OK Labs as a result.

Got that? Now let’s get to the profit sharing. Firstly, there has been no indication whether NICTA would receive any payment back from the sale to balance against the initial investment of taxpayer funds.

Hmm.

Any profit from the deal went to OK Labs investors initially and “anything left” is distributed to shareholders, which included NICTA. (Remember that they traded valuable and NICTA developed research for a greater stake of the pie, which will be valuable if “anything is left”.)

Hmmm.

Let me add the final paragraph of the article here, because I can’t do it any better justice:

Professor Heiser said professional bankers were engaged to make the sale “and they didn’t do it for free”. He said the sale of OK Labs enhanced the reputation of Australian IT research.

Financially, this is pretty much what has happened.

I can only hope that this is the worst-written, hatchet-job of an article because, otherwise, I’m flabbergasted. It appears that a government funded body has managed to develop and deploy a technology while systematically ensuring that any actual benefit from IP developed on these monies was distributed to everyone else before a single dollar flowed back in to turn over the research cycle once more. The investors are making money, NICTA traded some valuable IP for magic beans and may not get any money, the bankers are making money and, somehow, in the scope of this operatically complex financial dance, where the private benefit is enormous, Professor Heiser then turns around and sticks a public benefit statement on the end. We’ve enhanced the reputation of Australian IT research.

How does this … situation enhance anyone’s opinion of our research? Who is going to know in a year’s time where that research came from and why will they ever have to know?

The standard shining light in Australian IT from public funding is the CSIRO WiFi patent which is scheduled to attract royalty payments of roughly $1 billion over the next 5-10 years. This is the model that everyone explains to you when you first get into University research and, if you have anything commercialisable, expect a knock on the door from your local research innovation group because everyone wants another CSIRO patent. A billion dollars buys a lot of research.

I don’t know how you can possible slice up 25 person years of time and trade that for a peppercorn in potentia, with federal funding and the dominant position of NICTA on the Australian academic research scene, and possibly call this enhancing the reputation of Australian IT Research. Why, yes, I’m sure investors will want to come back, get us to pay for it, trade it away, sell it to them with no hope of recouping our investment and then not require royalties. I have no doubt that this may bring more investors but in the same way that a wounded fish attracts sharks. The enhanced reputation of the fish is a fleeting experience and is hardly enjoyable.

If Professor Heiser is reading this, then I welcome any clarification that he can make and, in the Australian have miscast this, then I welcome and will publish any supported correction. I sincerely hope that this is merely a miscommunication because the alternative is really rather embarrassing for all concerned.


The Complex Roles Of Universities In The Period Of Globalization – Altbach – Part 3

To finish this triptych, I’d like to look at Altbach’s assessment of contemporary issues. Private education providers are one of the most obvious recent developments and, with the erosion of the public good motivator, this is no real surprise. It’s less of a surprise when you affix the word “Profit-making” in front of the words ‘education provider’. Given that there is growing demand for education and also given that we are blurring the lines between the institutions, it becomes easy to see why a new market has exploded for people who wish to provide education, or something like it, at a reasonable fee with a possibility of making lots and lots of money. This, however, has an impact on the public sector because it reduces the students who may have come to us for a variety of reasons, especially when the private institutions are targeting the more wealthy in some way. Suddenly, we find ourselves having to justify which kinds of knowledge we are teaching in the public sector because the type of knowledge, and the jobs it leads to, become an issue when you are competing for students inside certain professional areas. Faculties of Arts across the world are very much feeling themselves caught in this pinch. It is hard to imagine many older Universities making such a bald statement such as “There is no need for History or English Scholars”, yet by pumping resources into their professional and technical streams they are saying it through their resource distribution. If something does not provide income or attract the right market, a jaded eye is cast across it and, depending on the wealth and capacity of the institution, this leads to the shutting down of schools or entire faculties.

Why is this such a problem? Because restarting a discipline is much harder once the number of participants drops down too far. Reduce the number of people in a discipline and their shared publications and venues also shrink. Given that publication is vital to perceived success in many ways, this shrinkage will make it harder to publish OR lead to accusations of irrelevance as the overall citation level drops because there are so few people in the area. We are so heavily measured and assessed, as individuals and as universities, that we are beleaguered by league tables and beset by set publication standards. Our management structures, modes of accountability, the way that we have worked and thought for centuries are not a good fit for this new modality. This is not the golden age ramblings that I have previously pointed to as dreaming of better days – in this case, it’s true. Our systems don’t work with the new expectations.

Opening ourselves up to students from anywhere is a noble goal, and one I support wholeheartedly, but it brings great challenge. Can we pursue anything that interests us, relevant or not, and expect to meet the demands of the new century? If we can, I don’t think we can do it with the systems that we have and certainly not while we’re being measured on externally applied metrics of success. Even deciding on whether a student should be admitted or not is now a matter of school ranking, bonus points, place availability, status and, in murkier waters, the two speed entry system of public and privately-funded places in the same institution, where admitting one party may (in the worst case) prevent another from entering. As Altbach notes, our ideas of governance are changing as our scale grows and our complexity increases. Senior Professors used to set our course but now we either need or have taken on trained administrators who do not think as we do, have not had our training and, in many ways, treat us as a standard business with a strange product. We are more accountable than ever, while we wander around being randomly measured and trying to work out what it is that we need to do in order to be measured accurately and then try and perform our tasks of learning, teaching and research. How do we reconcile the community of scholars with the bureaucracies that run our institutions?

Altbach then moves on to discuss developing countries and the special challenges that they face. Many of these countries have broken links to their indigenous cultures, due to colonisation, occupation, war and civil unrest, and, when combined with the colonial trend to keep investment in higher education low, this means that many of these countries are systematically disadvantaged. Their systems are so small that expansion is hard – insufficient training grounds for new educators, delay in building and resource appropriation and the threat of instability combine to make it very hard to kickstart anything. Poverty and lack of local government resources move some of these attempts across to the ‘impossible’ category. As it becomes hard to limit enrolments, overcrowding is the norm and, while you can’t limit enrolment, you can use draconian measures to ensure that anyone who falls behind is ejected, in the hope that freeing up that slot might ease some of the crush on the resources. This is a very unforgiving approach to education: you have one chance, you blew it, goodbye. Given that this is one of the only paths out of poverty in many of these countries, and that it is very easy to fall behind in a poor and resource-starved system, this is a nasty little feedback loop. Where other institutions are built up in response to demand, these newer academies tend not to offer the same level of education and we once again have the problem of a piece of paper that is not as worthy as another: we are providing education in name only and creating yet another two-speed system. Where the job market and the educational bodies don’t keep up with each other you may have that most awful ghetto: the educated unemployed, who have invested time and money into a degree that grants them no advantage at all.

Where we are over-stretched, we tend to only do those things that generate the most benefit and this is also true in the case of these third world Universities. Teaching earns money so teaching dominates. Research is sidelined, international collaboration is sidelined and staff have no time to do anything except teach because they are trying to keep their salary coming. Unsurprisingly, this is not a stage set of excellence and advancement – these universities are falling further and further behind.

Altbach concludes by talking about the pressure that we are all under and that have made the majority of our institutions reactive, limiting our creativity to solving pressing problems in a response to external pressures. Right now, we are running so fast that we do not have time to question why we are even on this treadmill, let alone take any real steps to make serious change that is truly strategic rather than reactive. We have lost our autonomy to a degree, as well as our identity. We are enmeshed in society but in a role that favours the market forces and makes us dance in response to it. Altbach ponders what our role should be and proposes a move towards the broader public interest, moving away from market forces and towards academic autonomy.This is not the selfish “leave me alone” cry of a spoiled child, this is a recognition of the fact that we have many more things to offer than a diploma and a vocation: universities are societies of thinkers and are far more complex and diverse than our current strictures would make us appear. All universities are important, says Altbach, and it is at society’s peril that it ignores the many roles that a University can provide. Looking at us as profit-making, degree factories, or as an elite streaming system, ignores the grand public benefit of an educated society, the value of the public intellectual and the scholarly community. We deserve support, says Altbach, because serve the goals of society and the individual. Let us do our jobs properly.

I found it to be a very interesting article to read and I hope I’ve capture the essence reasonably well. I look forward to discussing it! Thanks again, RV!


This Is Your Captain Speaking: Turn Off Your Gadgets

“Ladies and gentlemen, boys and girls,

This is your Captain speaking. Shortly,I’m going to push on a set of levers that will allow fuel to pour into the steel cylinders affixed to the side of the plane and, in the presence of well-engineered flame, create a series of small and controlled explosions that will allow us to lift roughly 400 tonnes of metal and flesh into the air and propel you towards your destination.

As part of this, when the plane heads down the runway, we will pass a threshold known as V1. Do you know what V1 means? V1 is the takeoff decision speed  and is the speed at which we will try and take off, even if one engine fails. Basically, V1 is the speed at which we are travelling so fast that we are safest in the air – we are beyond the realm of air brakes or the rather amusingly useless brakes on the wheels. You know that mechanical brakes can evaporate on trucks when they’re going too fast, right? Think an even faster “pfft, bloooo” for planes.

Having gone through V1, we will reach V2. That is the speed at which, having committed to take-off, we will attempt to rotate the nose up and we will safely be able to take off, even if one engine is down. You know this speed. We trundle down the runway and you might miss V1 but the moment we rotate the nose up, that’s V2.

If I can’t easily find out when either of these speeds are, we’re stuffed. I need the read-outs in front of me to give me a reliable idea of these speeds or my co-pilots and I will be working on guesswork and you, seriously, do not want that.

There are two points when you are seriously vulnerable in an aircraft: takeoff and landing. During both of these moments, our proximity to the ground and reduced speed combine to form a major liability: any misjudgement at this point can lead to catastrophe because we have not got any time to recover from disaster. This, of course, is why we ask you to turn off every single possible source of interference to out aircraft systems, which includes phones, iPods, iPads, MP3 players, Kindles, Kobo readers, whatever. We want to have the best chance possible to let the plane tell us everything that it can.

Some of you don’t turn the gadgets off and, as your Captain, let me berate both you and the people who educated you. You, because you ignored the legal requirement to comply with my instructions and your teachers, because they failed to adequately instruct you in the importance of cause and effect, personal responsibility, and anecdotal evidence.

If you, as a person, opt to leave your gear on despite being asked not to, you are saying to the roughly 500 other passengers that your need to read a book in an electronic form, or watch a movie, trumps their fundamental right to personal safety. Now, we’re not 100% sure that this will cause a problem but, as we’re also not sure that it won’t interfere with our systems and we do need to know lots of stuff about the aeroplane at these critical times, we ask you to switch this gear off. Will it cause an accident? Probably not. Is it safe? We don’t know. Right now, you’re not demonstrating an adequate knowledge of cause and effect or personal responsibility.

Oh, so your Uncle Willie left his mobile on and nothing happened? Great! Fantastic! Was it this type of plane? Same avionics? Was there unforeseen confusion in the flight deck that no-one mentioned (Probably not but you don’t know.) Hey,  I hear Uncle Willie drove through an intersection once against the red lights at 100 mph – why don’t you try that?  Anecdotal evidence, especially one exceptional case, proves nothing.

Actions have repercussions but this doesn’t mean that there will always be a 1:1 match-up between them. If mobile phones always crashed planes, we’d search you and confiscate them. It’s the possible and unlikely interaction of plane and gadget that we’re worried about and this is why we sincerely hope that your teachers have managed to get this idea through to you, along with the fact that rationalisation doesn’t equal reason and one contrary exemplar does not state a uniform case.

Let me remind you that we will shortly be flying in a 400 tonne piece of metal that hurtles through the sky at 650 mph on top of 2-4 engines of burning flame.

Do you actually want to make it harder for me to control this?

Think about the possible impact of your actions, comply with crew directions and, for a few minutes at the start and end of the flight, do what I ask you to do and turn off your gadgets. It might not do anything, but it might give you a chance to be irritated by a similar announcement on a subsequent flight.

Thank you for your attention.”


The Philosophical Angle

Socrates drank hemlock after being found guilty of corrupting the minds of the youth of Athens, and impiety. Seneca submitted to the whims of Nero when the Emperor, inevitably, required that his old tutor die. Seneca’s stoicism was truly tested in this, given that he slashed his veins, took poison, jumped in a warm bath and finally had to be steamed to death before Nero’s edict that he kill himself was finally enacted. I, fortunately, expect no such demonstrations of stoic fortitude from my students but, if we are to think about their behaviour and development as self-regulating beings, then I think that a discussion of their personal philosophy becomes unavoidable. We have talked about the development state, their response to authority, their thoughts on their own thinking, but what of their philosophy?

If you are in a hurry and jump in your car, every red light between you and your destination risks becoming a personal affront, an enraging event that defies your expectation of an ‘all-green’ ride into town. There is no reason why you should expect such favours from the Universe, whatever your belief system, but the fact that this is infuriating to you remains. In the case of the unexpected traffic light, which sounds like the worst Sherlock Holmes story ever, the worst outcome is that you will be late, which may have a variety of repercussions. In preparing assignment work, however, a student may end up failing with far more dire and predictable results.

“Watson, I shall now relate the entire affair through Morse tapped pipe code and interpretative dance.”

While stoicism attracts criticism, understandably, because it doesn’t always consider the fundamentally human nature of humans, being prepared for the unforeseen is a vital part of any planning process. Self-regulation is not about drawing up a time table that allows you to fit in everything that you know about, it is about being able to handle your life and your work when things go wrong. Much as a car doesn’t need to be steered when it is going in a straight line and meeting our requirements, it is how we change direction when we know the road and when a kangaroo jumps out that are the true tests of our ability to manage our resources and ourselves.

Planning is not everything, as anyone who has read Helmuth von Moltke the Elder or von Clausewitz will know: “no plan survives contact with the enemy”. In this case, however, the enemy is not just those events that seek to confound us, it can be us as well! You can have the best plan in the world that relies upon you starting on Day X, and yet you don’t. You may have excellent reasons for this but, the fact remains, you have now introduced problems into your own process. You have met the enemy and it is you. This illustrates the critical importance of ensuring that we have an accurate assessment of our own philosophies – and we do have to be very honest.

There is no point in a student building an elaborate time management plan that relies upon them changing the habits of a lifetime in a week. But this puts the onus upon us as well: there is no point in us fabricating a set of expectations that a student cannot meet because they do not yet have a mature philosophy for understanding what is required. We don’t give up (of course!) but we must now think about how we can scaffold and encourage such change in a manageable way. I find reflection very handy, as I’ve said before, as watching students write things like “I planned for this but then I didn’t do it! WHY?” allows me to step in and discuss this at the point that the student realises that they have a problem.

I am not saying that a student who has a philosophy of “Maybe one day I will pass by accident” should be encouraged to maintain such lassitude, but we must be honest and realise that demanding that their timeliness and process maturity spring fully-formed from their foreheads is an act of conjuring reserved only for certain Greek Gods. (Even Caligula couldn’t manage it and he had far greater claim to this than most.) I like to think of this in terms of similarity of action. If anything I do is akin to walking up to someone and yelling “You should hand in on time, do better!” then I had better re-think my strategy.

The development of a personal philosophy, especially when you may not have ever been exposed to some of the great exemplars, is a fundamentally difficult task. You first need to understand that such a concept exists, then gain the vocabulary for discussing it, then interpret your current approach and see the value of change. Once you have performed all of those tasks, then we can start talking about getting from A to B. If you don’t know what I’m talking about or can’t understand why it’s important, or even discuss core concepts, then I’m yelling at you in the corridor and you’ll nod, compliantly, until I go away. Chances of you taking positive steps in the direction that I want? Very low. Probably, nil. And if it does happen, either it’s accidental or you didn’t actually need my help.

I try to be stoic but I must be honest and say that if Nero sentenced me to death, I’d nod, say “I expected that”, then put on some fast saxophone music and leg it up over the seven hills and far away. I don’t think I’d ever actually expect true stoicism from most of my students. but a simple incorporation of the fact that not everything works out as you think it will would be a definite improvement over the current everything will work out in my favour expectation that seems to be the hallmark of the more frequently disappointed and distressed among them. The trick is that I first have to make them realise that this is something that, with thought, they can not only fix but use to make a genuine, long-lasting and overwhelmingly positive change in their lives.


A Puzzling Thought

Today I presented one of my favourite puzzles, the Monty Hall problem, to a group of Year 10 high school students. Probability is a very challenging area to teach because we humans seem to be so very, very bad at grasping it intuitively. I’ve written before about Card Shouting, where we appear to train cards to give us better results by yelling at them, and it becomes all too clear that many people have instinctive models of how the world work that are neither robust nor transferable. This wouldn’t be a problem except that:

  1. it makes it harder to understand science,
  2. the real models become hard to believe because they’re counter-intuttitve, and
  3. casinos make a lot of money out of people who don’t understand probability.

Monty Hall is simple. There are three doors and behind one is a great prize. You pick a door but it doesn’t get opened. The host, who knows where the prize is, opens one of the doors that you didn’t pick but the door that he/she opens is always going to be empty. So the host, in full knowledge, opens a known empty door, but it has to be one that you didn’t pick. You then have a choice to switch to the door that you didn’t pick and that hasn’t been opened, or you can stay with your original pick.

Based on a game show, Monty Hall was the name of the presenter.

Now let’s fast forward to the fact that you should always switch because you have a 2/3 chance of getting the prize if you do (no, not 50/50) so switching is the winning strategy. Going into today, what I expected was:

  • Initially, most students would want to stay with their original choice, having decided that there was no benefit to switching or that it was a 50/50 deal so it didn’t make any sense.
  • At least one student would actively reject the idea.
  • With discussion and demonstration, I could get students thinking about this problem in the right way.

The correct mental framework for Monty Hall is essential. What are the chances, with 1 prize behind 3 doors, that you picked the right door initially. It’s 1/3, right? So the chances that you didn’t pick the correct door is 2/3. Now, if you just swapped randomly, there’d be no advantage but this is where you have to understand the problem. There are 2 doors that you didn’t pick and, by elimination, these 2 doors contain the prize 2/3 of the time. The host knows where the prize is so the host will never open a door and show you the prize, the host just removes a worthless door. Now you have two sets of doors – the one you picked (correct 1/3 of the time) and the remaining door from the unpicked pair (correct 2/3 of the time). So, given that there’s only one remaining door to pick in the unpicked pair, by switching you increase your chances of winning from 1/3 to 2/3.

Don’t believe me? Here’s an on-line simulator that you can run (Ignore what it says about Internet Explorer, it tends to run on most things.)

Still don’t believe me? Here’s some Processing code that you can run locally and see the rates converge to the expected results of 1/3 for staying and 2/3 for switching.

This is a challenging and counter-intuitive result, until you actually understand what’s happening, and this clearly illustrates one of those situations where you can ask students to plug numbers into equations for probability but, when you actually ask them to reason mathematically, you suddenly discover that they don’t have the correct mental models to explain what is going on. So how did I approach it?

Well, I used Peer Instruction techniques to get the class to think about the problem and then vote on it. As expected, about 60% of the class were stayers. Then I asked them to discuss this with a switcher and to try and convince each other of the rightness of their actions. Then I asked them to vote again.

No significant change. Dang.

So I wheeled out the on-line simulator to demonstrate it working and to ensure that everyone really understood the problem. Then I showed the Processing simulation showing the numbers converging as expected. Then I pulled out the big guns: the 100 door example. In this case, you select from 100 doors and Monty eliminates 98 (empty) doors that you didn’t choose.

Suddenly, when faced with the 100 doors, many students became switchers. (Not surprising.) I then pointed out that the two problems (3 doors and 100 doors) had reduced to the same problem, except that the remaining doors were the only door left standing from 2 and 99 doors respectively. And, suddenly, on the repeated vote, everyone’s a switcher. (I then ran the code on the 100 door example and had to apologise because the 99% ‘switch’ trace is so close to the top that it’s hard to see.)

Why didn’t the discussion phase change people’s minds? I think it’s because of the group itself, a junior group with very little vocabulary of probability. it would have been hard for the to articulate the reasons for change beyond much ‘gut feeling’ despite the obvious mathematical ability present. So, expecting this, I confirmed that they were understanding the correct problem by showing demonstration and extended simulation, which provided conflicting evidence to their previously held belief. Getting people to think about the 100 door model, which is a quite deliberate manipulation of the fact that 1/100 vs 99/100 is a far more convincing decision factor than 1/3 vs 2/3, allowed them to identify a situation where switching makes sense, validating what I presented in the demonstrations.

In these cases, I like to mull for a while to work out what I have and haven’t learned from this. I believe that the students had a lot of fun in the puzzle section and that most of them got what happened in Monty Hall, but I’d really like to come back to them in a year or two and see what they actually took away from today’s example.

 


More on Computer Science Education as a fundamentally challenging topic.

Homo sum, humani a me nihil alienum puto (I am a [human], nothing human is foreign to me)” , Terence, 163BC

While this is a majestic sentiment, we are constantly confronted by how many foreign ideas and concepts there are in our lives. In the educational field, Meyer and Land have identified threshold concepts as a set of concepts that are transformative once understood but troublesome and alien before they are comprehended. The existence of these, often counter-intuitive, concepts give the lie to Terence’s quote as it appears that certain concepts will be extremely foreign and hard to communicate or comprehend until we understand them. (I’ve discussed this before in my write-up of the ICER Keynote.)

“Terry” to his friends.

Reading across the fields of education, educational psychology and Computer Science education research, it rapidly becomes apparent that some ideas have been described repeatedly over decades, but have gained little traction. Dewey’s disgust at the prison-like school classroom was recorded in 1938, yet you can walk onto any campus in the world and find the same “cells”, arrayed in ranks. The lecture is still the dominant communication form in many institutions, despite research support for the far greater efficacy of different approaches. For example, the benefits of social constructivism, including the zone of proximal development, are well known and extensively studied, yet even where group work is employed, it is not necessarily designed or facilitated to provide the most effective outcomes. The majority of course design and implementation shows little influence of any of the research conducted in the last 20 years, let alone the cognitive development stages of Piaget, the reliance upon authority found in Perry or even the existence of threshold concepts themselves. Why?

From a personal perspective, I was almost completely ignorant of the theoretical underpinnings of educational practice until very recently and I still rate myself as a rank novice in the area. I write here to be informed, not to be seen as an expert, and I learn from thinking and writing about what I’m doing. I am also now heavily involved in a research group that focuses on this so I have the peer support and time to start learning in the fascinating area of Computer Science Education. Many people, however, do not, and it is easy to see why one would not confront or even question the orthodoxy when one is unaware of any other truth.

Of course, as we all know, it is far harder to see that anything needs fixing when, instead of considering that our approach may be wrong, we identify our students as the weak link in the chain. It’s easy to do and, because we are often not scrupulously scientific in our recollection of events (because we are human), our anecdotal evidence dominates our experience. “Good” students pass, “bad” students fail. If we then define a bad student as “someone who fails”, we have a neat (if circular) definition that shields us from any thoughts on changing what we do.

When I found out how much I had to learn, I initially felt very guilty about some of the crimes that I had perpetrated against my students in my ignorance. I had bribed them with marks, punished them for minor transgressions with no real basis, talked at them for 50 minutes and assumed that any who did not recall my words just weren’t paying attention. At the same time, I carried out my own tasks with no bribery, negotiated my own deadlines and conditions, and checked my mail whenever possible in any meetings in which I felt bored. The realisation that, even through ignorance and human frailty, you have let your students down is not a good feeling, especially when you realise that you have been a hypocrite.

I lament the active procrastinator, who does everything except the right work and thus fails anyway with a confused look on their face, and I feel a great sympathy for the caring educator who, through lack of exposure or training, has no idea that what they are doing is not the best thing for their students. This is especially true when the educators have been heavily acculturated by their elders and superiors, at a vulnerable developmental time, and now not only have to question their orthodoxy, they must challenge their mentors and friends.

Scholarship in Computer Science learning and teaching illuminates one’s teaching practice. Discovering tools, theories and methodologies that can explain the actions of our students is of great importance to the lecturer and transforms the way that one thinks about learning and teaching. But transformative and highly illuminative mechanisms often come at a substantial cost in terms of the learning curve and we believe that this explains why there is a great deal of resistance from those members of the community who have not yet embraced the scholarship of learning and teaching. Combine this with a culture where you may be telling esteemed and valued colleagues that they have been practising poorly for decades and the resistance becomes even more understandable. We must address the fact that resistance to acceptance in the field may stem from effects that we would carefully address in our students (their ongoing problems with threshold concepts) but that we expect our colleagues to just accept these alien, challenging and unsettling ideas merely because we are right.

The burden of proof does not, I believe, lie with us. We have 70 years of studies in education and over 100 years of study in work practices to establish the rightness of our view. However, I wonder how we can approach our colleagues who continue to question these strange, counter-inutitive and frightening new ideas and help them to understand and eventually adopt these new concepts?

 


De Profundis – or de-profounding?

“It is common to assume that we are dealing with a highly intelligent book when we cease to understand it.” (de Botton, The Consolations of Philosophy, p157)

The notion of a lack of comprehension being a fundamental and innate fault of the reader, rather than the writer, is a mistake made, in many different and yet equally irritating ways, throughout the higher educational sector. A high pass rate may be seen as indicative of an easy course or a weak marker. A high failure rate may be attributed to the innate difficulty of the work or the inferior stuff of which the students are made. As I have written before, under such a presumption, I could fail all of my students and strut around, the smartest man in my University, for none have been able to understand the depths and subtlety of my area of knowledge.

Yet, if the real reason is that I have brought my students to a point where their abilities fail them and, either through ignorance or design, I do not strive to address this honestly and openly, then it doesn’t matter how many of them ultimately pass – I will be the biggest failure in the class. I know a great number of very interesting and intelligent educators but, were you to ask me if any of them could teach, I would have to answer that I did not know, unless I had actually seen them do so. For all of our pressure on students to contain the innate ability to persevere, to understand our discipline or to be (sorry, Ray) natural programmers, the notion that teaching itself might not be something that everyone is capable of is sometimes regarded as a great heresy. (The notion or insistence that developing as a teacher may require scholarship and, help us all, practise, is apostasy – our heresy leading us into exile.) Teaching revolves around imparting knowledge efficiently and effectively so that students may learn. The cornerstone of this activity is successful and continuing communication. Wisdom may be wisdom but it rapidly becomes hard to locate or learn from when it is swaddled in enough unnecessary baggage.

I have been, mostly thanks to the re-issue of cheap Penguins, undertaking a great deal of reading recently and I have revisited Marcus Aurelius, Seneca, de Botton and Wilde. The books that are the most influential upon me remain those books that, while profound, maintain their accessibility. Let me illustrate this with an example. For those who do not know what De Profundis means, it is a biblical reference to Psalm 130, appropriated by the ever humble Oscar Wilde as the title of his autobiographical letter to his former lover, from the prison in which he was housed because of that love.

But what it means is “From the depths”. In the original psalm, the first line is:

De profundis clamavi ad te, Domine;
From the depths, I have cried out to you, O Lord;

And in this reading, we see the measure of Wilde’s despair. Having been sentenced to hard labour, and having had his ability to write confiscated, his ability to read curtailed, and his reputation in tatters, he cries out from the depths to his Bosie, Lord Douglas.

De profundis [clamavi ad te, Bosie;]

If you have the context for this, then this immediately prepares you for the letter but, as it is, the number of people who are reading Wilde is shrinking, let alone the number of people who are reading a Latin Bible. Does this title still assist in the framing of the work, through its heavy dependence upon the anguish captured in Psalm 130, or is it time to retitle it “From the depths, I have cried out to you!” to capture both the translation and the sense. The message, the emotion and the hard-earned wisdom contained in the letter are still valuable but are we hurting the ability of people to discover and enjoy it by continuing to use a form of expression that may harm understanding?

Les Très Riches Heures du duc de Berry, Folio 70r – De Profundis the Musée Condé, Chantilly. (Another form of expression of this Psalm.)

Now, don’t worry, I’m not planning to rewrite Wilde but this raises a point in terms of the occasionally unhappy union of the language of profundity and the wisdom that it seeks to impart. You will note the irony that I am using a heavily structured, formal English, to write this and that there is very little use of slang here. This is deliberate because I am trying to be precise while still being evocative and, at the same time, illustrating that accurate use of more ornate language can obscure one’s point. (Let me rephrase that. The unnecessary use of long words and complex grammar gets in the way of understanding.)

When Her Majesty the Queen told the Commonwealth of her terrible year, her words were:

“1992 is not a year on which I shall look back with undiluted pleasure. In the words of one of my more sympathetic correspondents, it has turned out to be an Annus Horribilis.”

and I have difficulty thinking of a more complicated way of saying “1992 was a bad year” than to combine a complicated grammatical construction with a Latin term that is not going to be on the lips of the people who are listening to the speech. Let me try: “Looking back on 1992, it has been, in the words of one of my friends, a terrible year.” Same content. Same level of imparted knowledge. Much less getting in the way. (The professional tip here is to never use the letters “a”, “n”, “s” and “u” in one short word unless you are absolutely sure of your audience. “What did she say about… nahhh” is not the response you want from your loyal subjects.) [And there goes the Knighthood.]

I love language. I love reading. I am very lucky that, having had a very broad and classically based education, I can read just about anything and not be intimidated or confused by the language forms – providing that the author is writing in one of the languages that I read, of course! To assume that everyone is like me or, worse, to judge people on their ability because they find long and unfamiliar words confusing, or have never had the opportunity to use these skills before, is to leap towards the same problem outlined in the quote at the top. If we seek to label people unintelligent when they have not yet been exposed to something that is familiar to us, then this is just as bad as lauding someone’s intelligence because you don’t understand what they’re talking about.

If my students need to know something then I have to either ensure that they already do so, by clearly stating my need and being aware of the educational preparation in my locale, or I have to teach it to them in forms that they can understand and that will allow them to succeed. I may love language, classical works and big words, but I am paid to teach the students of 2012 to become the graduates, achievers and academics of the future. I have to understand, respect and incorporate their context, while also meeting the pedagogical and knowledge requirements of the courses that I teach.

No-one said it was going to be easy!


ICER 2012 Day Research Paper Session 4

This session kicked off with “Ability to ‘Explain in Plain English’ Linked to Proficiency in Computer-based Programming”,  (Laurie Murphy, Sue Fitzgerald, Raymond Lister and Renee McCauley (presenting)). I had seen a presentation along these lines at SIGCSE and this is an excellent example of international collaboration, if you look at the authors list. Does the ability to explain code in plain English correlate with ability to solve programming problems? The correlation appears to be there, whether or not we train students in Explaining in Plain English or not, but is this causation?

This raises a core question, addressed in the talk: Do we need to learn to read (trace) code before we learn to write code or vice versa? The early reaction of the Leeds group was that reading code didn’t amount to testing whether students could actually write code. Is there some unknown factor that must be achieved before either or both of these? This is a vexing question as it raises the spectre of whether we need to factor in some measure of general intelligence, which has not been used as a moderating factor.

Worse, we now return to that dreadful hypothesis of “programming as an innate characteristics”, where you were either born to program or not. Ray (unsurprisingly) believes that all of the skills in this area (EIPE/programming) are not innate and can be taught. This then raises the question of what the most pedagogically efficient way is to do this!

How Do Students Solve Parsons Programming Problems? — An Analysis of Interaction Traces
Juha Helminen (presenting), Petri Ihantola, Ville Karavirta and Lauri Malmi

This presentation was of particular interest to me because I am currently tearing apart my 1,900 student data corpus to try and determine the point at which students will give up on an activity, in terms of mark benefit, time expended and some other factors. This talk, which looked at how students solved problems, also recorded the steps and efforts that they took in order to try and solve them, which gave me some very interesting insights.

A Parsons problem is one where, given code fragments a student selects, arranges and composes a program in response to a question. Not all code fragments present will be required in the final solution. Adding to the difficulty, the fragments require different indentation to assert their execution order as part of block structure. For those whose eyes just glazed over, this means that it’s more than selecting a line to go somewhere, you have to associate it explicitly with other lines as a group. Juha presented a graph-based representation of the students’ traversals of the possible solutions for their Parsons problem. Students could ask for feedback immediately to find out how their programs were working and, unsurprisingly, some opted for a lot of “Am I there yet” querying. Some students queried feedback as much as 62 times for only 7 features, indicative of permutation programming, with very short inter-query intervals. (Are we there yet? No. Are we there yet? No. Are we there yet? No. Are we there yet? No.)

The primary code pattern of development was linear, with block structures forming the first development stages, but there were a lot of variations. Cycles (returning to the same point) also occurred in the development cycle but it was hard to tell if this was a deliberate reset pattern or a one where permutation programming had accidentally returned the programmer to the same state. (Asking the students “WHY” this had occurred would be an interesting survey question.)

There were some good comments from the audience, including the suggestion of correlating good and bad states with good and bad outcomes, using Markov chain analysis to look for patterns. Another improvement suggested was recording the time taken for the first move, to record the impact (possible impact) of cognition on the process. Were students starting from a ‘trial and error’ approach or only after things went wrong?

Tracking Program State: A Key Challenge in Learning to Program
Colleen Lewis (presenting, although you probably could have guessed that)

This paper won the Chairs’ Award for the best paper at the Conference and it was easy to see why. Colleen presented a beautifully explored case study of an 11 year old boy working on a problem in the Scratch programming language and trying to work out why he couldn’t draw a wall of bricks. By capturing Kevin’s actions, in code, his thoughts, from his spoken comments, we are exposed to the thought processes of a high achieving young man who cannot fathom why something isn’t working.

I cannot do justice to this talk by writing about something that was primarily visual, but Colleen’s hypothesis was that Kevin’s attention to the state (variables and environmental settings over which the program acts) within the problem is the determining factor in the debugging process. Once Kevin’s attention was focused on the correct problem, he solved it very quickly because the problem was easy to solve. Locating the correct problem required him to work through and determine which part of the state was at fault.

Kevin has a pile of ideas in his head but, as put by duSessa and Sherin (98), learning is about reliably using the right ideas in the correct context. Which of Kevin’s ideas are being used correctly at any one time? The discussion that followed talked about a lot of the problems that students have with computers, in that many students do not see computers as actually being deterministic. Many students, on encountering a problem, will try exactly the same thing again to see if the error occurs again – this requires a mental model that we expect a different set of outcomes with the same inputs and process, which is a loose definition of either insanity or nondeterminism. (Possibly both.)

I greatly enjoyed this session but the final exemplar, taking apart a short but incredibly semantically rich sequence and presenting it with a very good eye for detail, made it unsurprising that this paper won the award. Congratulations again, Colleen!


Our Influence: Prejudice As Predictor

If you want to see Raymond Lister get upset, tell him that students fall into two categories: those who can program and those who can’t. If you’ve been reading much (anything) of what I’ve been writing recently, you’ll realise that I’ve been talking about things like cognitive developmentself-regulationdependence on authority, all of which have one thing in common in that students can be at different stages when they reach us. There is no guarantee that students will be self-reliant, cognitively mature and completely capable of making reasoned decisions at the most independent level.

There was a question raised several times during the conference and it’s the antithesis of the infamous “double hump conjecture”, that students divide into two groups naturally and irrevocably because of some innate characteristic. The question is “Do our students demonstrate their proficiency because of what we do or in spite of what we do?” If the innate characteristic conjecture is correct, and this is a frequently raised folk pedagogy, then our role has no real bearing on whether a student will learn to program or not.

If we accept that students come to us at different stages in their development, and that these development stages will completely influence their ability to learn and form mental models, then the innate characteristic hypothesis withers and dies almost immediately. A student who does not have their abilities ready to display can no more demonstrate their ability to program than a three-year old child can write Shakespeare – they are not yet ready to be able to learn, assemble, reassemble or demonstrate the requisite concepts and related skills.

However, a prejudicial perspective that students who cannot demonstrate the requisite ability are innately and permanently lacking that skill will, unpleasantly, viciously and unnecessarily, cause that particular future to lock in. Of course a derisive attitude to these ‘stupid’ or ‘slow’ students will make them withdraw or undermine their confidence! As I will note from the conference, confidence and support have a crucial impact on students. Undermining a student’s confidence is worse than not teaching them at all. Walking in with the mental model that separates the world into programmers and non-programmers forces that model into being.

Since I’ve entered the area of educational research, I’ve been exposed to things that I can separate into the following categories:

  • Fascinating knowledge and new views of the world, based on solid research and valid experience.
  • Nonsense
  • Damned nonsense
  • Rank stupidity

Where most of the latter come from other educators who react, our of fear or ignorance, to the lessons from educational research with disbelief, derision and resentment. “I don’t care what you say, or what that paper says, you’re wrong” says the voice of “experience”.

There is no doubt that genuine and thoughtful experience is, has been, and will always be a strong and necessary sibling to the educational and psychological theory that is the foundation of educational research. However, shallow experience can often be built up into something that it is not, when it is combined with fallacious thinking, cherry picking, confirmation bias and any other permutation of fear, resentment and inertia. The influence of folk pedagogies, lessons claimed from tea room mutterings and the projection of a comfortable non-reality that mysteriously never requires the proponent to ever expend any additional effort or change what they do, is a malign shadow over the illumination of good learning and teaching practice.

The best educators explain their successes with solid theory, strive to find a solution to the problems that lead to failure, and listen to all sources in order to construct a better practice and experience for their students. I hope, one day, to achieve this level- but I do know that doubting everything new is not the path forward for me.

I am pleased to say that the knowledge and joy of this (to me) new field far outstrips most of the other things that I have seen but I cannot stress any more how important it is that we choose our perspectives carefully. We, as educators, have disproportionally high influence: large shadows and big feet. Reading further into this discipline illustrates that we must very carefully consider the way that we think, the way that our students think and the capability that we actually have in the students for reasoning and knowledge accumulation before we make any rash or prejudicial statements about the innate capabilities of that most mythical of entities: the standard student.