Moral Luck and Voluntary Action: Is There a Corresponding Pedagogical Luck?

Moral luck (sometimes described as moral accident) describes a situation where someone is assigned moral blame or praise for something happening, even though the person was either not in control of what was happening or could not affect its consequences. There are many examples, including the traffic accident scenario described in the Moral Luck link, and there are several different classifications of moral luck but let me focus on one: the situation where you either take no positive steps to address a situation, or actively take negative steps, yet the outcome is still positive. To a consequentialist, this is a beneficial outcome and constitutes an example of Resultant Moral Luck. One of the most extreme examples is that you randomly stick your foot out, hoping to trip someone in the street, and accidentally bring down a criminal being pursued by the police. The outcome is good, you are possibly a hero, but any assignation of a moral intention to your actions is deeply flawed: you weren’t in control of the situation, you did not intend the outcome and, in fact, you had hoped to cause harm. The voluntary action that you took was in no way intended to cause this outcome. Yet, you are a hero.

When we look at methods and practices of teaching, it quickly becomes apparent that there are many different approaches and, upon doing some reading, that these have different utilities and efficacies. Your choice of pedagogy is rarely a one-size-fits-all approach and, especially if your institution takes a relatively traditional approach, we have to start to wonder exactly which part of the evolutionary selection stage we are in. Have we, by chance and/or design, arrived at an elegant and efficient design years ago that cannot be improved upon by recent findings or are we ripe for new development, new directions and entirely different ways of teaching?

I would argue that, if we are not taking steps to confirm where we are in the developmental timeline or we are not taking steps to examine what we do with the intention of improving,  then we are wandering in an area that we could call pedagogical luck, where any positive teaching outcomes that may arise cannot be attributed to our voluntary actions and intentions. Are we in the territory that Feynman was referring to when he quoted Gibbon:

“The power of instruction is seldom of much efficacy except in those happy dispositions where it is almost superfluous”?

The notion of pedagogical luck, much like moral luck, raises questions of responsibility and accountability. It also explains how we can misattribute blame, because we risk not having a clear ethical framework that can ascribe intention, action and outcome in a meaningful way. In moral luck two people can speed through the same red light, yet only one causes an accident because a child runs into an intersection and the other one may receive a fine for running the light. The outcomes could almost not be any more starkly different: in one a human is injured or killed, the other is a purely administrative outcome. We certainly will attribute more blame to the first driver than the second, despite the fact that both had no desire to kill, nor did they act any differently – the reason that this is resultant is because this is just the way things turned out.

If an academic works with a class and, as it happens, everyone passes, then we would usually assume some intention and voluntary action was involved on the part of that academic. The outcome, for the students and the academic, are both beneficial. It is… unlikely… that said academic would then walk around stating “I’m amazed that they all passed – I barely even showed up to class and I didn’t revise the notes.” However, where someone has done nothing (or has not taken a voluntary action to cause change) and all of the students fail, we can expect (with a reasonable certainty) that the usual statements of blame shifting may start to occur: the students were stupid, lazy, unprepared, insufficiently attentive, the material was pitched at the right level but the students didn’t work hard enough, et cetera. “I have kept the course the same, it is obviously the students who are at fault.” Of course, it’s easy to see why if we have not taken any active steps to change anything – why should we be held responsible for an action that has had either neutral or positive outcomes in the past? Why should we judge the killer-driver any more harshly than the red-light-runner? The outcome is a matter of luck.

This is highly undesirable behaviour so how can we avoid the issues involved in depending upon pedagogical luck? I’m tempted to delve into virtue ethics here and argue that, of all places, that if you can’t find a virtuous seeker of knowledge in a University then perhaps we should all go back to a simple agrarian existence and wait to die of some horrifically mutated bovine disease that we no longer have the wit or wisdom to cure. However, I suspect that we don’t need to all be virtuous, all the time, to adopt a simple maxim that commits us to seeking improvement in our learning and teaching, or to confirming that our approaches are still valid. Where possible, such endeavours should be public and shared widely, so that our lessons can be learned elsewhere. Yes, we’ve wandered fairly heavily into Kant because I’m effectively arguing good will as a stand-alone virtue, regardless of what is achieved. In the absence of a guarantee of virtuous people, and we all have bad days, then perhaps it is a commitment to scholarship, review and reflection that can allow us to take that fresh approach to pedagogical development and implementation that will cause us to be less susceptible to blame shifting where it is inappropriate and less likely to form cargo-cultish ideas as to why certain courses are succeeding or failing.

It is a simple idea: claiming beneficial outcomes as caused by us when we have done nothing is questionable, ethically, especially when we refuse to accept negative outcomes under the same scenario. By identifying that pedagogical luck is possible and readily identifiable in certain practices around the world, we clearly identify the need to avoid the situations where it can dominate.


The Earth Goes Around the Sun or the Sun Goes Around the Earth: Your Reaction Reflects Your Investment

There is a rather good new BBC version of Sherlock Holmes, called Sherlock because nobody likes confusion, where Holmes is played by Benedict Cumberbatch. One of the key points about Holmes’ focus is that it comes at a very definite cost. At one point, Cumberbatch’s Holmes is being lightly mocked because he was unaware that the Earth goes around the Sun. He is completely unfazed by this (he may have known it but he deleted it) because it’s not important to him. This extract is from the episode “The Great Game”:

Sherlock Holmes: Listen: [gets up and points to his head] This is my hard-drive, and it only makes sense to put things in there that are useful. Really useful. Ordinary people fill their heads with all kinds of rubbish, and that makes it hard to get at the stuff that matters! Do you see?

John Watson[brief silence; looks at Sherlock incredulously] But it’s the solar system!

Sherlock Holmes[extremely irritated by now] Oh, hell! What does that matter?! So we go around the sun! If we went around the moon or round and round the garden like a teddy bear, it wouldn’t make any difference! All that matters to me is the work!

Sherlock’s (self-described) sociopathy and his focus on his work make heliocentricity an irrelevant detail. But this clearly indicates his level of investment in his work. All the versions of Sherlock have extensive catalogues of tobacco types, a detailed knowledge of chemistry and an unerring eye for detail. If someone had walked up to him and said “Captain Ross smokes Greenseas tobacco” and they were wrong then Sherlock’s agitation (and derision) would be directed at them: worse if he had depended upon this fact to draw a conclusion.

We are all well aware that such indifference to whether Sun or Earth occupies the centre of the Solar System has not always been received so sanguinely. As it turns out, while there is widespread acceptance of the fact of heliocentricity, there is still considerable opposition in some quarters and, in the absence of scientific education, it is easy to see why people would naturally assume by simple (unaided) observation that the Sun is circling us, rather than the reverse. You have to accept a number of things before heliocentricity moves from being a sound mathematical model for calculation (as Cardinal Bellarmine did when discussing it with Galileo, because it so well explains things hypothetically) to the acceptance of it as the model of what actually occurs (as it makes the associated passages of scripture much harder to deal with). And the challenge of accepting this often lies in the degree to which that acceptance will change your world.

Your reaction reflects your investment.

Sherlock didn’t care either way. His world was not shaken by which orbited what because it was not a key plank of his being, nor did it force him to revise anything that he cared about. Cardinal Bellarmine, in discussions with Galileo, had a much greater investment, acting as he was on behalf of the Church and, one can only assume, firm in his belief in scripture while retaining his sensibilities to be able work in science (Bellarmine was a Jesuit and worked predominantly in theology). As he is quoted:

If there were a real proof that the Sun is in the center of the universe, that the Earth is in the third sphere, and that the Sun does not go round the Earth but the Earth round the Sun, then we should have to proceed with great circumspection in explaining passages of Scripture which appear to teach the contrary, and we should rather have to say that we did not understand them than declare an opinion false which has been proved to be true. But I do not think there is any such proof since none has been shown to me.

It’s easy to think that these battles are over but, of course, as we deal with one challenging issue, another arises. This battle is not actually over. The 2006 General Social Survey showed that 18.3% of those people surveyed thought that the Sun went around the Earth, and 8% didn’t know. (0.1% refused. I think I’ve read his webpage.) (If you’re interested, all of the GSS data and its questions are available here. I hope to run the more recent figures to see how this has trended but I’ve run out of time this week.) That’s a survey run in 2006 in the US.

Why do nearly a quarter of the US population (or why did, given that this is 2006) not know about the Earth going around the Sun? As an educator, I have to look at this because if it’s because nobody told them, then, boy, do we have some ‘splaining to do. If it’s because they deleted it like Sherlock, then we have some seriously focused people or a lot of self-deleting sociopaths. (This is also not that likely a conjecture.) If it’s because someone told them that believing this meant that they had to spit in the face of one god or another, then we are seeing the same old combat between reaction and investment. There are a number of other correlations on this that, fortunately, indicate that this might be down to poor education, as knowledge of heliocentricity appears to correlate with the number of words that people got correct in the vocabulary test. Also, the number of people who didn’t accept heliocentricity decreased with increasing education. (Yes, that can also be skewed culturally as well but the large-representation major religions embrace education.)

So, and it’s a weird straw to clutch at and I need to dig more, it doesn’t appear that heliocentricity is, in the majority of cases, being rejected because of a strong investment in an antithetical stance, it’s just a lack of education or retention of that information. So, maybe we can put this one down, give more money to science teachers and move on.

But let me get to the meat of my real argument here, which is that a suitably alien or counter-intuitive proposition will be met with hostility, derision and rejection. When things matter, for whatever reason, we take them more seriously. When we take things so seriously that they shape how we live, consciously or not, then there is a problem when those underpinnings are challenged. We can make empty statements like “well, I suppose that works in theory” when the theory forces us to accept that we have been wrong, or at least walking on the less righteous path. When someone says to me “well, that’s fine in theory” I know what they are really saying. I’ve heard it before from Cardinal Bellarmine and it has gained no more weight since then. So it’s hard? Our job is hard. Constantly questioning is hard, tiring and often unrewarding. Yet, without it, we would have achieved very, very little.

People of all colours and races are equal? Unthinkable! Against our established texts! Supported by pseudo-science and biased surveys! They appear to be more similar than we thought! But they can’t marry! Wait, they can! They are equal! How can you think that they’re not?!

How many times do we have to go through this? We are playing out the same argument over and over again: when it matters enough (or too much), we resist to the point where we are being stubborn and (often) foolish.

And, that, I believe is where we stand in the middle of all of these revelations of unconscious and systematic bias against women that I referred to in my last post. People who have considered themselves fair and balanced, objective and ethical, now have to question whether they have been operating in error over all these years – if they accept the research published in PNAS and all of the associated areas. Suddenly, positive discrimination hiring policies become obvious as they now allow the hiring of people who appear to be the same, that the evidence now says have most likely been undervalued. This isn’t disadvantaging a man, this is being fair to the best candidate.

When presented with something challenging I find it helpful to switch the focus or the person involved. Would I be so challenged if it were to someone else? If the new revelation concerned these people or those people? How would I feel about if I read it in the paper? Would it matter if someone I trusted said it to me? Where are my human frailties and how I can account for them?

But, of course, as an educator, I have to think about how to frame my challenging and heretical information so that I don’t cause a spontaneous rejection that will prevent further discussion. I have to provide an atmosphere that exemplifies good practice, a world where people eventually wonder why this part of the world seems to be better, fairer and more reasonable than that part of the world. Then, with any luck, they take their questioning and new thinking to another place and we seed better things.


Let the Denial Begin

It is an awful fact that women are very underrepresented in my discipline, Computer Science, and as an aggregate across my faculty, which includes Engineering and Mathematics (so we’re the Technology, Engineering and Mathematics of STEM). I have heard almost every tired and discredited excuse for why this is the case but what has always angered me is the sheer weight of resistance to any research that (a) clearly demonstrates that bias exists to explain why this occurs, (b) identifies how performance can be manipulated through preconceptions and (c) requires people to consider that we are all more similar than current representation would indicate.

Yes, if I were to look around and say “Women are not going to graduate in large numbers because I see so few of them” then I would be accurate and yet, at the same time, completely missing the point. If I were to turn that around and ask “Why are so few women coming in to my degree?” then I have a useful question and, from various branches of research, the more rocks we turn over, the more we seem to find bias (conscious or otherwise) in both industry and academia that discourages women from participation in STEM.

A paper was recently published in the Proceedings of the National Academy of Sciences of the United States of America (PNAS, to its friends), entitled “Science faculty’s subtle gender biases favor male students”. (PNAS has an open access option but the key graphs and content are also covered in a Scientific American blog article.) The study was simple. Take a job application for  a lab manager position. Assign a name where half of the names are a recognisably male name, the other half are female. (The names John and Jennifer were chosen for this purpose as they had been pre-tested to be equivalent in terms of likability and recogniseability.) Get people to rate the application, including aspects like degree of mentoring offered and salary.

Let me summarise that: the name John or Jennifer is assigned to the same application materials. What we would expect, if there is no bias, is that we would see a similar ranking and equivalent salary offering. (All figures from the original paper, via the SciAm link.)

Oh. It appears that the mere presence of a woman’s name somehow altered reality so that an objective assessment of ability was warped through some sort of … I give up. Humour has escaped me. The name change has resulted in a systematic and significant downgrading of perceived ability. Let me get the next graph out of the way which is the salary offer.

And, equally mysteriously, having the name John is worth over $3,500 more than having the name Jennifer.

I should leap to note that it was both male and female scientists making this classification – which starts to lead us away from outright misogyny and towards ingrained and subtler prejudices. Did people resort to explicitly sexist reasoning to downgrade the candidates? No, they used sound reasoning to argue against the applicant’s competency. Except, of course, we draw back the curtain and suddenly reveal that our sound reasoning works one way when the applicant is a man, another if they are a woman.

Before you think “Oh, they must have targeted a given field, age group or gone after people who do or don’t have tenure”, the field, age and tenure status of the rating professors had no significant effect. This bias is pervasive among faculty, field, age, gender and status. The report also looked at mentoring and, regardless of the rater’s gender, they offered less mentoring to women.

Let’s be blunt. Study after study shows that if there are any gender differences at all, they are so small as to not even vaguely explain what we see in the representation of female students in certain fields and completely fails to explain their reduced progress in later life. However, the bias and stereotypes that people are operating under do not so much predict what will happen as shape what will happen. We are now aware of effects such as Stereotype Threat (Wiki link) that allows us to structure important situations in someone’s life so that the framing of the activity leaves them in a position where they reinforce the negative stereotype because of higher anxiety, relative to a non-stereotyped group. As an example, look at Osborne, Linking Stereotype Threat and Anxiety, where you can actually reduce the performance of girls on a maths test through reminding them that they are girls and that girls tend to do worse on test than boys. Osborne then compared this with a group where the difference was identified but a far more positive statement was made (the participants were told that despite the difference, there were situations where girls performed as well or better). The first scenario (girls do worse) was a high Stereotype Threat scenario (high ST), the second is low ST. Here’s the graph from Wikipedia that is a redrawing of the one in the paper that shows the results.

The effect of Stereotype Threat (ST) on math test scores for girls and boys. Data from Osborne (2007) (via Wikipedia)

That is the impact of an explicit stereotype in action – suddenly, when framed fairly and without an explicit stereotype or implicit bias, we see that people are far more similar than we thought. If anything, we have partially inverted the stereotype.

To return to my first paragraph, I said:

what has always angered me is the sheer weight of resistance to any research that (a) clearly demonstrates that bias exists to explain why this occurs, (b) identifies how performance can be manipulated through preconceptions and (c) requires people to consider that we are all more similar than current representation would indicate.

The PNAS paper, among others, clearly shows that the biasses exist. A simple name change is enough, as long as it’s a woman’s name. The demonstrated existence of stereotype threat shows us how performance can be manipulated through preconception. (And it’s important to note that stereotype threat is as powerful against minorities as woman – anyone who is part of a stereotype can be manipulated through their own increased or reduced anxiety.) So let me finally discuss the consideration of all of this and the title of this post.

I am expecting to get at least one person howling me down. Someone who will tear apart all of this because this cannot, possibly, under any circumstances be true. Someone who will start talking about our “African ancestors” to start arguing the Savanna-distribution of roles, as if our hominid predecessors ever had to apply to be a lab manager anywhere. Most of you, I hope, will read this and know all of this far too well. Some of you will reflect on this and, like me, examine yourself very carefully to find out if you have been using this bias or if you have been framing things, while trying to help, in a way that really didn’t help at all.

Some of you, who are my students, will read this and will see that research that you have done is reflected in these figures. Yes, we treat women differently and we appear, in these circumstances, to treat them less well. This does not, under any circumstances, mean that we have to accept this or, in any way, respect this as an established tradition or a desirable status quo. But the detection of an insidious and pervasive bias, that spans a community, shows us how hard my point (c) actually is.

We must first accept that there is a problem. There is a problem. Denying it will achieve nothing. Arguing minutiae will achieve nothing. We have to change the way that we react and be honest with ourselves that, sometimes, our treasured objectivity is actually nothing of the kind.


Beautiful Corrections

(Sorry about the delay in today’s post. Yesterday afternoon, I took an early minute, and my wife and I went to view Australian Aboriginal art at the Tandanya National Aboriginal Cultural Institute in Adelaide, had a drink in a pub and then had a long and relaxing dinner at a local ethically-sourced Italian restaurant with a wickedly good pizza oven and a great Langhe Nebbiolo. This didn’t leave much time for blogging. Work/life balance-wise, however, it was a winner.)

Yesterday, I referred to an article on New Dorp high school and I wanted to bring out one of the other things that I really liked about their approach to a ‘get the kids writing’ program. As the article says, thinking, reading and speaking are all interconnected and are reinforced through sound instruction in good writing. This immediately leads to the conclusion that teaching people to write is going to lead to improvements across the board and, as a Probationary-plated social constructivist, I immediately think about constructive interaction between students based on great confidence in speaking, fuelled through a greater depth of understanding and ability to express your ideas.

The article discusses this, because classroom discussion became an opportunity for students to listen, think and be more precise in the way that they discussed their ideas. This can be a trap, as most educators know far too well, if students feel that they have to say something rather than that they have to say something that they can defend, explain or shows signs of reflection. (We see this in writing, too. “What I did on my holiday” is a relatively unassailable personal anecdote with no great guarantee of depth or need for defensible statement, yet “What was the most useful thing that you did on your holiday?” requires thought, comparison, reflection and review. To a degree, obviously. I’m not going to start early writers on a detailed comparison of Yves Klein blue and its apparent lifting from Picasso…)

It is very easy to take classroom discussion in the wrong way. You don’t always have to be cheerleadingly positive (warning: not a real adjective), but framing a critique or a question makes a big difference when you want to encourage discussion and build confidence. That’s why I like what I’m reading about in New Dorp (and I’ve seen elsewhere to a lesser degree), in that the students have a poster at the from of the class that lists ways to respond. For example:

  • I agree/disagree with ___ because …
  • I have a different opinion …
  • I have something to add …
  • Can you explain your answer?
  • I agree with ___ but I disagree with your conclusion (because) …

This is a far cry from the passive responses to a tired questioning approach of “Now, hands up if you think that John is correct”. With this framing, students are encouraged to contribute, contest and expand, but using a formal approach to the argument that reduces dependency upon ad homimen or genetic fallacy issues: we have to address what was said rather than the person or the group that it came from. It’s very easy to say “You’re wrong” or “That’s stupid” and it’s an easy answer that completely undermines what the faculty at New Dorp are trying to achieve.

It’s easy to see how this approach is useful in the higher educational sphere, especially once we get into student-based activities, because we can’t always be the facilitators ourselves, so the training of our sessional staff becomes crucial. One challenge for our sessional staff is how to respond to questions without ending up giving the answer away immediately or doing the work for the student. We expend a lot of time on training (Katrina does a great deal of work in this area) and this simple set of guiding questions and framing, as a training device for our staff as well as a template for our students, will allow us to keep the important lessons fresh and in everyone’s mind. We focus a lot on Contributing Student Pedagogy (CSP), a pedagogy that encourages students to contribute to other students’ learning, including valuing other contributions, generally using a high degree of role flexibility (sometimes you lead, sometimes you support and sometimes you organise, for example). We have a paper in the upcoming special issue of Computer Science Education on CSP, where we talk about this at length, but a simple semi-formal structuring of questions to assist people in thinking about how they are about to contribute or evaluate someone else’s contribution is a valuable component of this kind of approach.

To return to what New Dorp is attempting to do, these questions encourage all participants to think about the why and the because and how their contribution will work in with what has already been said. However, and this is non-trivial, having a semi-scripted start to a response also encourages the correct use of language, familiarity with key phrases and the correct use of modifiers and conjunctions. One of the issues identified at New Dorp was that poor writers couldn’t pull a U-turn in a sentence with much success. Although, despite, and words like that were effectively a mystery – sentences had to be artificially short, tightly focussed and lacking in complexity. Such a limitation greatly limits the degree of expressiveness available to the writer. Sentences don’t have to be long, but they have to be long enough. Sentences don’t have to contain long words, but they have to contain the right words. Ideas need to be expressed in a way that makes them easy to understand but this requires practice, practice and even more practice.

The script on the poster at the front is not a rigid proscription. The poster doesn’t say “Explain the use of adjectives in the sentence.” Instead, it provides a hook that a student can hang their own ideas upon, the leading sentence that starts the invasion of text into the bleak white space of a new page. It encourages discussion, support, interaction and the development of thought.

It appears that New Dorp’s approach is working. Students are improving. Students can write. Students can communicate their thoughts to other people successfully. They can use language. What a great improvement!


Bad Writing, Bad Future?

I was recently reading an article on New Dorp public high school on Staten Island. New Dorp had, until recently, a low graduation rate that was among the bottom 2,000 across the United States. (If you’re wondering, there were 98,817 public schools in the US in 2009-10, according to the National Center for Education Statistics, 65,840 being secondary. So New Dorp was in the bottom 2% across all schools and bottom 3% of secondary.) New Dorp’s primary intake is from poor and working-class families and, in 2006, 82% of the freshmen entered the school with a reading level lower than the required grade.

However, it was bad writing that was ultimately identified as the main obstacle to success: students couldn’t turn their thoughts into readable essays. Because this appeared to be the primary difference between successful and unsuccessful students, Deirdre DeAngelis (the principal) and the faculty decided that writing would become a focus. If nothing else, New Dorp’s students would learn to write well.

And, apparently, it has paid off. Pass rates are up, repeating rates have dropped, scores are higher than any previous class. Pre-college enrolments are up but, interestingly, the demographic makeup has remained the same and graduations rates have leapt from 63% to a projected 80% this Spring. (Yes, I know, projected data. I’ll try to check this again after it’s happened.)

The article, which I encourage you to read, goes on to discuss why this change of focus was so important. There was resistance – the usual response of “We’re doing our job, but the students aren’t smart enough (or are too lazy)” from certain groups of educators. Yet, students responded with increased participation and high attendance, rewarding efforts and silencing critics. What was interesting is that analysis of why students couldn’t write indicated that most could decipher the underlying texts and could comprehend sentences but had major deficiencies in the use of key parts of speech. Simple speeches were fine but compound sentences and sentences with dependent clauses were hard to decipher and very difficult to write. How can you use ‘although’ correctly when you don’t know what it means?

As understanding of speech grew, so did reading comprehension. Classroom discussion encouraged students to listen, think and speak more precisely, giving them something to repeat in their writing.

It’s an interesting article and I’m re-reading it at the moment to see exactly what I can extract for my own students and where I have to read to verify and expand upon the ideas. From a personal perspective, however, I think of one of the best reminders of what it is like to be a student who is confused or intimidated by writing.

I go to Hong Kong.

If you’ve been to Hong Kong, you’ll know that there is a vast amount of signage, some in Chinese characters and some in English, but there is really far more Chinese neon and it is all over the landscape. I can read some Chinese (duck, soup, daily yum cha, restaurant, men, exit – you get the gist) and I understand some Chinese so I can get a feeling for some of what is happening. But I have no grasp of any subtlety. I cannot create a sentence or write a character reliably. I am a very good communicator in my own language but in Chinese I sound ridiculous. I scrawl characters that good natured colleagues interpret very generously but it is the scribbling of a child.

In Hong Kong, unless I am speaking English, I appear illiterate. It is easy to say “Well, don’t feel bad, why would you have learned Cantonese in Australia” but let’s remember that when looking at the students of New Dorp. Why would anyone have encouraged them in creative writing, written expression and the development of sophisticated literary argument when a large percentage of their parents have English as a second language, effectively reduced access to schooling and, most likely, a very tight time budget to spend with their children due to overwork and job crowding?

A student who can’t write effectively, if we haven’t actually really tried to teach them how to write, is no more stupid or lazy than I am when I don’t try to learn all of Cantonese before going to Hong Kong. We have both been denied an opportunity. I am lucky in that I can choose when I go to Hong Kong. A student who can’t write has a much harder road because their future will be brighter and better if they can write, as evidenced by the increased success rates at New Dorp.

I look forward to seeing what New Dorp gets up to in the future and I take my hat off to them for this approach.

 


The Future of the Text Book: A Printbook, an eText and a Custom walk into a bar.

Well, it’s still Banned Books Week so I thought I’d follow up on this and talk about text books. I’ve just come from a meeting with a Leading Publishing House (LPH) who, in this fine age of diversification, have made some serious moves into electronic publishing and learning systems. This really doesn’t identify any of the major players because they’re all doing it, we just happen to have a long term relationship with LPH. My students are not the largest purchasers of text books, a fact that LPH’s agent confirmed. While Engineers buy a lot of books, Computer Scientists tend not to buy many and will, maybe, buy one serious text if they think it will be of use to them.

It’s not hard to see why. Many programming language or application books are obsolete within weeks or months, sometimes even before they arrive, and when the books cost upwards of $100 – why buy them when you can download all of the documentation for free? Unlike Humanities, where core texts can remain the same from year to year, or Engineering and Physics, where the principles are effectively established, my discipline’s principles are generally taught by exposure to languages and contextualisation in programming. There are obvious exceptions. Bentley’s Programming Pearls, almost anything by Knuth and certain key texts on algorithms or principles (hello, Dragon Book!) all deal with fundamentals and the things that don’t change from year to year – however, this is not the majority of recommended texts in CS, which tend to head towards programming language guides and manuals. With very few exceptions, any book on a specific programming language has a shelf-life and, if we are updating the course to reflect new content, then we really shouldn’t be surprised if students don’t feel the need to keep buying the new book.

Ah, the Dragon Book.

In other disciplines, the real text book is still being sold extensively and, interestingly, in Australia the eBook is generally sold in a bundle with the real text, even when we know that the student has some form of eBook reader. The model appears to be “work at home from the book and have the eCopy for skimming at Uni”. Both of these forms are still the text book and, if we’re talking about the text book, it appears to be that if students see the need, they’ll buy it. However, the price is becoming more and more important. Is there a widespread model where students can only buy the chapters they need, much as you can buy individual songs from the iTunes Store, and wait until later to see if they want to buy the whole thing? Well, yes, but it’s not widespread in the text book world and, as far as LPH is concerned, it’s not something that they do. Yet.

What is interesting is the growing market in textbook mash-ups. It is now possible to pick a selection of chapters from a range of a publisher’s offerings, add some of your own content, get it checked for copyright issues and then *voila* you have your own custom printed book with only the chapters that you need. All thriller, no filler. Of course, any costs involved in this, especially costly copyright issues, get passed on to the people who buy it. (The students.) This, fairly obviously, restricts the mash-ups to easy to mash materials – books only from one publisher where the IP issues are sorted, open-source images and the like. One problem that surfaces occasionally are people who put their own work in to be included in such a custom run and it turns out that some of the content is not actually original. This can be an oversight and even due to inheritability sometimes. Suppose that Person A created a course from a text, B inherited the course and made some changes based on the course, then continued to change it over the years. It’s a Boat of Theseus problem because the final work is the work of A and B but probably retains enough of the original text source to cause copyright issues when combined back into a new book. Copyright issues can often be overcome but it increases costs and, as stated, that costs the student more.

Given how expensive text books (still) are and that the custom market still operates at a high-ish price point, I’m still waiting for one of the LPHs to take the radical step of providing books at a price point that makes them effectively irresistible. Look at the Orange Penguin reprints, which I do often because I own a million of them, they cost $10 (cheaper in a bundle) and you can pick them up anywhere. Yes, there is an amelioration of the editing costs because these are all reprints of previous versions. Yes, there are no cover arts costs and they are using relatively mainline stock for the printing. But, hang on, isn’t this exactly what we can do in the custom sense, if we stick to jamming together existing chapters? Yet my early researches indicate that there is no large market of custom textbooks that are anywhere near this cost.

I’m going to put up the naïve and relatively ignorant flags here as I’m sure that LPH actuaries have been all over this so, rather than say “Surely…” (and have to kick myself), let me make this a wish.

“I wish that I could assemble a useful book for my students from key chapters of available works and, with low presentation costs, get a book together for under $40 that really nailed the content required for a year level.”  I’d be even happier if that $40 was $20. Or even free. There are some seriously successful free text book initiatives but, as always, there is that spectre of reimbursement for the effort expended by the author. I’m certainly not advocating doing authors out of their entitlements but I am wondering how we can do that and, with minimal overhead, make all of these books as useful and widespread as they need to be. 

There are some books and sets of chapters that I’d love my students to have, while respecting the author’s right to receive their entitlements for the work and setting a fair price. To be honest, it really seems like I’m expecting too much. What do you think?


Six ‘Easy’ Pieces? Richard Feynman and the Undergraduate Lectures

Richard P. Feynman was a Nobel prize winning theoretical physicist, who made great contributions to physics and the popularity of physics through his books and lectures. Among many other useful activities he developed Feynman diagrams, which provided a useful pictorial abstraction of the rather complicated mathematical expressions that govern the behaviour of subatomic particles.

Trust me when I tell you that this is easier to understand than the expressions.

This is a great tool in many ways because it makes the difficult more easy to understand, the abstract able to be represented in a (closer to) concrete manner and, above all, humans like pictures. Feynman was very interested in teaching as well because he felt that students could offer inspiration and because teaching could be a diversion when the well of theoretical physics creativity was running dry.  He was an opponent of rote learning and any approach to teaching that put the form before the function. He loved to explain and felt a strong duty to explain things clearly and correctly, with an emphasis on a key principle that if he couldn’t explain it at the freshman level, then it wasn’t yet understood fully.

In the 60’s Feynman was asked, by Caltech, to reinvigorate the teaching of undergraduates and, three years later, he produced the Feynman Lectures on Physics. I’ve read these before (I used to study Physics – I know, I seem so nice!) and so have many other people – it’s estimated that more than 3 million copies have been sold in various languages. I picked up a copy of the ‘cut-down’ version of the lectures “Six Easy Pieces”, recently re-published in Penguin (AU$ 9.95! Hooray for cheap books!)

Reading the 1989 Special Preface to the original lectures, re-printed in “Six Easy Pieces”, a strange fact emerges, which is that Feynman’s lectures did not necessarily succeed for their target audience, the undergraduates, but instead served to inspire the teachers. As Goodstein and Neugebauer noted, while the class started with 180 undergraduate students, many of the students dreaded the class and, over time, dropped out. While the class remained full, it was because of the increased occupation by faculty and graduate students.

In the original preface, by Feynman, he appears to have noticed that something was amiss because he reflects on the fact that he didn’t think it was a great success. One problem was that there was no feedback from the students to him to tell him how he was doing, whether they were keeping up. (Feynman provided very little outline and all of the homework assignments were created by other professors sitting in the class, furiously noting what had been covered and then creating the other work for recitation.) Feynman’s aim was to challenge and interest the best and brightest, he sought to not only direct the lecture at the smartest in the room  but to present work so that even the most brilliant in the room would be unable to cover it all. Feynman’s preface contains terms such as ‘sufficiently clever’, which may seem fine to some but to me indicate clearly that he, an astoundingly smart and still empathic human being, had at least an inkling that something had gone wrong between his vision and what happened in the classroom.

At the end of the preface, Feynman reflects, in a rather melancholy tone, “I don’t think I did very well by the students”. He is concerned that, based on the way that the the students handled the questions in the examination, that the system is a failure. A colleague points out that maybe 12-24 students appeared to really get it but you don’t have to be a very good mathematician to release that 24/180 (a nudge over 13%) is not the best rate of transfer. As Feynman gloomily responds (quoting Gibbon):

“The power of instruction is seldom of much efficacy except in those happy dispositions where it is almost superfluous”

Feynman finishes, with his characteristic insight, that the direct individual relationship between student and teacher is paramount, where the student discusses things and works with, and discusses, ideas. That it is impossible to learn very much by sitting in a lecture. But he sees himself torn between what he sees as the right way to proceed and the number of students that we have to teach.

And, 49 years later, we, the inheritors of Sisyphus, are still trying to push that same rock up the same educational hill. Richard Feynman, a grand communicator and superlative thinker and scientist, tried his hardest to make the lecture work and even he couldn’t do it. He had mountains of support and he was unhappy with the result. He is clearly articulating all of the ideas for which we now have so much evidence and, yet, here we still are with 1000-person lectures and students who might be able to plug some numbers into formulas but don’t necessarily know what it means to think inside our discipline or discuss ideas in a meaningful dialogue.

From a personal perspective, Feynman’s Lectures on Physics are one the reasons why I gave up physics. I was struggling to see how it all fitted together and I went to seek help. (I was also a terrible student in those days but this was one of the rare occasions when I tried to improve.) One of my lecturers told me that I should read Feynman’s lectures and because it was designed for undergrads, if I couldn’t get that, I wouldn’t be able to catch up – basically, I didn’t have the Physics brain. I read it. I didn’t get it. I sorted the world into “physicists” and “non-physicists”, with me in the second group. (This is probably not a bad outcome for the physics community and, years later, while I can now happily read Feynman, it certainly doesn’t excite me as much as what I’m doing now.) I imagine that Feynman himself, while not lamenting me leaving the field, would probably be at least mildly perturbed at such a weaponisation of his work. From reading about him, his books and prefaces, I believe that he expected a lot of his students but he never actually wanted to be unpleasant about it. His own prefaces record his unease with the course he produced. He has no doubts about the physics and the aim – but his implementation was not what he wanted and not what he believed to be the best approach.

So, when someone questions your educational research supported ideas for improving learning and teaching, grab a copy of “Six Easy Pieces” and get them to read all of the preface material. Feynman himself regarded a lot of areas in educational research as cargo cult science, which applies as well to any poorly constructed scientific experimentation, but it is quite obvious that on at least some of the most important issues regarding knowledge transfer, he had a deep understanding and commitment to improvement, because of his direct experience with undergraduates and his ability to openly criticise himself in order to improve.


Our Obligations: Moral and Legal?

Mark Guzdial raises an interesting point over at a BLOG@CACM article, namely that, if we don’t keep up to to date with contemporary practice in learning and teaching, can be considered unprofessional or even negligent or unethical? If we were surgeons who had not bothered to stay up to date then our patients, and certifying bodies, would be rightly upset. If we are teachers – then what?

The other issue Mark discusses is that of the legal requirement. The US has Title IX, which should extend the same participation rights to all genders for any education program or activity that attracts federal funding. If we do not construct activities that are inclusive (or we design activities that, by their nature, are exclusive) would we be liable under US law?

Mark’s final question is: If we know a better way to teach computing, are we professionally (and even legally) required to use it?

That is a spectacularly good question and, of course, it has no easy answer. Let me extend the idea of the surgeon by building on the doctors’ credo: primum non nocere (first, do no harm). Ultimately, it requires us to consider that all of our actions have outcomes and, in the case of medical intervention, we should be sure that we must always consider the harm that will be caused by this intervention.

Let us consider that there are two approaches that we could take in our pursuit of knowledge of learning and teaching: that of true scholarship of learning and teaching, and that of ignorance of new techniques of learning and teaching. (We’ll leave enthusiasm and ability to the side for the time being.) While this is falsely dichotomous, we can fix this by defining scholarship as starting at ‘knowing that other techniques exist and change might not kill you’, with everything else below that as ‘ignorance of new techniques’.

Now let us consider the impact of both of these bases, in terms of enthusiasm. If someone has any energy at all, then they will be able to apply techniques in the classroom. If they are more energetic then they will apply with more vigour and any effect will be amplified. If these are useful and evidentially supported techniques, then we would expect benefit. If these are folk pedagogies or traditions that have long been discredited then any vigour will be applied to an innately useless or destructive technique. In the case of an inert teacher, neither matters. It is obvious then that the minimum harm is to employ techniques that will reward vigour with sound outcomes: so we must either use validated techniques or explore new techniques that will work.

Now let us look at ability. If a teacher is ‘gifted’ (or profoundly experienced)  then he or she will be more likely to carry the class, pretty much regardless. However, what if a teacher is not so much of a star? Then, in this case, we start to become dependent once again upon the strength of the underlying technique or pedagogy. Otherwise, we risk harming our students by applying bad technique because of insufficient ability to correct it. Again, do no harm requires us to provide techniques that will survive the average or worse-than-average teacher, which requires a consideration of load, development level, reliance upon authority and so on – for student and teacher.

I believe that this argues that, yes, we are professionally bound to confirm our techniques and approaches and, if a better approach is available, evaluate it and adopt it. To do anything else risks doing harm and we cannot do this and remain professional. We are intervening with our students all the time – if we didn’t feel that our approach had worth or would change lives then we wouldn’t be doing it. If intervention and guidance are at our core then we must adopt something like the first, do no harm maxim because it gives us a clear signpost on decisions that could affect a student for life.

One of the greatest problems we face is potentially those people who are highly enthused and deeply undereducated in key areas of modern developments of teaching. As Kurt von Hammerstein-Equord would have said:

One must beware of anyone who is [undereducated] and [very enthusiastic] — [s/he] must not be entrusted with any responsibility because [s/he] will always cause only mischief.

If your best volunteer is also your worst nightmare, how do you resolve this when doing so requires you to say “This is right but you are wrong.” Can you do so without causing enormous problems that may swamp the benefit of doing so?

What about the legal issues? Do we risk heading into the murky world of compliance if we add a legal layer – will an ethical argument be enough?

What do you think about it?


Let Me Eat Some Humble Pie First.

I’m, once again, sitting in an airport lounge and about to fly to Melbourne to discuss a challenging transition project. I have a very strange job in some ways. If you ask me what I am doing today it can vary from ‘teaching’ to ‘research’ (which says everything and nothing) or ‘flying to a meeting to look at something interesting’, because higher education is a damn funny beast in many ways.

Two days ago, however, what I was doing was “making an ass of myself”. Fortunately, the impact of this was that I ended up looking over-reactive and foolish, rather than any real damage, but this is something that I want to share with all of you because I am constantly aware of the aura of competence that we ascribe to the people in our societies who can communicate well. I regularly state (and it’s on my about page) that I expose my thinking processes in order to educate but there is something more than this, in that dissecting my own activities and reactions allows me to learn from myself.

I have read a great deal of literature on trying to bring change to areas that are steeped in tradition and burdened by history and, if you ask me, I can tell you that trying to force people to change won’t work. The best way to enact change is to provide an environment in which change can occur, providing pathways and good examples and by not wasting your time and effort bashing away at the unchanging stone faces of the looming statuary. The problem is, when you believe that you’re doing the right thing, that you get caught up in your own rhetoric. Worse, if you’ve been fighting these battles for years, you build up two highly destructive emotions: frustration, which then can lead to anger.

Two days ago, I let accumulated frustration out and I snapped at someone when, to be honest, I should have basically ignored it or, more positively, interpreted it generously and then guided the discussion towards the more generous interpretation. Instead of doing this, where I could have been positive, I took a negative stance and, boy, did I look like a schmuck when the dust settled.

And rightly so! I was a schmuck! The important thing now is for me to remember that my role is not to assume some level of authoritarian control over everything – I am not the evidence or the work of experts, I am a conduit that can help other people become more educated about these things. I tried to take control of something that not only could I not control but that it was not my job to control. Let’s call this a failure of humility – a hubris issue – and I shall make a delightful pie from it.

That’s “Pahh” for some of you.

The night of the aftermath and yesterday were very, very difficult for me because I had to review where I had gone wrong, how I could have handled it and what it meant for me in terms of ongoing relationships with people. I spent a lot of time in e-mail looking at constructive ways forward, with a lot of discussion and thought, and I believe that all the good avenues of dialog are open and, once again I’m still a schmuck, but no long term damage is done.

In the end, however, I have to apply the same spirit to myself that I apply to my students. I have to determine why I acted as I did (and, ultimately, it was over-protectiveness combined with fatigue). I have to work out how I could have done it better. I have to explain, in detail, to myself how I can change it and put steps in place to make sure that I change it. Then I move forward, with a new perspective and (I hope) a better way of dealing with things.

I am concerned with some of the information that has surfaced during this issue, as I am now worried that I am seriously out of step with some of my colleagues – a lot of what I’m trying to do revolves around how much mental adjustment someone can make and it is now obvious that there are far fewer usable foundations in some areas than I had hoped. This does not mean that I should become strident, shrill and militant because it won’t work. It does mean that I have some rethinking to do, a time to regroup and consider how I can go forward with the same message (educational research is useful, scientific and essential for our future) in a way that works for an even wider range of people.

Yes, if I had a time machine, I’d probably try and go back to not initiate the problems of two days ago. I prefer not to look like a raving idiot. But it’s not the end of the world and, as long as I’m learning from it, it’s a valuable reminder of how much more I have to learn, how much thinking is required to make good change happen and the fact that sometimes we all make mistakes.


The Complex Roles Of Universities In The Period Of Globalization – Altbach – Part 3

To finish this triptych, I’d like to look at Altbach’s assessment of contemporary issues. Private education providers are one of the most obvious recent developments and, with the erosion of the public good motivator, this is no real surprise. It’s less of a surprise when you affix the word “Profit-making” in front of the words ‘education provider’. Given that there is growing demand for education and also given that we are blurring the lines between the institutions, it becomes easy to see why a new market has exploded for people who wish to provide education, or something like it, at a reasonable fee with a possibility of making lots and lots of money. This, however, has an impact on the public sector because it reduces the students who may have come to us for a variety of reasons, especially when the private institutions are targeting the more wealthy in some way. Suddenly, we find ourselves having to justify which kinds of knowledge we are teaching in the public sector because the type of knowledge, and the jobs it leads to, become an issue when you are competing for students inside certain professional areas. Faculties of Arts across the world are very much feeling themselves caught in this pinch. It is hard to imagine many older Universities making such a bald statement such as “There is no need for History or English Scholars”, yet by pumping resources into their professional and technical streams they are saying it through their resource distribution. If something does not provide income or attract the right market, a jaded eye is cast across it and, depending on the wealth and capacity of the institution, this leads to the shutting down of schools or entire faculties.

Why is this such a problem? Because restarting a discipline is much harder once the number of participants drops down too far. Reduce the number of people in a discipline and their shared publications and venues also shrink. Given that publication is vital to perceived success in many ways, this shrinkage will make it harder to publish OR lead to accusations of irrelevance as the overall citation level drops because there are so few people in the area. We are so heavily measured and assessed, as individuals and as universities, that we are beleaguered by league tables and beset by set publication standards. Our management structures, modes of accountability, the way that we have worked and thought for centuries are not a good fit for this new modality. This is not the golden age ramblings that I have previously pointed to as dreaming of better days – in this case, it’s true. Our systems don’t work with the new expectations.

Opening ourselves up to students from anywhere is a noble goal, and one I support wholeheartedly, but it brings great challenge. Can we pursue anything that interests us, relevant or not, and expect to meet the demands of the new century? If we can, I don’t think we can do it with the systems that we have and certainly not while we’re being measured on externally applied metrics of success. Even deciding on whether a student should be admitted or not is now a matter of school ranking, bonus points, place availability, status and, in murkier waters, the two speed entry system of public and privately-funded places in the same institution, where admitting one party may (in the worst case) prevent another from entering. As Altbach notes, our ideas of governance are changing as our scale grows and our complexity increases. Senior Professors used to set our course but now we either need or have taken on trained administrators who do not think as we do, have not had our training and, in many ways, treat us as a standard business with a strange product. We are more accountable than ever, while we wander around being randomly measured and trying to work out what it is that we need to do in order to be measured accurately and then try and perform our tasks of learning, teaching and research. How do we reconcile the community of scholars with the bureaucracies that run our institutions?

Altbach then moves on to discuss developing countries and the special challenges that they face. Many of these countries have broken links to their indigenous cultures, due to colonisation, occupation, war and civil unrest, and, when combined with the colonial trend to keep investment in higher education low, this means that many of these countries are systematically disadvantaged. Their systems are so small that expansion is hard – insufficient training grounds for new educators, delay in building and resource appropriation and the threat of instability combine to make it very hard to kickstart anything. Poverty and lack of local government resources move some of these attempts across to the ‘impossible’ category. As it becomes hard to limit enrolments, overcrowding is the norm and, while you can’t limit enrolment, you can use draconian measures to ensure that anyone who falls behind is ejected, in the hope that freeing up that slot might ease some of the crush on the resources. This is a very unforgiving approach to education: you have one chance, you blew it, goodbye. Given that this is one of the only paths out of poverty in many of these countries, and that it is very easy to fall behind in a poor and resource-starved system, this is a nasty little feedback loop. Where other institutions are built up in response to demand, these newer academies tend not to offer the same level of education and we once again have the problem of a piece of paper that is not as worthy as another: we are providing education in name only and creating yet another two-speed system. Where the job market and the educational bodies don’t keep up with each other you may have that most awful ghetto: the educated unemployed, who have invested time and money into a degree that grants them no advantage at all.

Where we are over-stretched, we tend to only do those things that generate the most benefit and this is also true in the case of these third world Universities. Teaching earns money so teaching dominates. Research is sidelined, international collaboration is sidelined and staff have no time to do anything except teach because they are trying to keep their salary coming. Unsurprisingly, this is not a stage set of excellence and advancement – these universities are falling further and further behind.

Altbach concludes by talking about the pressure that we are all under and that have made the majority of our institutions reactive, limiting our creativity to solving pressing problems in a response to external pressures. Right now, we are running so fast that we do not have time to question why we are even on this treadmill, let alone take any real steps to make serious change that is truly strategic rather than reactive. We have lost our autonomy to a degree, as well as our identity. We are enmeshed in society but in a role that favours the market forces and makes us dance in response to it. Altbach ponders what our role should be and proposes a move towards the broader public interest, moving away from market forces and towards academic autonomy.This is not the selfish “leave me alone” cry of a spoiled child, this is a recognition of the fact that we have many more things to offer than a diploma and a vocation: universities are societies of thinkers and are far more complex and diverse than our current strictures would make us appear. All universities are important, says Altbach, and it is at society’s peril that it ignores the many roles that a University can provide. Looking at us as profit-making, degree factories, or as an elite streaming system, ignores the grand public benefit of an educated society, the value of the public intellectual and the scholarly community. We deserve support, says Altbach, because serve the goals of society and the individual. Let us do our jobs properly.

I found it to be a very interesting article to read and I hope I’ve capture the essence reasonably well. I look forward to discussing it! Thanks again, RV!