The joy of X (kcd)

xkcd is a fantastic webcomic written and illustrated by a very interesting guy called Randall Munroe. As he puts it, it’s a “webcomic of romance, sarcasm, math, and language.” (Note the Oxford comma!) The comics are out every Monday, Wednesday and Friday and cover a wide range of topics.

From a teacher’s point of view, they can be quite abstract and cover adult content, but the sheer breadth and delight of the comics are amazing. Take the one that is currently on the site “Game AIs”:

If you can’t find a way to integrate this diagram into a discussion on complexity, computer science, programming, artificial intelligence or games – you may not be trying hard enough. And xkcd is full of this kind of stuff. Giant scale diagrams from the smallest particles to the Universe. Ways of thinking about different amounts of radiation.

Beautiful little stories about flying ferrets who save people lost at sea.

You may have to be a little cautious on occasion, because some of it is quite adult, but choosing some images from this site for teaching, which Randall allows under most circumstances, can bring a lesson to life. If you haven’t seen it before, grab a comfortable chair, sit down and have a good read. There’s something here for most people who teach in or anywhere near the sciences.


Do you have your teaching buddy?

How are you developing and maintaining your learning and teaching support network? Do you have one, formally or informally? Thinking about it right now, can you name at least one person you can turn to, to bounce ideas off, to proof-read things, to discuss research with?

If not, then you need one! With a support network of even one person you’ve got someone else to talk to, to sanity check you, to help you laugh when things aren’t funny and to balance you if you’re going off-kilter.

It doesn’t need to be someone in your own discipline, although that can help, but it does need to be someone who understands what it is like to be an educator. There’s a lot of gallows humour, of joking about the things that are making us despair, and sometimes other people, especially partners, don’t get how we can complain about something so much and still love it so much. That’s where your teaching buddy comes in. With any luck you have more than one, you have a network of these people. These are not just the people whose blogs you read or whose books you have, these are people you can message or mail to ask a question or grab a coffee with or just sit down and have a long “GRAAAAA” chat with – without losing your job.

Sometimes teaching feels like an us-and-them kind of job. Us is always us, but them can be our students, or our administrators, or our bosses. You don’t want to gang up on any of these people but, at the same time, you don’t want to find yourself crawling the walls. Apart from anything else, working on cool projects is always more fun with a friend to help out, to throw ideas around with and to just sit down and talk to.

Do you have a network? Do you know someone who doesn’t? Can you reach out to try and help?

Are you working alone? Is there someone you could ask, anywhere? Have a look around, there are lots of professional networks – conferences and workshops are a great place to meet like-minded people. It’s ok, we’re not talking about marrying these people, you can even, if you’re so inclined, look at it as a very casual speed-dating set-up if you’re nervous. But you’ll be amazed how many people out there are ready to talk, want to talk and, working together, we can probably all achieve that little bit more.

 

 

 


“That” student.

If there’s one piece of advice I would give to anyone starting college, it would be “Don’t be that student”. Despite what many students think, while we pretty much know who you are, depending on class size, we don’t have the time we’d like to be able to track every student in detail. The students we see the most, deal with the most, and talk about the most tend to fall into two categories: the very high-achievers and that student. The high-achievers come to make sure that they’ve dotted all the i’s, that their question on a possible interpretation of something on slide 3 has the answer that they think it does and to talk about honours or PhDs or job references or things like that. When we talk about those students, the high-achievers, it’s generally because they’re moving on, doing interesting things.

The rest of the class? We’ll see them periodically, in lectures, on the forums, around. Even those who are struggling, who we see more, we probably won’t see as often (although we’re probably trying to). We’ll try to learn names, get an idea of who you are, but we’ll probably never see you enough to get much depth.

But that student? That student we deal with a lot. We generally don’t gossip but, sometimes, if someone is expressing exasperation with a student, or can’t get their head around why one of their students is doing something odd, we might, from time to time, lean across and say “Student X?” “Yup, that student.”

Let me be frank. If you’re trying, but you’re struggling, but you stay in touch and do your own work and you come to appointments? You’re not that student. If you don’t show up to class or do any of the work and fail silently, despite all of the e-mail asking you to get in touch? You’re not that student. People who know that they are struggling and are striving to fix it are my bread-and-butter and I’ll try to get you back. People who don’t show up at all and don’t respond? You’re only wasting your own time. It’s a shame (and I’ll keep trying to get to you) but you’ve made a decision, of sorts.

So who is that student? If you:

  • never hand anything in on time, even with extensions, and you have no real reason and you can’t even be bothered to think of one;
  • stick your hand up in lectures frequently, which is good, but only ask irrelevant questions, frustrate your classmates and then, a week later, do the same thing again without a hint of introspection – you’re not dumb but you can’t be bothered listening;
  • show up without having done any of the pre-reading or any of the previous assessment and then complain that you don’t know what we’re talking about;
  • can’t see why your group would care that you only started your section of the group assignment 12 hours before deadline;
  • make an incredibly urgent appointment one afternoon for early the next morning and then don’t show up because you forgot – or just because;
  • can’t understand what’s wrong with the previous entries on this list…

then you might be that student. Sadly, until you actually decide that you want to be in the course, and you devote the effort, and you work out what you have to do in order to pass, then there’s not much that I may be able to do for you. Why are you showing up if you’re not doing anything? I can try and help you to work out how to get ahead but, until you accept that you’re going to need to allocate more time and yourself to this course, there’s not a great deal I can do.

And every lecturer you run across, who doesn’t know you, is going to try and help you as well, because that’s our job. But, you, if you’re that student, you’re making yourself nigh-on impossible to help.

Some come good. That’s always a huge blast when someone genuinely sorts themselves out, gets their courses done and graduates. We’re genuinely happy for your achievement – not because we’ve got rid of you (seriously!) A lot, however, get kicked out after they’ve under performed for too long and that is such a huge waste of potential and time. And that, most of the time, is what happens to that student.

We offer a lot of opportunities for redemption and, honestly, it makes me really sad when someone stays on the path that will ultimately lead to them being kicked out. Half the reason we can even identify that student is because so many people will try and bring them back, get them on the righteous path and bring them up into the general body. Hey, if you can get that student into over-achieving, you’ll really have achieved something good!

Not everyone has to, wants to or needs to go to tertiary study. But if you’re going to do it, why not give it a good shot? I sincerely hope that there is enough good teaching around for everyone to be able to make the best of their shot. (Sometimes that’s not true but I can always hope that we’re all trying to make our teaching better.)

Like always, all joking aside, we have to focus on imparting knowledge (teaching) but that requires that our student be ready to receive knowledge (learning). Seriously, no-one really wants to be that student.


The Zeroth Law of Teaching: “No Negativity?”

I was at a conference recently and I was chatting with the PhD students at their poster session. One of them summarised his life philosophy as ‘no negativity’. I looked at him to see if he was joking and then replied “So, positivity, then?” The student’s eyes lit up as he thought about what I’d said, and his own comment, laughed and agreed.

When I first told this story on one of my other blogs, a number of people responded by saying “Oh, but he could have meant ‘at least neutrality'” and, while I didn’t argue it there, ultimately this was missing both the point of my critique and the student’s response. The first thing I considered when responding to the student was that he was obviously looking for something short, sharp and shiny to contain his world view. The second thing I considered was that I didn’t want to be negative, so my comment had to be chosen carefully. The third was based on my assessment of the student.

The student was a very positive, enthusiastic and creative person. When he said ‘no negativity’, he fairly obviously meant ‘positive, creative energy!’ He wanted a short way to express this but, as we are all prone to do, he focused on the antithesis and then negated it. Now, of course, by doing this he created an automatic contradiction in his own maxim. That’s why I checked to see if he was joking first because, as an ironic statement, it’s wonderful. My belief, based on initial reaction and his reaction to my comment, was that he hadn’t consciously realised that he was rejecting negativity with a negative. Now he has the choice to either be deliberately ironic or to be succinct and clear.

English is a funny beast. If I say “I don’t disagree with you”, it doesn’t always mean that I agree with you, double negatives or not. It’s also confusing for people with English as a second language because it appears very similar to “I’m not disagreeing with you”, when the two have different uses and, depending on your cultural background, very different interpretations. I choose my language, my idioms and my examples very carefully to make sure that I pitch myself to the current audience. This means that my classes in Singapore are run and presented slightly differently from my classes in Australia. Same knowledge. Same standards. Different presentation to maximise my efforts.

If you don’t know your audience, then your humour, your use of language subtleties and, especially, the use of sarcasm and irony can be missed completely and people won’t know if you are being exceedingly clever or if you’ve missed the point. If a student misses a subtlety, then do you think that they’ll always stick a hand up to check? Are they going to learn something incorrectly or miss a key step?

That, for me, is the Zeroth law of teaching: “Know your audience.” If you pitch yourself at the right level, to the right group, at the right time, you will be far more likely to pass on the knowledge in the most effective and useful way possible.


Being a better teacher: 5 things not to do.

Yes, the Zeroth law of teaching should be “Don’t be negative” but that’s another post (as well as a comedy routine). Here are five things that I’ve stopped doing and my students seem to appreciate it.

  1. Confusing attendance with participation.
    Everything that I do with students should give them the opportunity to participate and engage – if I want them just to be exposed to knowledge I can give them readings outside of class and then use my presence and teaching skills to reinforce that in contact time. Taking a roll that demonstrates that they were physically present while I read the text book at them achieves very little. It’s the same for any other activity: a tick represents that they did something, not just that they were there.
  2. Bluffing.
    When I started out, there was always the temptation to have to appear all-knowledgeable at all times. Much as, in the PhD process, I finally learned that knowing a lot about an area also meant knowing what you didn’t know, sometimes teaching is about accepting that you’re wrong, or you weren’t clear, or that you need to take another approach. I didn’t try to bluff my students often, but I did it once or twice and it was dumb. Better to admit your mistakes and fix them than try and bluff. Your students will lose respect for you – and you’ll lose respect for yourself.
  3. Recycling Tired Material
    Some material should get carried forward into new courses because the fundamentals stay the same. However, where possible, every course should be reviewed and refreshed. If you are going to re-use something, update any time or context sensitive references. Putting up a piece on Steve Jobs the week after his death is timely. Three years down the track, unless it’s part of a very specific series of other material, it looks like you’re lazy. In particular, if you inherit slides or material from someone else, check it. Make it yours. Much as you will probably never win the 100m dash in borrowed shoes, you will probably never excel at teaching in someone else’s material and students can and do feel the difference.
  4. Overstating my authority
    “Because I said so”, however you state it, is the argument of last resort of a tired parent, it’s not going to achieve very much at all when you’re attempting to form high-reasoning, professionally competent people. Lecturers usually have very good reasons for almost everything that they do, whether shaped by good practice, current and past research or University policy, but it sometimes takes a lot of time to explain the reasons for something. That means, on occasion, when tired, or in a hurry, or because this is the 30th person this week to ask why they can’t just hand something up late, the temptation to appeal to your own authority can be tempting. Initially, when I first started teaching, my problem was that I expected all of my students to have read every single line of the policies so, when they questioned them, I assumed that I was being challenged. Stepping back, educating people to look at all of the relevant detail in pedagogical and professional terms is just part of my job. We now have course profiles that clearly describe everything a student needs to know. When questioned on things that are supported by course, school, faculty and University practice and policy, I depersonalise what is (most usually) not a personal attack at all and say “Look at the course profile. It will clearly explain everything” and refer all of my discussions to that.
    I am most definitely not saying that we have no authority in our teaching, or that we should abdicate our responsibility, but I am saying “know the limits” and use it when necessary and appropriate.
  5. Expecting students to be me
    What have I done? I have a Bachelors, a Masters and a PhD in Computer Science. I have a Grad Dip in Oenology (that’s wine science). I was a Captain in Royal Australian Armoured Corps. I run marathons up and down mountains for fun. Does this tell you what kind of student I am now? Maybe. You’d expect me to be driven, self-reliant and self-motivated. You’d be pretty right. Does it tell you what kind of student I was when I started? Not at all. My first degree took longer than it should because I was a terrible student, with no self-discipline or understanding of what I was doing or why I was doing it.
    When I first started teaching, I made the mistake of thinking that because I could get to where I got, every student in my class had that potential and that the way to realise that potential was the way that I did it. In hindsight, this is laughably stupid because my pathway was based on having an excellent secondary education, which I could draw on once I decided to become a good student, having a good support system, not running out of money, living in a safe city, being part of an un-repressed group (white Australian male) and having a lot of good luck, including meeting my wife, who is the cornerstone of all of my success. Due to Australian polygamy laws, not everyone will be able to marry my wife, so this approach is obviously not generalisable.
    More seriously,  my students have a wide variety of life and educational experiences before they come to me. What affects the way that they learn, participate and grow will vary from student to student. While every student has the potential to pass, assuming we have set up our entrance criteria correctly, it is up to me to be aware of the wide variety of student when I’m teaching and try to hold that delicate balance that meets most people’s needs most of the time.

Learning from mistakes and improving for the future is one of the most important skills my students learn – it makes sense that I value it as well and I practise what I try to teach them.


Five things that made my first-year programming course better.

We’re always looking for ways to make our teaching better – more effective, more engaging and the kind of class that students fight to be in. I recently got the chance to write a new first-year course from scratch and, based on my previous experience, there were five things I did that, from early results, appear to have made a positive difference. Caveats: As always, there’s always the risk that any change will bring about an improvement or that this is cohort variation or many other factors. I’m basing this list on the intersection of things that I did and the things that my students thought made a difference.

  1. Modern, appealing design of all course materials. The course materials had the same look and feel, based on a modern design template that used simple typefaces (Helvetica Neue and Courier New) with a straightforward colour scheme. When the lecture approach changed, as we’ll discuss shortly, there were strong cues in the material to indicate that we were in a different mode. My students are surrounded by good design all day, every day: advertising, games, magazines, TV, films, … If the most boring, listless and dull thing they see all day is my visual aids, there will be an association.
  2. Lectures had two sections of content, one more lecture-y, one more tutorial, with a five minute break in the middle where we discussed topics of interest from outside the classroom. Every lecture hour contained coursework material, the chance t practice it and the opportunity to see how it all fitted into a bigger picture. Students were very positive in their support of the five-minute ‘distraction’ and it also provided an excellent transition point from ‘lecturing with participation’ to ‘student-focused peer-level activity with lecturer overview’.
  3. Giving the students their own ‘interesting things’ space on the electronic forums. We had standard information fora, student questions and a couple of others where students could just chat about things. Participation in the ‘offside’ forums was optional although all students were enrolled at the start. It is some 3 months since the last class and there is still occasional traffic on the interesting things fora. It kept the main lines of communication clear but allowed, in much the same way as the five-minute diversion, space for expansion and thought.
  4. We increased the difficulty of the practical work, once we had confirmed basic skills and provided practice in the skills required to approach the harder programming work. After several weeks of small ‘1 week’ scale C++ programming exercises, we dropped a deliberately loosely-spec’d problem onto the students that required them to carry out a proper design, plan their testing and write their code efficiently, over a two week timeframe. Before this we had rewarded design with a few marks and also had the in-class demonstrators discuss and encourage testing, as well as presenting it in lectures. Student feedback on this prac was very positive – challenging but highly rewarding. The code standard of the class jumped up after this. Also, students who had wondered why had been preaching design for such ‘simple’ problems indicated that they now understood that they had been practising design as a process, at the same time that they were practising coding. This startled some of them because we had apparently been thinking hard about the design of the course itself. (Which we had, but it’s nice when people realise it.)
  5. We encouraged and rewarded student reflection on process with cold, hard marks. Student were required to provide a written reflection on their software development process at two stages, just after the hard prac and at the end of the course. Both times, most marks were awarded for clarity of communication and addressing key points, rather than any definition of a ‘right answer’. As a result, the final reflections were written at a very high level, showing a clear understanding of the requirement for design and testing, as well as having almost no syntax or grammar errors and, for the most parts, clearly showing evidence of thought and editing.

The class in question did very well but, regrettably, they should have anyway because they were all self-selected high achievers in a small class. There is no quantitative strength in a numerical discussion here (I have measurement elements in place but there is no significance in the results, yet). The qualitative approach is far more interesting, because the student feedback clearly shows participating, engaged and self-aware students who can communicate verbally and in writing. The hardest prac in the course was the most popular, because of the challenge, but it was an achievable challenge. We set the bar higher, the students climbed higher. Most, if not all of them, now realise the reason that we talk about design and testing so much, and how you can use one or both to reduce your development time by reducing your bug load in later phases. That’s not bad at all for the end of their first 12 months and only their second computing course after a rapid-fire grounding in OOP in C++ in a previous semester.

I look forward to running this course again next year with 130 students from a broad range. Let’s see what happens.


The Pipeline and How to Swing it

Getting everything done would be easy if we had very little to do or unlimited time in which to do it. Sadly, by the time you stack up what your students need you to be, your school or faculty needs you to do, the parts of you required for your colleagues and your family, it gets hard to get things done. That’s where good pipeline management gives you a bit of help in encouraging you to prioritise in a way that lets you maximise your use of your own time.

Some things cannot be handled in advance. You can’t mark an assignment until the students have returned it, you can’t publish the exam results until all of the marking and any adjustments have been taken into account. Some things have to be dealt with by you being there and dealing with the events as they happen. To be good at learning and teaching requires a lot of your time, there’s no disputing it, but trying to do it all at the same time will crush you. Some of things that we need to do can be reorganised in terms of their importance, amount of preparation time and deadline, and this is where your pipeline comes from. If you currently have a to-do list, but you don’t do any real longer-term forecasting, then this post is probably for you.

If you’re not good at breaking things into manageable tasks, like me, then go and grab one of the many good books that can help you. I have had a lot of great use of a book called “Getting Things Done” by David Allen. You may want to start by looking at a website called 43 Folders. If that appeals then you might want to replace your existing paper to-do list (or e-mail notes, or sticky notes) with some task management software. I use OmniFocus on iPad and Mac for task tracking and Merlin for project management. Whatever you use isn’t important but what you need to be able to do is to work out:

  1. What you want to do
  2. How it breaks into components (and you should know the order of these) – you must be able to identify the FIRST STEP. This will lead to the second.
  3. When it is due (set this wherever you need to in order to finish on time)
  4. How long each component will take
  5. Who else is involved
  6. What other resources you have

Then, armed with a list of all of the projects that you have to achieve, and a list of the first steps in each one, you can work out which has to be be tackled first. Something not due for a month? How long will it take? A month? Start now! A week? Get it to pop up in two weeks time. Maybe you can handle it early and go on to something else.

A to-do list is a great start but it’s only as good as the bigger list of projects that feeds it new to-do items. A good to-do item can be achieved in 15 minutes, maybe an hour. Why so short? Because then you can tick it off and move on to the next task. If you spend a day working and you tick nothing off your list, how much will you feel like you’ve achieved? If your to-do items, for writing an exam say, were “review last year’s exams”,”copy LaTeX template to repository and check security and backups”,”Write question 1 on underwater knitting” you can look at your work at the end of the day and, if you’ve got to Question 2, you can tick off three things. Doing things this way also gives you some checkpointing and rollback if you get interrupted, or distracted, or come down with a cold. Short tasks are also easier to interleave and it may help if you set up your pipeline so that short high-reward jobs get bumped up the queue occasionally to give you some needed endorphins for the longer haul projects such as grant writing or course re-design.

I wrote a 36 lecture course late last year and the pleasure in ticking off 36 individual ‘complete lecture x’ items was much greater than waiting two months to tick off ‘write lectures’. Apart from anything else, a good, concise task description will remind you what you were thinking and get you back into work more quickly – your ability to context switch will improve.

How you refill your list is up to you but, given how busy we all are now, it’s better to have the list showing you what you’ve achieved but listing what you could do next than to let you think that there’s nothing you have to do. If you want to take a breather, schedule it into your calendar or your list and stick to it. Got 15 minutes paper review time? Print the paper, leave your office, sit down somewhere else and read, if you can. One very good suggestion is that you take a break every hour to rest your aching back, get your eyes away from the computer and refresh. That’s harder sometimes than others but always be open to taking a brief , refreshing pause that will let you finish your work, get home, enjoy dinner and sleep.

And, if you actually know all of your deadlines, and what has to happen and when, you will worry less about what you’re missing and, with any luck, the sleep you have will be deeper and better. Sometimes, yes, it’s going to be a mad rush to completion but doing that all the time will burn you out. Use some of the excellent references and technology to do what you have to do and what you want to do in a timeframe that makes everyone happy and keeps you sane.

Happy pipelining!


SWEDE: Scale Will Eventually Demolish Everyone

Yes, I like acronyms – a good acronym is memorable, meaningful and it makes you think. I wanted to explain why measurement was so important in the previous post but I neglected to tell you why I thought that we had to consider changing our learning and teaching approaches in the first place. So here’s my next higher ed teaching maxim – Scale Will Eventually Demolish Everyone. Even if we don’t change what we do, we have to be aware of why change should be considered and I want to give you a reason that doesn’t require you to have a fervent commitment to the nature of assessment or new technology. I’ll appeal to your existing knowledge – that you’re already too busy and things are getting busier.

Why do we even have to think about change? The first reason is that things change. New technologies become available, student expectations change, materials change – things change. The second reason is that we now have a lot of students in tertiary education and, if your government is anything like mine, the goal is to increase that number. We may not necessarily have more students in a given classroom, although that is a likely outcome, but we may certainly be teaching more students. We are already teaching a very large number of students and we are a long way from sitting around the agora in small groups, listening to someone who, through Socratic technique, will take three to four years to guide us towards mature and complete knowledge. Some techniques just don’t scale and we have to recognise this, while still providing as many, if not all, the benefits of our knowledge to our students, regardless of how many are in our classes.

I have taught classes as small as 7 and as large as 360, I know that some of you handle much larger and you have my deepest sympathies, and I cannot apply the same techniques in both and expect the same results, unless I work out how to handle the scale. An individual only has 168 hours in each week, fewer if they have the audacity to sleep or eat. Even if we were devoted beyond belief, lecturing, assessment and marking load will eventually reach a point where we cannot handle any more. Reduce this 168 to a (marginally) manageable 70-80 hours to allow for sleep and some outside activities and we can handle half the students. But I still need to pass my knowledge on, encourage them, give them feedback, provide assignment work and examinations, mark everything, give it back in a timely fashion and be what I am supposed to be, doing what I’m supposed to do.

Sometimes we handle scale through the use of other people – TAs, marking teams – and this certainly works. But it’s usually not the same as us, the lecturer, being there, unless you’re very lucky in the way that your teams are made up. There should be a reason that we’re there, that the students want to come and listen to us, to discuss the knowledge with us, to learn from us and while there is certainly a place for other people, including using students themselves, we have to think about how we are going to do it properly and in a way that scales to the right level while providing everything that the students need. This places an obligation on us to provide quality control for external marking, to provide strong guidance and rubrics for markers, for learning how to control the class when it moves in and out of ‘nearest neighbour answer checking’, to think about all of the techniques that could be used to increase the quality of our teaching while recognising the pragmatic limitations imposed upon us by the tyranny of scale. Among many, many other things.

We can handle scale if we make sensible use of existing techniques, actively search out new ones (whether philosophical, pedagogical or electronic), assess how we are meeting (or not meeting) our goals and we are clear about what our teaching goals actually are. Frankly, you’re probably already too busy – too many of you are reading this on your phone as you sit on the bus or while you chew your dinner. You don’t need to make things harder for yourself when new approaches come along that can allow you to do the same, if not better job, with less effort. If we don’t choose to handle scale and balance this with our requirements to provide teaching, then eventually we risk reaching a point where we won’t be able to provide any teaching at all – because our time to do everything will blow out so far that even if we are phoning it in, we just won’t get the marks processed in time, or assignments back.

Despite me talking about quality control and our requirements, protecting ourselves from the expenditure of unnecessary effort is the only sensible way to approach a time-consuming, difficult but very enjoyable job. We want to use our individual effort in a way that maximises our results – this is where measurement, process awareness and honesty comes back in, reinforcing my previous post. This is where being open to change, to assessing what you need, to finding new techniques and from doing it properly comes in. Because we have to.

Because, ultimately, SWEDE – Scale Will Eventually Demolish Everyone.


MIKE: Measurement Is the Key to Everything

One of the problems in convincing other people to try alternative learning and teaching approaches is that, basically, everyone is as busy as you are. While you might not accept that, you might be the busiest person in the Universe, then perhaps you can accept that everyone thinks that they are as busy as you are. In a world where academics struggle to fit in research, administration, teaching, marking, personal development, grant applications – oh, and their real lives – it’s not surprising that a lot of first reactions to ‘have you tried something new’ is ‘do you know how busy I am?’

We have a big advantage in ICT in that most people are very open to the scientific method of measurement, analysis and evaluation (potted version). So why is it that when someone says “Have you tried this” and you ask something in return like “Well, no, but how long will it take and what will be the benefits?” you’ll be lucky to get an answer to the first half of that compound statement, let alone the benefits. “Your students will be happier” is very hard to quantify – but “we reduced our drop-out rate by 30%” is a cold hard fact. (Well, it purports to be. If someone has done their due diligence, it’s a fact.)

There is, of course, a problem. In order to be able to assess the impact of what we’re doing, we have to establish the baseline (how things were before we started), apply our changes, measure the outcomes and then try and determine if what we did had anything to do with the perceived change or whether it was all random noise. This is not helped by the fact that a lot of classes are small, smaller than we need for statistical validity, or that we can’t easily establish cohorts of the right size or consistency. But, being honest, the first problem for many people is that they do not even think of measuring the impact of what they’ve done until after they’ve done it.

So here’s the first of my three slogans.

MIKE: Measurement Is the Key to Everything.

Looking at that model that I keep discussing, I have three separate places to “lose” knowledge in its flow to my students (to reduce the efficacy of flow). The first is in the teaching process itself. If I don’t have the knowledge, I can’t pass it on. If I choose not to share the knowledge, I can’t pass it on. Next, the medium of exchange (that disconnected external transfer from teacher to learner) will make a difference. If I write everything I know in a book and give it to my class, tell them that the final exam is in two months and walk off – I’m in a high-loss environment. So the medium can and does make a difference but it can only facilitate knowledge transfer by minimising the loss or maximising availability of learners to knowledge. It can’t add knowledge. Finally, what the learners themselves do will have a big impact on how the knowledge is processed and assimilated. That’s why, even without curve grading, those Bell curves seem to show up so frequently – in a similar teaching environment, with the same lecturer, individual students still have some variation. We can, of course, vary the peak of the curve but we would expect to see some variation in an otherwise identical environment. A lot of this has to do with the environment that students had before they reached us, which is interesting if only for the fact that this medium of knowledge transfer may now appear to have both memory and temporal aspects – perhaps our dealing with this previous environment, or accepting that such differences exist, in the construction of our transfer medium is as important as the knowledge that we bring to the situation.

Now I can quantify the effort that I put in to my teaching activities, if I’m honest with myself and count time spent actively creating new approaches or materials – and discounting those times I spend in the tea room pontificating about things I never apply. (I don’t think that such sessions have no value, but I hesitate to count them in a genuine measurement of producing new teaching materials unless I am actively mentoring or I run off and do something with that. Even then, I discount the time for each coffee I had. 🙂 ) If I have assessed the student quality or class metric that I want to change, and I have established a baseline on the cohort (somehow), I can come up with an measurement of time spent, or difficulty level to surmount, to implement my new approach and I can then present the effort, and the outcome, along with the environment in order to show other people what I did and how they could do the same thing.

I recently made some changes to a new first year course and I was fortunate in that I achieved a much higher pass rate than usual for the effort that I expended, with excellent process awareness of how to correctly design and finish programming projects on time. Hooray, you might think. Aha – I had only 21 students (it was the first offering and the pipeline was barely filled) and these students had, in the main, correctly self-selected as having programming experience before coming to University. Yes, we had a good result, excellent engagement, and high participation and we achieved it with the standard load model for writing a new course but our environment was not the standard one. Next semester, when I have 130 students from across the range of the intake, I will have an environment where, when I measure how many hours I spent on each activity, I will have much more applicable environment to realistic teaching situations in other Australian Universities.

I’ll be able to assess each student’s early indications of prowess, from their marks in other courses, and compare them to what is achieved in this new course. I can then start to make statements indicating what the benefits of the approach are. But, to do that, I have to think measurement from the moment I start working on the course, keep track of my time, note where I make changes, look for which factors are being affected and, finally, be honest if I can see trends but not significance, an indication of a Bayesian model but not a confirmation. I have to think about quantitative and qualitative assessment mechanisms – I may have to get surveys pre-approved or start designing custom assessment forms. I have to think about how I am going to be able to assess the worth of what I’ve done in the ground-up design of this course weeks before Week 1 – not only for my own benefit, but for communication with others and for possible papers or presentations.

Ultimately, I can give you a warm feeling and tell you that ‘students will love this’ or I can show you the well-written, thoughtful and mature advice on process improvement for timely completion of software projects, well proof-read and easy to read, that I received from the vast majority of the students that I had in my course – after they’d been in the system for less than 12 months. And I could tell you how much effort that took, and the caveats of the environment, and then, with all of those caveats, you might think about how you could do a similar thing in order to achieve a similar result. Or to see if I’m barking mad. That is, after all, what we expect our students to do: assemble evidence, weigh and analyse, complete the evaluation and come to a conclusion. Then act.

Measurement: it really Is the Key to Everything.


Examining my L & T diagram

I was discussing yesterday’s blog post and a couple of questions came up, which prompted me to re-evaluate the simple diagram and look for a cleaner form. Among those questions:

  1. Are learning and teaching such distinctly separate activities? What about what we learn while we’re teaching?
  2. Is it just very good students who rise to the teaching level amongst their peers?

The sketchy model in the previous post is based on the flow of knowledge. (I note that I’ve been relaxed in my use of the terms information and knowledge semi-interchangably. That’s something for another post but, very briefly, I support the data/information/knowledge model where knowledge is the contextualised and useful form of what entered our sphere as raw data.) The notion of the necessity of an external supply of knowledge, produced by teachers and consumed by learners, is obviously generally false, as the formation of complex knowledge occurs somewhere in our species, in reaction to the data we are exposed to, but that is far more suited to a discussion of research. Our research locates, classifies and develops new knowledge into a form where this can then be used, or passed onto learners to provide a basis for their development in a discipline area. So, specifically for learning and teaching purposes, our system is effectively built on the idea that the teachers have identified areas of knowledge that are to be passed on, in some form, and they provide the mechanisms and structures required for learners to gain this knowledge. Some of this knowledge may be in the area of knowledge location and development, our research training is, of course, an area of concern for both learners and teachers.

So, to answer question 1, why have I separated learning and teaching? When thinking about flows, flows start somewhere and finish elsewhere. Hence, any model of knowledge flow has to show it starting from somewhere and going somewhere else. Much like working out in a gym, standing there with static muscles doesn’t do very much – static and stagnant knowledge flows do even less because you’re not even sweating. I have implicitly accepted that there is some sort of knowledge repository, somewhere, that has transferred a quantity of knowledge to the teachers, somehow, and that these teachers will send the knowledge out again into a communication medium that the learners can then draw knowledge from. But what about the things we learn when we are teaching? Where does that fit in this model? Have I chosen a model that presumes too much?

Thinking about it, what is it that we learn while teaching? If it’s that something has changed in the material, where did we find it? If it’s from the literature, or colleagues, or any other external source, then we switched into learning mode outside of teaching. If it was during a class, where we hit upon a student question that changes the way we think about something, I would argue (and hopefully not as an empty argument of pure semantics) that while we are absorbing this, we are really not capable of teaching this new ‘discovery’ until we have finished the learning phase and then can project it back out to our learners. Even so, our own thoughts on the matter (and my earlier digression on research) indicate that there is some sort of internal learning/teaching mode that does not require external knowledge, per se, but is an internal transformation of data in the context of our existing knowledge. The arrows of knowledge that traverse the boundaries of student and teacher do form a proscriptive barrier to the teacher who learns from themselves and, of course, the learner who teaches themself.

Thus, the sketch is incomplete. I still believe that learning and teaching are separate activities for a given body of knowledge in a single individual, much as an internal combustion engine has different activities at different times, but I need to show the possibility of learning and teaching working together inside an individual.

But how do we fix the sketch? Here are some attempts that I came up with.

The first shows learners learning from themselves, and teachers teaching themselves, but the arrows, for clarity, leave the individual and loopback. I’ve also tried to show that the learner and teacher can be the same person by linking together both bubbles with a link. I don’t like this as it makes it look as if you have to stand in a room and yell the knowledge, then listen to it. This led to the second diagram, where the arrows are now inside the bubbles, and learners can teach teachers, and teachers can learn from learners. The third diagram is a similar concept but with the introduction of the ‘disconnecting medium’ that means that all teaching is viewed through a veil, of sorts, no doubt darkly on occasion. What we teach may not be interpreted in the way that we meant it to be.

I thought about this some more and came up with the final diagram, which unifies the two activities, but without the confusion of the arrows. Learning is still mostly an in-flow activity from multiple sources, teaching is still an out-flow activity to multiple recipients, but the intersection reflects the ‘&’ state: this is the point where people can teach themselves, without recourse to any additional knowledge sources. Latent knowledge, experience, raw data, thinking time, all live in the space called ‘&’ and complete the sketch.

I produced two versions of this in a neater form (I generally use OmniGraffle Pro and Adobe Illustrator for my diagrams, on OS X, if you’re curious. These are both Illustrator). I’m unsure which most embodies the idea the best, although I lean towards the horizontal version as it does not provide a visual hint that one is subordinate to the other. Reading left to right, as we do in English, it also implies that learners can become teachers.

I’m also happy because I was able to use the Caslon italic ampersand, which is a fundamentally beautiful character. Apart from the slightly dynamic air to the diagram lent by the use of italics, the italicised L and T are now of the same type family and style as the ampersand. They will almost always be more visually pleasing to most viewers and, for those who know their typefaces, the diagram will look more consistent.

To, finally, address question 2, I realise that I was too vague in meaning in my last post. While I believe that a student has to be a good student to move to the teaching phase, that is a point at which many students may find themselves at a certain time or in a certain area. A student needs to be confident, accurate and capable of communication in order to share their knowledge but, with careful maintenance of the environment, provision of opportunity and encouragement, on their day, any learner can be a teacher. The new diagram reinforces that: add knowledge, add the correct medium, stir, a teacher may emerge.

This new diagram also provides a basis for measurement that can also be handy. MIKE: Measurement Is Key to Everything. But that’s another blog post…