Last Lecture Blues

I delivered the last lecture, technically the review and revision lecture, for my first year course today. As usual, when I’ve had a good group of students or a course I enjoy, the relief in having reduced my workload is minor compared to the realisation that another semester has come to an end and that this particular party is over.

Hellooooo???

Today’s lecture was optional but we still managed to get roughly 30% of the active class along. Questions were asked, questions were discussed, outline answers were given and then, although they all say and listened until I’d finished a few minutes late, they were all up and gone. The next time I’ll see most of them is at the exam, a few weeks from now. After that? It depends on what I teach. Some of these students I’ll run into over the years and we’ll actually get to know each other. Some may end up as my honours or post-graduate students. Some will walk out of the gates this semester and never return.

Now, hear me out, because I’m not complaining about it, but this is not the easiest job in the world. Done properly, education requires constant questioning, study, planning, implementing, listening, talking and, above all, dealing with the fact that you may see the best student you ever have for a maximum of 6 months. It is, however, a job that I love, a job that I have a passion for and, of course, in many ways it’s a calling more than a job.

One of the things I’ve had a chance to reflect on in this blog is how much I enjoy my job, while at the same time recognising how hard it is to do it well. Many times, the students I need to speak to most are those who contact me least, who up and fade away one day, leaving me wondering what happened to them.

At the end of the semester, it’s a good time to ask myself some core questions and see if I can give some good answers:

  1. Did I do the best job that I could do, given the resources (structures, curriculum, computers etc) that I had to work with?
  2. Did I actively seek out the students who needed help, rather than just waiting for people to contact me?
  3. Did I look for pitfalls before I ran into them?
  4. Did I look after the staff who were working with or for me, and mentor them correctly?
  5. Did I try to make everything that I worked with an awesome experience for my students?

This has been the busiest six months of my life and one of my joys has been walking into a lecture theatre, having written the course, knowing the material and losing myself in an hour of interactive, collaborative and enjoyable knowledge exchange with my students. Despite that, being so busy, sometimes I didn’t quite have the foresight that I should had had and my radar range was measured in days rather than weeks. Don’t get me wrong, everything got done, but I could have tried to locate troubled students more actively, and some minor pitfalls nearly got me.

However, I think that we still delivered a great course and I’m happy with 1, 4 and 5. I aimed for awesome and I think we hit it fairly often. 2 and 3 needed work but I’ve already started making the required changes to make this better.

On reflection, I’d give myself an 8ish/10 but, of course, that’s not enough. Overall, in the course, because of the excellent support from my co-lecturer and my teaching staff, the course itself I’d push up into the 9-pluses. I, however, should be up there as well and right now, I’m too busy.

So, it’s time for some rebalancing into the new semester. Some more structure for identifying problems students. Looking at things a little earlier. And aiming for an awesome 10/10 for my own performance next semester.

To all my students, past and present, it’s been fantastic. Best of luck with your exams!


Codes of Conduct: Being a Grown-Up.

I always hope that my students are functioning at a higher level, heading towards functional adulthood, to some extent. After all, if they need to go to the bathroom, they can usually manage that in a clean and tidy manner. They dress themselves. They can answer questions. So why do some of them act like children when it comes to good/bad behaviour?

I searched for “adult child” and found this. I think Craig Ferguson should sue.

I was reading Darlena’s blog post about one of Rafe Esquith’s books and she referred to Rafe’s referral to Kohlberg’s Six Levels of Moral Development, which I ‘quote-quote’ here:

  1. I do not want to get into trouble.
  2. I want a reward.
  3. I want to please someone.
  4. I always follow the rules.
  5. I am considerate of other people.
  6. I have a personal code of behaviour.

I’ve been talking around these points for a while, in terms of the Perry classifications of duality, multiplicity and commitment. What disappoints me the most is when I have to deal with students who are either trying not to get into trouble or only work for reward – and these are their prime motivations. There’s a world of difference between having students who do things because they have worked through everything we’ve talked about and decided to commit to that approach (step 6 in this scale) and those who only do it because they feel that they will get punished if they don’t.

I always say that I expect a lot of my students and, fairly early on, I do expect them to have formed a personal code of conduct. Yes, I expect them to be timely in their submissions, but because they understand that assignment placement is deliberate and assists them in knowledge formation. Yes, I expect them to not plagiarise or cheat, but because to do so deprives them of learning opportunities. I expect them not to talk in class because they don’t want to deprive other people of learning opportunities (which is a bit of points 5 and 6).

I press this point a lot. I say that I reward what they know, as long as it’s relevant, rather than punishing them for getting things wrong. I encourage them to participate, to be aware of other people, to interact and work with me to make the knowledge transfer more effective – to allow them to construct the mental frameworks required to produce the knowledge for themselves.

I really don’t think it’s good enough to say “Well, students always do X and what can you do?” I have a number of people in my classes who have discovered, to their mounting amazement, that I basically won’t accept behaviour that doesn’t meet reasonable standards. I mean what I say when I say things and I don’t change my mind just because someone asks me. I’m tough on plagiarism and cheating. I don’t let people bully me or other people. And, amazingly, I don’t see many of these behaviours in my class.

I encourage a constructive and positive approach for all of my students – but the basis of this is that they have to establish a personal code of conduct that I can work with. If they go down this path, then everything else tends to follow and we can go a fantastic educational journey together. If they’re still stuck, doing the minimum they can get away with, because they don’t want to get yelled at, then my first (and far more difficult) task is to reach them, try and get them to think beyond using this as their only motivator.

Now, of course, the golden rule is that if you want a student to do something, then giving marks for it is the best way to go – and that’s a technique I use, and I’ve discussed it before. But it’s never JUST the marks. There’s always  reward in terms of scaffolding, or personal satisfaction, or insight. I want fiero! I also don’t want the students to do things just because I ask them to, because they want to please me. I have a middling amount of lecturing charisma but I’m always aware that I have to be content first/showmanship second. If I do that, then students are less likely to fall into the trap of trying to do things just because I ask them to.

I’m really not the kind of teacher who needs an apple on the desk. (I already have two iMacs and a MacBook Air. Ba-dum-*ting*)

Number 4 is one that I really want to steer people away from. Yes, rules should be followed – except where they shouldn’t. You may not know this but it is completely legitimate for a solider in the Australian Army to refuse to follow an illegal order. (Yes, it will probably not go very well but it’s still an option.) If a soldier, who is normally bound by the chain of command to follow orders, believes the order to be illegal (“No prisoners” being one of them) they don’t have to follow it. Australian soldiers are encouraged to exercise discretion and thought because that makes them better soldiers – they can fill in the blanks when the situation changes and potentially improve things. The price, of course, is that a thinker thinks.

Same for students. I want students who change the world, who make things better, who may occasionally walk on the grass to get to that bright new future even when the signs say ‘stay off the grass’. However, without a personal code of conduct, which rules you can bend or break are going to be fairly arbitrarily selected and are far more likely to have a selfish focus. We want rule bending in the face of sound ethics, not rationalisation.

As I said, it’s a lot to ask of students but, as I’ve always said, if I don’t ask for it, and tell people what I want, I can’t expect it and I certainly can’t build on it.


The Confusing Message: Sourcing Student Feedback

Once, for a course which we shall label ‘an introduction to X and Y’, I saw some feedback from a student that went as follows. A single student, on the same feedback form, and in adjacent text boxes, gave these answers:

What do you like most about this course: the X

What would you like to see happen to improve the course: less X, more Y!

Now, of course, this not inherently contradictory but, honestly, it’s really hard to get the message here. You think that X is great but less useful than Y, although you like X more? You’re a secret masochist and you like to remove pleasure from your life?

As (almost) always, the problem here is that we these two questions, asked in adjacent text boxes, are asking completely different things. Survey construction is an art, a dark and mysterious art, and a well-constructed survey will probably not answer a question once, in one way. It will ask the same question in multiple ways, sometimes in the negative, to see if the “X” and “not ( not (X))” scores line up for each area of interest. This, of course, assumes that you have people who are willing to fill out long surveys and give you reliable answers. This is a big assumption. Most of the surveys that I work with have to fit into short time frames and are Likert-based with text boxes. Not quite yes/no tick/flick but not much more and very little opportunity for mutually interacting questions.

The Red Tick of Courage!

Our student experience surveys are about 10 questions long with two text boxes and are about the length that we can fit into the end of a lecture and have the majority of students fill out and return. From experience, if I construct larger surveys, or have special ‘survey-only’ sessions, I get poor participation. (Hey, I might just be doing it wrong. Tips and help in the comments, please!)

Of course, being Mr Measurement, I often measure things as side effects of the main activity. Today, I held a quiz in class and while everyone was writing away, I was actually getting a count of attendees because they were about to hand up cards for marking. This gives me an indicator of attendance and, as it happens, two weeks away from the end of the course, we’re still getting good attendance. (So, I’m happy.) I can also see how the students are doing with fundamental concepts so I can monitor that too.

I’m fascinated by what students think about their experience but I need to know what they need based on their performance, so that I can improve their performance without having to work out what they mean. The original example would give me no real insight into what to do and how to improve – so I can’t really do anything with any certainty. If the student had said “I love X but I feel that we spent too much time on it and it could be just as good with a little less.” then I know what I can do.

I also sometimes just ask for direct feedback in assignments, or in class, because then I’ll get the things that are really bugging or exciting people. That also gives me the ability to adapt to what I hear and ask more directed questions.

Student opinion and feedback can be a vital indicator of our teaching efficacy, assuming that we can find out what people think rather than just getting some short and glib answers to questions that don’t really probe in the right ways, where we never get a real indication of their thoughts. To do this requires us to form a relationship, to monitor, to show the value of feedback and to listen. Sadly, that takes a lot more work than throwing out a standard form once a semester, so it’s not surprising that it’s occasionally overlooked.


We Expect Commitment – That’s Why We Have to Commit As Well.

I’m currently in Cupertino, California, to talk about how my University (or, to be precise, a Faculty in my University), starting using iPads in First Year by giving them to all starting students. As a result, last night I found myself at a large table on highly committed and passionate people in Education, talking about innovative support mechanisms for students.

Pizza and beer – Fuelling educational discussions since forever. (I love the Internet: I didn’t take any pictures of my food but a quick web-search for BJ’s Pizza Cupertino quickly turned up some good stuff.)

I’ve highlighted committed and passionate because it shows why those people are even at this meeting in the first place – they’re here to talk about something very cool that has been done for students, or a solution that has fixed a persistent or troublesome problem. From my conversations so far, everyone has been fascinated by what everyone else is doing and, in a couple of cases, I was taking notes furiously because it’s all great stuff that I want to do when I get home.

We expect our students to be committed to our courses: showing up, listening, contributing, collaborating, doing the work and getting the knowledge. We all clearly understand that passion makes that easier. Some students may have a sufficiently good view of where they want to go, when they come in, that we can draw on their goal drive to keep them going. However, a lot don’t, and even those who do have that view often turn out to have a slightly warped view of what their goal reality actually is. So, anything we can do to keep a student’s momentum going, while they work out what their goals and passions actually are, and make a true commitment to our courses, is really important.

And that’s where our commitment and passion come into things. As you may know, I travel a lot and, honestly, that’s pretty draining. However, after being awake for 33 hours after a trans-Pacific flight, I was still awake, alert and excited, sitting around last night talking to anyone who would listen with the things that we’re doing which are probably worth sharing. Much more importantly, I was fired up and interested to talk to the people around me who talking about the work that had been put in to make things work for students, the grand visions, the problems that had been overcome and, importantly, they could easily show me what they’d been doing because, in most cases, these systems are highly accessible in a mobile environment. Passion and commitment in my colleagues keeps me going and helps me to pass it on to my students.

Students always know if you’re into what you’re doing. Honestly, they do. Accepting that is one of the first steps to becoming a good teacher because it does away with that obstructive hypocrisy layer that bad teachers tend to cling to. This has to be more than a single teacher outlook though. Modern electronic systems for student support, learning and teaching, require the majority of educators to be involved in your institution. If you say “This is something you should do, please use it” and very few other lecturers do – who do the students believe? Because if they believe you, then your colleagues look bad (whether they should or not, I leave to you). If they believe your colleagues then you are wasting your effort and you’re going to get really frustrated. What about if half the class does and half doesn’t?

We’re going through some major strategic reviews at the moment back home and it’s really important that, whatever our new strategy on electronic support for learning and teaching is, it has to be something that the majority of staff and students can commit to, with results and participation drive or reward their passions. (It’s a good thing we’ve got some time to develop this, because it’s a really big ask!)

The educational times are most definitely a-changin’. (Sorry, I’m in California.) We’ve all seen what happens when new initiatives are pushed through, rather than guided through or introduced with strong support. Some time ago, I ran across a hierarchy of commitment that uses terms that I like, so I’m going to draw from that now. The terms are condemnation, complaint, compliance and commitment.

If we jam stuff through (new systems, new procedures, compulsory participation in on-line activities) without the proper consultation and preparation, we risk high levels of condemnation or under-mining from people who feel threatened or disenfranchised. Even if it’s not this bad, we may end up with people who just complain about it – Why should I? Who’s going to tell me to? Some people are just going to go along with it but, let’s face it, compliance is not the most inspirational mental state. Why are you doing it? Because someone told me to and I just thought I should go along with it.

We want commitment! I know what I’m doing. I agree with what I’m doing. I have chosen to not just take part but to do so willingly and I’m implicitly going to try and improve what’s going on. We want in our students, we want it in our colleagues. To get that in our colleagues for some of the new education systems is going to take a lot of discussion, a lot of thinking, a lot of careful design and some really good implementation, including honest and open review of what works and what doesn’t. It’s also going to take an honest and open discussion of the kind of workload involved to (a) produce everything properly as a set-up cost and (b) the ongoing costs in terms of workload, physical resources and time for staff, organisations and students.

So, if we want commitment from our students, then we must have commitment from our staff, which means that we who are involved in system planning and design have to commit in turn. I’m committed enough to come to California for about 8 more hours than I’m spending on planes here and back again. That, however, means nothing unless I show real commitment and take good things back to my own community, spend time and effort in carefully crafting effective communication for my students and colleagues, and keep on chasing it up and putting the effort in until something good is achieved.


Things I Have Learned From my Cats, About Teaching

If you don’t have cats, or don’t like cats, then (a) get cats or (b) give in to your feline masters. More seriously, cats are very handy as a reference for the professional (or enthusiastic amateur) educator, because they ground you before you go and try something that you are heavily invested in with a whole class of students.

The important lessons that you can learn from cats are:

  1. Cats will only do what you tell them if they were already planning to do it.Obviously, students are more intelligent than cats and can learn a whole range of complex things. However, it’s easy to sometimes think that a particular thing that you did led to a completely different behaviour on the students’ part. Once you’ve removed other factors, isolated the element, repeated the experiment and got the same result? Sure, that’s influential. Before then, it may be any one of the effects that contaminate this kind of perception.
  2. Cats have good days and bad days. These are randomly allocated.

    Sometimes cats stay off the table. Sometimes they don’t. This is for reasons that I don’t understand because I can’t see the whole of the cats’ thinking process – despite them living inside my house for the past 8 years and me being able to observe them the whole time. I’ve realised over the years that I see my students for a very small fraction of their lives and trying to determine  when they’re going to be really receptive or not is not easy. I can try to present or set up my course in a way that reaches them most of the time. Sometimes it won’t happen. (I should note that they generally do, however, stay off the tables.)
  3. Cats can’t tell you what’s wrong because they don’t have the vocabulary.Of course, students can talk to me most of the time and we can talk about what’s wrong, but we have very different vocabularies in many ways. By exposing my thoughts and my processes to the students in their language, and scaffolding them to an understanding of the vocabulary of teaching education, or to get them to understand how collaboration isn’t a shorthand for “straight copying”.

This is rather trivial but, as always, it’s about framing and engagement. I suppose I’m saying the things I usually say but with a strange linkage to cat stories. As you read this, I’m probably on a plane somewhere, so I’ll try to be more coherent once I land.


E-Library: Electronic or Ephemeral?

My technical and professional library is a strange beast. Part Computer Science, part graphic design, part fiction, it’s made up of new books, books I had in Uni, books that I have inherited from other academics and books that I salvaged from libraries before they disappeared. But, of course, there is a new and growing section of my library, which you can’t see on the shelves – my E-Library. I realised that, this week, I now have started an E-Library collection that grows on a monthly basis as I add more content. I shall use the term eBooks for the rest of this post, but I’m not referring to a specific format – it’s just the digitised and electronically transferable image of a book that I’m concerned with.

Why am I buying eBooks? Because they arrive within minutes. I talk about this from a student perspective in tomorrow’s main post but, for me, I buy physical+electronic where I can because I will end up with a copy that I can use right now and a copy that I can add to my physical library.

When I am gone, or when I retire, my professional library will be stripped for those things that will be kept, by me or my wife, and the rest will go out into the corridor, onto a table, for the rest of my colleagues and students to pick through. The remainder will probably be offered to a school, as the main library is not really interested in my 1950s Engineering texts. But what of texts that only exist in the Ephemeral Library? There are so many questions about this form of my library:

  1. Will I even be able to transfer all of my books? I buy mostly from suppliers who allow me to legitimately transfer the electronic copies but there are some of my books that are locked to my identity or my machine.
  2. How will I advertise them? Put up a webpage with a download link? That immediately breaches most publishers restrictions. Asking people to register their interest and then provide it to them takes effort and, most likely, means that it will be a low priority.
  3. Will the formats that I am buying today be a working format in 30 years time? We have a tendency to think in the now, forgetting that 78s are gone, 8-track is gone, cassette is mostly gone and vinyl is more fringe oriented than mainstream these days. Beta is buried deep in the ground with VHS buried just above it. The physical formats are being obliterated in the face of the relentless march of digitised containers but, remember, standards change and, worse, standards evolve within the standards themselves. At some stage BluRay X will break BluRay 1.2, most likely. In the same way, PDF 22 may lose the ability to handle earlier versions. Backwards compatibility is a grand goal but, time and again, we have eventually abandoned it on the argument that it is no longer necessary.
  4. Will I maintain the burden of updating my media to make sure that 3 doesn’t happen? How much spare time do you have?
  5. Finally, what happens when I die? I don’t think I’m allowed to transfer my iTunes account details to my wife – so over 260 songs will, at some stage, disappear from our shared iPods. The same for my library. Suddenly, books disappear. Possibly books that have not been published for years and will never be published again. Gutenberg dies and all of his Bibles spontaneously combust? Not the most robust model.

Obviously, part of the whole management process that will have to be recognised is the difference between renting, leasing and owning a digital property. If we are actually going to own things, and most people think that they own things but would be surprised if they read the fine print, we have to come up with a form of identity management that allows transfer of property to occur across legally recognisable lines. One can only hope that we’ve sorted out the simple things like child rearing, marriage, hospital visitation and social security access before we attempt to push through a global, trans-corportate, persistent rights management system that allows us to keep our collections together, even after we die.

 


Hurdles and Hang-ups: Identifying Those Things That Trip Up a Student

Most of the courses I teach have a number of guidelines in place that allow a student to, with relative ease and fairly early on, identify if they are meeting the requirements of the course. Some of these are based around their running assessment percentages, where a student knows their mark and can use this to estimate how they’re travelling. We use a minimum performance requirement that says that a student must achieve at least 40% in every component (where a component is “the examination” or “the aggregate mark across the whole of their programming assignments”) and 50% overall in order to pass. If a student doesn’t meet this, but would otherwise pass, we can look at targeted remedial (replacement) assessment in order to address the concern.

Bazinga! (With apologies to the Austrian athlete involved, who suffered no more injury than some cuts to his lower lip and jaw.)

One of the things we use is often referred to as a hurdle assessment, an assessment item that is compulsory and must be passed in order to pass the course. One of the good things about hurdle assessments is that you can take something that you consider to be a crucial skill and require a demonstration of adequate performance in that skill – well before the final examination and, often, in a way that is more practically oriented. Because of this we have practical programming exams early on in our course, to resolve the issues of students who can write about programming but can’t actually program yet.

It would be easy to think of these as barriers to progress, but the term hurdle is far more apt in this case, because if you visualise athletic training for the hurdles, you will see a sequence of hurdles leading to a goal. If you fall at one, then you require more training and then can attempt it again. This is another strong component of our guidelines – if we present hurdles, we must offer opportunities for learning and then reassessment.

Of course, this is the goal, role and burden of the educator: not the cheering on of the naturally gifted, but the encouragement, development and picking up of those who fall occasionally.

Picked correctly, hurdles identify a lack of ability or development in a core skill that is an absolute pre-requisite for further achievement. Picked poorly, it encourages misdirected effort, rote learning or eye-rolling by students as they undertake compulsory make-work.

I spend a lot to time trying to frame what is happening in the course so that my students can keep an eye on their own progress. A lot of what affects a student is nothing to do with academic ability and everything to do with their youth, their problems, their lives and their hang-ups. If I can provide some framing that tells them what is important and when it is important for it to be important, then I hope to provide a set of guides against which students can assess their own abilities and prioritise their efforts in order to achieve success.

Students have enough problems these days, with so many of them working or studying part-time or changing degrees or … well… 21st Century, really, without me adding to it by making the course a black box where no feedback or indicators reach them until I stamp a big red F on their paperwork and tell them to come back next year. If they can still afford it.


Let’s get out of the geek box – professional pride is what we’re after.

As a member of the Information and Communication Technology (ICT) education community, I deal with a lot of students and, believe me, they come in all shapes, sizes and types. Could I pick one of my students out of a crowd by type alone? No. Could I pick a Science, Technology, Engineering and Mathematics (STEM) class from looking at who is sitting in the seats? Sadly, yes, but probably more from gender representation than anything else – and that is something that we’re very much trying to change.

Students walking

Can you spot the ICT student?

I’m not a big fan of ‘Geek pride’ or attempting to ‘reclaim’ pejorative terms such as dork or nerd. I don’t see why we have to try and turn these terms around, much less put up with them. I have lots of interests – if I paint in oil, I’m an artist, if I sketch on an iPad, I’m a nerd? What? If I can discuss David Foster Wallace or Margaret Atwood’s books at length I’m educated but if I do the same thing with Science Fiction, I’m a geek? Huh? I work a lot in information classification so you can understand that (a) this doesn’t make much sense to me and (b) highlights the problem that accepting the term, in any sense, might eventually give us ownership but it still allows people to put us in the geek box. Let’s get out of the geek box and reclaim a far more useful form of identify – professional pride in doing a job well, with a job that is worth doing.

Let me be more blunt – being good at my job and the interests I have outside of my job may have some relationship but it’s never going to be an ironclad correlation. Stereotypes aren’t useful in any area and, despite the popular stereotype of ICT and scientists on television and in other media, my community is made up many, many different kinds of people. Like any other community.

Forcing us to identify as geeks, dorks or nerds; requiring people to have an all-consuming love of certain TV shows; resorting to a ‘geek shibboleth’ of unpopular or obscure information to confirm membership? This are ways to create a fragmented set of sub-communities that are divided, diminished and able to be ignored. It also provides a barrier to entry because people assume that they must pass these membership tests to join the community when this is not true at all. I don’t want people to ignore our stream of education and the profession because of their incorrect perception of what is required to be a member.

(If you want to watch Buffy, watch Buffy! But don’t feel that you can’t be a programmer because you prefer Ginsberg to Giles.)

I am not a geek. Or a dork. Or a nerd. I am interested in everything – like so many of my students and like so many other people! I want to communicate to my students that they don’t need to be in a box to play in the world. And they shouldn’t put other people in there, either.

Here are my rather loose thoughts but I’d really like to get some dialogue going in the comments if possible, to help me get a handle on it so that I can communicate these things with my students.

  1. My interests and my job have some connection but one does not completely define the other.
    I am an educator, a computer scientist, a programmer, a systems designer – none of these need to be apologised for, tolerated by other people or somehow seen as beneath any other discipline. (This applies to all lines of work – a job done well is a matter of pride and should be respected, assuming that the job in question isn’t inherently unethical or evil.) I can do these jobs well. I also happen to be a painter, a writer, a singer, a guitar player and an amateur long distance runner. If I had listed these terms first, how would you have classed me? What are my job interests and what are my real interests? As it happens, I enjoy the works of Borges, Singer, and Stoppard – but I also enjoy le Guin, Banks, Dick, Moorcock, Tiptree and Steven King.
    If I take professional pride in doing my job well, and I then do perform it well, my interests, or the stereotypes associated with my interests, are irrelevant. Feel free to question my taste, but don’t use it to tell me who I am, what I can do and how my work should be appreciated.
  2. All professions have jargon or, more precisely, all professions have a specific set of terms that are used to precisely convey information between practitioners. This is not cause for mockery or derision.
    Watched “House” recently? When was the last time you went to the Doctor and called him or her a geek, even out of earshot, for referring to the abdomen instead of tummy? We’re all exposed to tech jargon because the tech is everywhere – when I use certain terms, I’m doing so to make sure that I’m referring to the right thing. We don’t want to turn tech talk into a shibboleth (a means of identifying the same religious group) but we want it to remain an accurate and concise way of discussing things in a professional sense. But, as a profession, this comes with an obligation…
  3.  As a profession, communication with other people is worthy of attention because it is important.
    When the pilots are flying your plane, they’ll try and communicate with you in a combination of pilot-specific language and normal human communication. ICT people have to do that all the time and, admittedly, sometimes we succeed more than others. Some people in my profession try to confound other people when speaking for a whole lot of reasons that aren’t really that important – please don’t do it. It’s divisive and it’s unnecessary. If people don’t know what you’re talking about, educate them. Use the right words to do your job and the right words to communicate with other people. We don’t want to turn ourselves into some kind of exclusive club because, ultimately, it’s going to work against us. And it is working against us.
  4.  It’s time to grow up
    Sometimes this all seems so… schoolyard. People called other people names and it caused group formation and division. Now, in an ongoing battle of “geek” versus “anti-geek” we revisit the playground and try and put people into boxes. It’s time to move away from that and accept that stereotypes are often untrue, although convenient, and that we don’t need to put people into these boxes. That applies to people outside the ICT community and to people inside the community. Every community has a range of people – you will always find people to support loose stereotypes but, look carefully, and you’ll always find people who don’t fit.
  5. We’re not smarter and our field isn’t so hard that only amazing people can do it
    When some people go and talk to students they say things like “It’s hard but you get so much out of it”. What students hear is “It’s hard.” That saying “It’s hard” is worn like a badge of honour – that you have to be worthy enough to do somethings because they’re difficult.Rubbish.There are as many degrees of work difficulty as there are pieces of work and challenges range from easy to impossible – like any other discipline. It’s nice to feel smart, it’s nice to think you’ve conquered something but, being honest, you don’t need to be really smart to do these things although you do need to dedicate some time and thought to most of the activities. Yes, at the top end, there are scarily smart people. I’m not one of them but I admire those who have those skills and use them well. The really bright people are often some of the nicest and most humble. It’s another division that we don’t need.

    I’m a great believer that we should tell students the truth, in the context of other professions. We have less memorisation than medicine but more freedom to create and innovate. In ICT we have fewer theorems than maths but more large programs where we try to string things together. We have fewer people pass out from fumes than Organic Chemistry but that’s a positive and a negative (Yes, I’m joking). We get to do amazing things but, like all amazing things, this requires study and work. It is completely achievable by the vast majority of students who qualify for University. We don’t need to be exclusive and divided – we want more people and we want our community to grow.

We have some seriously difficult challenges to solve in the coming decades. We’re not going to get anywhere by splintering communities, making false barriers to entry and trying to pretend that our schoolyard view is even vaguely indicative of reality.


Back in the Saddle: Getting Students Talking.

I gave my first “non-intensive mode” lecture in weeks on Monday and it was a blast. I’ve already mentioned that it was on Ethics and I do enjoy teaching that. I regularly throw to the class with “Hey, what do you think about this – 1 minute, give me an answer, talk to your neighbour. Go!” and then wander about. While I’m wandering, I’m not worried about the students who are all talking – that’s what I want – I’m looking for the students who are sitting by themselves.

Generally, where possible, I’ll try and nudge the geographically isolated students together – you know, when one is sitting in row 3, then there’s a huge gap and there’s another in row 7 – but I try to do this before the lecture gets going. Once you’ve got all of our gear out, you don’t want to move and, if you do, you drop stuff and – well, it’s a mess.

Some people, of course, just don’t want to play. They won’t sit with other people, they won’t talk, they won’t interact unless I address them directly and then stand and wait for them to answer. Now this has to be done very carefully because you don’t want to get into a staring match or an intimidation play with a student, so it has to stay light but it has to be obvious that you’re not going away. Now, I’m sure some of you are thinking “why is he picking on the introverts” and, frankly, that’s a valid concern for all of us. I watch body language like a hawk and I know the difference between “not really wanting to play” and “about to bolt”. If someone answers me in any way, I’ll build that into what I’m talking about. If someone can’t make eye contact or is making serious avoidance signals at me, I’ll back off and cover it by flicking to a neighbour who looks keen. At that point, everyone gets (rightly) concerned I’m going to flick to them and I’ve taken the heat right off my original student. Humour, injected generically and NEVER directed at the student, can sometimes defuse the situation. It’s more risky than not, in my opinion, so unless you know that you’re a comedy genius and you have major awards for your empathetic handling of hostage situations, best stick to redirecting class attention in other ways.

I don’t see many really shy or introverted people who won’t take part at all in my lectures but, then again, I’m really keen on setting up a non-judgemental and constructive environment where everyone can have their say, without fear of being ridiculed. I’ve only rarely had to deal with unpleasant students but I’ll do it – and I think my students know that they can depend upon that.

My real concern is always with communication ability and the desire to communicate. Before anyone thinks I’m having a go at International students, I’m not. The range of linguistic ability, social awareness and skill in communication rungs the gamut across all of my student groups, regardless of origin. Yes, students with English as a second language can struggle a bit but I provide recordings of my lectures and I have become much more adept at understanding accented English – remember: their English is far better than my Farsi/Urdu/Mandarin/Hokkien/Bahaya/German/… Yes, there can be cultural barriers to participation but, then again, that’s true of mature age students not wanting to look silly in front of the young ‘uns. Or person X in front of person Y, for almost all values of X and Y, including X==Y! (The ultimate generalisation, you saw it here first.)

What I find helps is to provide the following structure to assist, encourage and sustain participation in lectures:

  1. Provide a clear context
    Let the students know the area in which the activity, questions or whatever will be taking place. Give them hooks to hang their answers on. You want their first answers to be in the ballpark of right, so you can lead them closer. In sufficient context will give you answers that don’t really lead anywhere and that makes your job much harder.
  2. Start simple
    Start with short phrases, show of hands, yes/no. Once the class is warm, get longer, get discursive, write things on paper. Walking in and, first thing, asking a question that needs a two-minute answer may not work with most classes.
  3. Build constructively
    Almost any answer can lead somewhere good, assuming you’ve got point 1 down. Take it and run with it. A lot of students already think that they’re wrong and we want them to confident, and accurately confident, about being right so we try and build a massive structure of beautiful knowledge out of an enormous set of tolerably reasonable bricks. Encouraging students to feel values makes spaces friendly, supportive and collaborative. You can get a great collaboration going in a terrible space if you have the right environment. The best lecture theatre or collar suite in the world is going to be silent if you say “No, try again.” whenever a student says anything.
  4. Activate damage control
    Having said that, sometimes you need to lead people back to the righteous path. Sometimes you need to stop discussions. Religion, politics, gender issues, etc cannot be injected – unless that’s what you’re talking about. Even in my ethics course I deliberately framed it as a non-judgemental environment, where I wasn’t testing moral compasses, I was assessing thinking. Any sniff of heated argument and I would have been in there, redirecting, repurposing and juggling like mad. If things are going really, really badly – stop the activity. It helps to have something up your sleeve but you’re always better to stop before someone says or does something that really screws up their lives. We’re not in loco parentis but we still have that role of pastoral care.
  5. Take a risk or two
    Students love seeing us out on the edge. Whether it’s solving an unseen problem or trying an in-class activity that might go wrong – the fact that you’re willing to try stuff goes a long way to encourage students to try stuff, too. I think there’s an aspect of mutual confidence that develops there. Having said that, PREPARE YOUR STUFF. 🙂 There’s a world of difference between a touch of risk and trying to run the whole course on a scrap of paper. The latter is not effective. (Unless you’re very, very good and I’ve never met anyone who could actually pull that off – although several thought that they could.)

This is what works for me – what works for you?


Bad Summaries Ruin Good Reports: Generation Why?

A media release came around on Friday from Universities Australia called “Generation WhY? (sic) Students question point of science and maths“. You can read the media release, key findings and the associated report here. The key findings, for students who are both STEM and non-STEM, are published with a series of pull quotes and explanations underneath them. For my own purposes, I’ve removed those because I want you to read the key findings in the raw:

  1. More than 40% of students surveyed did not feel encouraged to do well in maths and science by their teachers at high school
  2. 1 in 3 students were influenced by past teachers in their university choices
  3. 1 in 5 STEM students somewhat or totally engage in the stereotype that science is for nerds.
  4. Students sometimes felt (that) STEM subjects do not align with other interests and abilities.
  5. Some students interviewed saw no positive value from pursuing STEM as a career.
  6. An inability to understand or work with the precise black-and-white nature of science, as opposed to less structured processes, turned some students away.

The report itself is 144 pages long but from page 88 it’s an appendix containing the survey so it’s not too long a read. However, those 6 statements above are, well, in the politest way possible, not very precise. Finding 2., for example, has accompanying text that implies the influence was negative – that 1 in 3 students were discouraged, rather than influenced. Finding 3 is interesting but how many non-STEM students feel the same way? Finding 4 – sometimes? Let’s look at the questions to get an idea of how the survey was framed. The initial questions are all basic demography, then we get to the meat.

Question 19. As a person are you primarily?

  • More socially outgoing and like being the centre of attention
  • More a quiet and private person and like being with your own thoughts
  • Not sure/can’t answer

Urm. I’m socially outgoing but I like time alone with my thoughts. I’m sure of that, however. But this is a quibble. Not many people will have a problem with this. Let’s look at another one.

Question 21. As a person do you primarily?

  • Go with your gut instincts
  • Focus on cold hard facts
  • Not sure/Can’t answer

Urm, again. COLD HARD FACTS. M’lud, I think that we’re leading the witness a tad. How about “Go with your instincts/Focus on the facts”? (Still lots of room for improvement)

You can read the rest of the survey yourself – because I don’t want you all to die of boredom. First thing is that, yes, of course, survey design is hard and I’m sure that a lot of thought went into this survey. However, the press release that came out from this survey makes some claims that, if true, mean that we in the higher edu sector are pretty much stuffed in some ways, because we just won’t get the students here to work with in the first place. Once a student gets into STEM, I can work with them. If, as the survey suggests, I’m losing 33% to teacher discouragement, or 40% to not doing well, or 20% to the nerd factor, I’ve lost a vast number of potential students.

Reading the survey, rather than the keypoints, is far more illuminating. It turns out that teacher influence can be either way, which should have been obvious in the summary. It paints teachers in a much fairer manner. That whole ‘science is for nerds’ is in the middle of a question with lots of opinion options and a 5 point rating scale for agreement. So 20% of STEM students ticked the Totally or Somewhat agree box.

Hang on. That means that 80% of the people in STEM either can’t answer or don’t think it’s for nerds. Page 69 of the report talks on this. I quote: “A higher proportion of STEM respondents somewhat agreed with the statement science is for nerds than did non-STEM respondents.”

They then show the results table. 1364 students in total, 730 non-STEM, 634 STEM. 96 of non-STEM thought it was for nerds, 124 of STEM thought it was for nerds. All other results were disagreers. They’ve already removed the can’t answer people from the survey. That’s 13% of outside STEM people and 19.6% of STEM. Now all of these students are currently enrolled, at University, so the people who are more likely to think science is for nerds are already inside our borders. So, the actual finding is:

“Around 1 in 10 students outside of STEM have a negative image of science as being for nerds, and the number increases slightly to just under 1 in 5 for students inside STEM. Overall, roughly 1 in 6 first-year students surveyed have a perception of science as nerdy.”

That’s surprisingly positive to me. I’d always thought that everyone thought we were enormous dorks. Hooray! Checking the figures, only 5% of STEM students totally agree anyway, compared with 3% of non-STEM, but we have a lot more ‘somewhat agrees’ which really drives the numbers up in STEM.

Here’s the quote that was underneath the 1 in 5 figure in finding 3: “Also if you see scientists on the news like, there’s kind of a stereotype that you will see… Like kind of wearing glasses… They never dress well.” That seems pretty damning. Not only do people think we’re nerds, they took the time to write this down.

But that quote doesn’t come from the survey. That pull quote is not from the same source as the survey data, it’s an anonymous student comment from the Phase 1 pre-survey focus group. In fact, there is no text box associated with that question (Question 80) – Question 81 is a question with a text box, but it’s for comments about the survey itself. Associating that quote with that finding makes a very strong implied linkage that is very. simply. not. there. The initial focus group at University of Sydney was composed of 8 people, a 5/3 male/female split, all first-year, with five B.Sc and three B.A. students. What they admitted that they felt about stereotyping was used to build the survey question at the end. But putting their pre-survey thoughts together with a post-survey result is something that, well, ok, maybe it’s done all the time, but I wouldn’t do it myself.

Those two entities have no linkage – unless it is to say “Hey, the focus group thought everyone would think that science was for nerds but they turned out to be wrong – it’s less than 20% on average and we’re harder on ourselves in STEM, about being cool, than other people think we should be. Woo!” because that recognises the data origin and what the result means. The way that it is presented in the key findings is misleading.

Finding 4 is a curious one (Students sometimes felt (that) STEM subjects do not align with other interests and abilities.) because there is a question, Q50, that asks about why you chose a particular degree. However, the report does not clearly show the detail of the responses and the question just lists ‘Best fit for my interests and abilities’ as one of the options for “What are the reasons for your choice of University degree/course/program”. Searching for the words “interests” or “abilities” in the text brings up some earlier quotes and I must be missing something because I couldn’t find anything to support finding 4, beyond a brief quote from the pre-focus group again. The word ‘align’ doesn’t occur in the report. I’ve read all the questions and can’t see where that finding could be derived. I must be missing something because I can’t find a single solid point in the report, or a summary, that supports this key finding. So, dear reader, if you can find it, please help me out and show me where it is! (I’m a bit tired, so forgive me if I’ve missed the obvious.)

I can’t help but feel that this media release, focusing on negative interpretation and using contextualising quotes that reinforce that interpretation, is doing a disservice to the interesting data contained within the report. Check it out for yourself to see how else things have been reported one way in the actual report and then projected out through the media release. If nothing else, it’s a teaching example in itself of how you can present data accurately but in a way that will very definitely channel someone’s interpretation – especially if they don’t bother to read the original article. If you read the report, you can see that the writers are concerned about the statistical validity because only 12% of their target group responded.

It’s a reminder that all the work you put into your survey design and data analysis process is nothing if that message is lost or adulterated in the search for an easy message. The message matters more than the medium. Once again, the medium is important, but the message is paramount.

Finally, it’s a reminder that we always must read the primary source, to at least calibrate the secondary and tertiary reports.