What’s the Big Idea?

Posted: June 8, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , | Leave a comment

I was reading Mark Guzdial’s blog just before sitting down to write tonight and came across this post. Mark was musing about the parallels between the Common Core standards of English Language arts and those of Computing Literacy. He also mentioned the CS:Principles program – an AP course designed to give an understanding of fundamental principles, the breadth of application and the way that computing can change the world.

I want to talk more about the parallels that Mark mentioned but I’ll do that in another post because I read through the CS:Principles Big Ideas and wanted to share them with you. There are seven big ideas:

  1. Creativity, recognising the innately creative nature of computing;
  2. Abstraction, where we rise above detail to allow us to focus on the right things;
  3. Data, where data is the foundation of the creation of knowledge;
  4. Algorithms, to develop solutions to computational problems;
  5. Programming, the enabler of our dreams of solutions and the way that we turn algorithms into solution – the basis of our expression;
  6. Internet, the ties that bind all modern computing together; and
  7. Impact, the fact that Computing can, and regularly does, change the world.

I think that I’m going to refer to these with the NSF Grand Challenges as part of my new Grand Challenges course, because there is a lot of similarity. I’ve nearly got the design finished so it’s not too late to incorporate new material. (I don’t like trying to rearrange courses too late into the process because I use a lot of linked assessment and scaffolding, it gets very tricky and easy to make mistakes if I try and insert a late design change.)

For me, the first and the last ideas are among the most important. Yes, you may be able to plod your way through simple work in computing but really good solutions require skill, practice, and creativity. When you get a really good solution or approach to a problem, you are going to change things – possibly even the world. It looks like someone took the fundamentals of computing and jammed together between two pieces of amazing stuff, framing the discipline inside the right context for a change. Instead of putting computing in a nerd sandwich, it’s in an awesome sandwich. I like that a lot.

It turns out that there are a lot of images when you search for “Awesome Sandwich”.

Allowing yourself to be creative, understanding abstraction, knowing how to put data together, working out to move the data around in the right ways and then coding it correctly, using all of the resources that you have to hand and that you can reach out and touch through the Internet – that’s how to change the world.

 

Last Lecture Blues

Posted: June 7, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , | Leave a comment

I delivered the last lecture, technically the review and revision lecture, for my first year course today. As usual, when I’ve had a good group of students or a course I enjoy, the relief in having reduced my workload is minor compared to the realisation that another semester has come to an end and that this particular party is over.

Hellooooo???

Today’s lecture was optional but we still managed to get roughly 30% of the active class along. Questions were asked, questions were discussed, outline answers were given and then, although they all say and listened until I’d finished a few minutes late, they were all up and gone. The next time I’ll see most of them is at the exam, a few weeks from now. After that? It depends on what I teach. Some of these students I’ll run into over the years and we’ll actually get to know each other. Some may end up as my honours or post-graduate students. Some will walk out of the gates this semester and never return.

Now, hear me out, because I’m not complaining about it, but this is not the easiest job in the world. Done properly, education requires constant questioning, study, planning, implementing, listening, talking and, above all, dealing with the fact that you may see the best student you ever have for a maximum of 6 months. It is, however, a job that I love, a job that I have a passion for and, of course, in many ways it’s a calling more than a job.

One of the things I’ve had a chance to reflect on in this blog is how much I enjoy my job, while at the same time recognising how hard it is to do it well. Many times, the students I need to speak to most are those who contact me least, who up and fade away one day, leaving me wondering what happened to them.

At the end of the semester, it’s a good time to ask myself some core questions and see if I can give some good answers:

  1. Did I do the best job that I could do, given the resources (structures, curriculum, computers etc) that I had to work with?
  2. Did I actively seek out the students who needed help, rather than just waiting for people to contact me?
  3. Did I look for pitfalls before I ran into them?
  4. Did I look after the staff who were working with or for me, and mentor them correctly?
  5. Did I try to make everything that I worked with an awesome experience for my students?

This has been the busiest six months of my life and one of my joys has been walking into a lecture theatre, having written the course, knowing the material and losing myself in an hour of interactive, collaborative and enjoyable knowledge exchange with my students. Despite that, being so busy, sometimes I didn’t quite have the foresight that I should had had and my radar range was measured in days rather than weeks. Don’t get me wrong, everything got done, but I could have tried to locate troubled students more actively, and some minor pitfalls nearly got me.

However, I think that we still delivered a great course and I’m happy with 1, 4 and 5. I aimed for awesome and I think we hit it fairly often. 2 and 3 needed work but I’ve already started making the required changes to make this better.

On reflection, I’d give myself an 8ish/10 but, of course, that’s not enough. Overall, in the course, because of the excellent support from my co-lecturer and my teaching staff, the course itself I’d push up into the 9-pluses. I, however, should be up there as well and right now, I’m too busy.

So, it’s time for some rebalancing into the new semester. Some more structure for identifying problems students. Looking at things a little earlier. And aiming for an awesome 10/10 for my own performance next semester.

To all my students, past and present, it’s been fantastic. Best of luck with your exams!

The Shortest Distance Between Two Points Is The Internet

Posted: June 5, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , | 2 Comments

MY CHEESE!

I’ve been noticing a slight upwards trend in readership, as I’ve previously noted. On Friday, however, the readership exploded. 209 views on Friday, 259 views on Saturday. (Normally, I’m lucky to get a third of that.) One person, who obviously needs some help, viewed 99 things in one hour. (Even I’ve never done that.)

It was pretty obvious that something had happened but the other shoe didn’t drop until today, when a comment confirmation request came in. I’d been mentioned in a radio show and podcast for electronics enthusiasts and professionals – The Amp Hour!

Dave Jones had found my post on the bra ad that managed to combine sexism and insulting engineers and had, in his own words, been dismayed by it. His comment, and a link on the website, and suddenly I have some (quite possibly heavily confused) people reading my blog and wondering what they’d wandered into.

I saw the comment confirmation request, followed it back, commented, Dave responded, loop closed.

Except, of course, for how amazingly cool it is that something I wrote about an issue that bothered me found someone else, who it also bothered, who mentioned it, which sent people to me, which sent me to him, and then we basically met up in the corridor, nodded at each other and said “Hi”.

Of course, this would be far more impressive if Dave was in Antarctica, but he’s actually in Sydney. He went looking for stuff about the ad because he saw it and it bugged him – and he found my blog.

But this is still pretty cool. We’re a thousand kilometres apart (or so) and we’ve both agreed that the ad is rubbish. Twenty years ago, we would have had to have met or one of us would have had to write an article that got published on paper and distributed to me. I certainly wouldn’t know about Dave’s expertise in Internet Dating (seriously?) or passion for geocaching.

This is the world that that I have to prepare my students for. A world where their comments, good or bad, can travel for thousand of kilometres. A world where presence doesn’t have to mean physical presence. Of course, as educators, that applies to our classrooms and spaces as well. Our world does not have to be bricks and mortar, bench seats and blackboards.

We’re trying to make connections: knowledge, ideas, people, the future. We already appear to have the infrastructure to do it – do we have all of the right tools and the drive and vision to realise it?

I have no idea but I hope that we do. In the meantime, I’ll be over here, looking at the walls and thinking about the shortest distance between two points.

Eating Your Own Dog Food (How Can I Get Better at Words with Friends?)

Posted: June 4, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , , , , , | 1 Comment

I am currently being simultaneously beaten in four games of Words with Friends. This amuses me far more than it bugs me because it appears that, despite having a large vocabulary, a (I’m told) quick wit and being relatively skilled in the right word in the right place – I am rather bad at a game that should reward at least some of these skills.

One of the things that I dislike, and I know that my students dislike, is when someone stands up and says “To solve problem X, you need to take set of actions S.” Then, when you come to X, or you find that person’s version of a solution to X, it’s not actually S that is used. It’s “S-like” or “S-lite” or “Z, which looks like an S backwards and sounds like it if you’re an American with a lisp.”

There’s a term I love called “eating your own dog food” (Wikipedia link) that means that a company uses the products that it creates in order to solve the problems for which a customer would buy their products. It’s a fairly simple mantra: if you’re making the best thing to solve Problem X, then you should be using it yourself when you run across Problem X. Now,of course, a company can do this by banning or proscribing any other products but this misses the point. At it’s heart, dogfooding means that, in a situation where you are free to choose, you make a product so good that you would choose it anyway.

It speaks to authenticity when you talk about your product and it provides both goals and thinking framework. The same thing works for education – if I tell someone to take a certain approach to solve a problem, then it should be one that I would use as well.

So, if a student said to me “I am bad at this type of problem,” I’d start talking to them to find out exactly what they’re good and bad at, get them to analyse their own process, get them to identify some improvement strategies (with my guidance and suggestions) and then put something together to get it going. Then we’d follow up, discuss what happened, and (with some careful scaffolding) we’d iteratively improve this as far as we could. I’d also be open to the student working out whether the problem is actually one that they need to solve – although it’s a given that I’ll have a strong opinion if it’s something important.

So, let me eat my own dog food for this post, to help me get better at Words with Friends, to again expose my thinking processes but also to demonstrate the efficacy of doing this!

Step 1: What’s the problem?

So, I can get reasonable scores at Words with Friends but I don’t seem to be winning. Words with Friends is a game that rewards you for playing words with “high value” tiles on key positions that add score multipliers. The words QATS can be worth 13 or 99 depending on where it is placed. You have 7 randomly selected tiles with different letters, and a range of values for letters in a 1:1 association, but must follow strict placement and connection rules. In summary, a Words with Friends game is a connected set of tiles, where each set of tiles placed must form a valid word once set placement is complete, and points are calculated from the composition and placement of the tiles, but bonus spaces on the board only count once. The random allocation of letters means that you have to have a set of strategies to minimise the negative impact of a bad draw and to maximise the benefit of a good draw. So you need a way of determining the possible moves and then picking the best one.

Some simple guidelines that help you to choose words can be formed along the lines of the number of base points by letter (so words featuring Q, X or J will be worth more because these are high value letters), the values of words will tend to increase as the word length increases as there are more letters with values to count (although certain high value letters cannot be juxtaposed – QXJJXWY is not a word, sadly), but both of these metrics are overshadowed by the strategic placement of letters to either extend existing words (allowing you to recount existing tiles and extending point 2) or to access the bonus spaces. Given that QATS can be worth 99 points as a four-letter word if played in the right place, it might be worth ignoring QUEUES earlier if think you can reach that spot.

Step 2: So where is my problem?

After thinking about my game, I realised that I wasn’t playing Words with Friends properly, because I wasn’t giving enough thought to the adversarial nature of the occupancy of the bonus spaces. My original game was more along the lines of “look at letters, look at board, find a good word, play it.” As a result, any occupancy of the bonus spaces was a nice-to-have, rather than a must-have. I also didn’t target placement that allowed me to count tiles already on the board and, looking at other games, my game is a loose grid compared to the tight mesh that can earn very large points.

I’m also wasn’t thinking about the problem space correctly. There are a fixed number of tiles in the game, with known distribution. As tiles are played, I know how many tiles are left and that up to 14 of them are in my and my opponent’s hand. If I know how many tiles there are of each letter, I can play with a reasonable idea of the likelihood of my opponent’s best move. Early on, this is hard, but that’s ok, because we can both play in a way that doesn’t give a bonus tile advantage. Later on, it’s probably more useful.

Finally, I was trying to use words that I knew, rather than words that are legal in Words with Friends. I had no idea that the following were acceptable until (at least once out of desperation) I tried them. Here are some you might (nor might now) know: AA, QAT, ZEE, ZAS, SCARP, DYNE. The last one is interesting, because it’s a unit of force, but BRIX, a unit used to measure concentration (often of sugar) isn’t a legal word.

So, I had three problems, most of which relate to the fact that I’m more used to playing “Take 2” (a game played with Scrabble tiles but no bonus spaces) than “Scrabble” itself, where the bonus spaces are crucial.

Step 3: What are the strategies for improvements?

The first, and most obvious, strategy is to get used to playing in the adversarial space and pay much closer attention to which bonus spaces I leave open in my play and to increase my recounting of existing tiles. The second is to start keeping track of tiles that are out and play to the more likely outcome. Finally, I need to get a list of which words are legal in Words with Friends and, basically, learn them.

Step 4: Early outcomes

After getting thrashed in my first games, I started applying the first strategy. I have since achieved words worth over 100 points and, despite not winning, the gap is diminishing. So this appears to be working.

The second and the third… look, it’s going to sound funny but this seems like a lot of work for a game. I quite like playing the best word I can think of without having to constrain myself to play some word I’m never going to actually use (when we’re up to our elbows in aa, I will accept your criticism then) or sit there eliminating tiles one-by-one (or using an assistant to do it). Given that I’m not even sure that this is the way people actually play, I’m probably better off playing a lot of games and naturally picking up words that occur, rather than trying to learn them all in one go.

Of course, if a student said something along the last lines to me, then they’re saying that they don’t mind not succeeding. In this case, it’s perfectly true. I enjoy playing and, right now, I don’t need to win to enjoy the game.

Just as well really, I think I’m about to lose four games within a minute of each other. That’s four in a row – pity, if there were three of them I could do a syzygy joke.

Step 5: Discussion and Iteration

So, here’s the discussion and my chance to think about whether my strategies need modification to achieve my original goal. Now, if I keep that goal at winning, then I do need to keep iterating but I have noticed that with a simple change of aiming more a the bonuses, I get a good “Yeah” from a high points word that probably won’t be matched by winning a game.

To wrap up, having looked at the problem, thought through it and make some constructive suggestions regarding improvement, I’ve not only improved my game but I’ve improved my understanding and enjoyment of the activity. I feel far more in control of my hideous performance and can now talk to more people about other ways to improve that maintain that enjoyment.

Now, of course, I imagine that a million WwF players are going to jump in and say “nooooo! here’s how you do it.” Please do so! Right now I’m talking to myself but I’d love some guidance for iterative improvement.

It is an amazing day.

Posted: June 2, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , | Leave a comment

Today marks the start of my sixth month of blogging. It is also the day after my largest number of hits, my most ‘viewed’ month and my my most ‘viewed’ week. Thank you to everyone who has visited and all of those of you who have taken the time to comment! It is amazing, in many ways, how ordinary a day this is to me, given how much is going on. But, of course, every day is amazing because every day is a new day. There is always the chance to do something new, something different, something wonderful.

Someone else thought that this was what an amazing day looked like. I agree!

I have tried to share my own progress in terms of understanding key concepts of learning and teaching, as a student, as a practitioner, and as a person. I can only hope that some of the people who have stumbled across this blog have found something useful here. (Sorry to the people who were looking for Page 3 girls.)

Analysing the searches that brought people here has, as I’ve previously noted, been somewhat sad as “alone in the crowd” is still the biggest draw. I worry because if you are looking for words to live by, this may not be the place to find the words that keep you alive. So, if your searches bring you here as well, I can only hope that you find what you need.

The word ‘hope’ springs up a lot in my writing. It’s a standard English form (I hope that you are well) but, for me, it is more than that. I have a great hope for the future – I would have difficulty doing my job if I did not. Every semester, I get to see a new group of students, some of whom I may know, and we start again. Knowledge, learning, hope.

For no other reason than that, the hope of something better, the hope of something brighter, and the hope that I may be helping to illuminate the way ahead – it is an amazing day.

Thoughts from the house of enquiry.

Posted: June 1, 2012 | Author: | Filed under: Education, Opinion | Tags: , , , , , , , , , , , , , | 1 Comment

Today we renamed the building that is at the heart of the Faculty of Engineering, Computer and Mathematical Sciences. The new name for our new eight-storey, highly efficient and environmentally sustainable building, only 18 months old, is Ingkarni Wardli. This name comes from the original custodians of the land upon which the University is built, the Kaurna people, one of the indigenous people of Australia. The name means “place of learning or enquiry” but another reading of the name is “house of enquiry“, which is my favourite.

Ingkarni Wardli
The University of Adelaide

At today’s ceremony, there were the usual speeches that ones would expect at an event of this nature but the big difference for me was the sincerity and genuine recognition that accompanied the renaming. The Kaurna people are extremely pleased to have a building named in this way, and that it is this building, because they value education and enquiry and place a strong emphasis in local cultural and educational leadership. Our Executive Dean, Professor Peter Dowd, has been strongly committed to this for some time and, to do it properly, it has taken some time. (Our Vice Chancellor, Professor James McWha, has made our reconciliation week events, recognising the custodianship and contribution of the indigenous communities, a significant part of our University culture for over a decade, and has also been strongly supportive of this initiative.)

Why did it take time? Because it would have been easy to do it quickly and get it wrong. The unthinking or uninformed use of words from another language are the source of much derision on the Internet and there are even web sites devoted to it. (Don’t even ask about that unfortunate town in Europe whose name is an obscenity in English.) It would have been easy to drag together a few smatterings of language from various peoples across the region, or from the larger groups in the East of Australia, and jam this name on to the building.

Of course, it would have been a meaningless and empty gesture – potentially even insulting in its ignorance – while giving a number of people that nice warm feeling that they had used a ‘native’ name.

I work at a University. Knowledge is our business. To be more precise, the correct use of knowledge is our business. For us, this would have been far worse than launching a Nova car in a Spanish speaking country – this would have revealed us to be shallow and insular, uncaring and insensitive. Ignorant.

So it took a while. We approached the Kaurna community and quickly discovered that our original suggestion was a word that made no sense by itself – it had to be combined with another word to become a sensible phrase. Approval was sought and granted. Plans were made. Signage was changed. Today, however, the building’s name actually changed. From now on, it is Ingkarni Wardli.

I felt privileged to be a part, even in a very minor way, in today’s ceremony. The Dean’s speech emphasised the importance of the name, why we had chosen it and how it brought our cultures together. He made a point that there are many synonyms for recognition but that the two most common antonyms are ignorance and forgetfulness. By recognising the Kaurna people and asking them for a name, to work with us on providing a name, we show our awareness, our remembrance and our knowledge of their presence in the past and in the present. The representatives of the Kaurna, among them a senior Kaurna elder who gave a wonderful speech, and other peoples present clearly felt recognised, acknowledged and remembered and this cemented the importance of the ceremony. This was not a segregated event – it was all of us together, bound by our love of learning and knowledge. Seekers all, together.

I have, with some regret, seen people sniping at the name, pulling faces, making comment about how long it took, even suggesting that no-one would use the name. To them, I say, grow up. Our students learn from us (the good and the bad things we do) and we have no time for such facile and, ultimately, useless gestures. If you genuinely want to change the name, state your case, make a stand and work to change it. If not, then start using it without the eye-rolling or deliberate mis-pronunciation. Names change all the time, for far less significant reasons than this. To snipe at a name just because of the race of the people it came from? I’m sure that there’s a word for that – and it’s not one that I would ever want to see associated with someone involved in the formation of new people and the development of emerging thinkers.

There are great divides between many cultures and it is rare to be able to find a bridge that connects two disparate cultures in a way that aligns their most treasured characteristics. The naming of our new building is a bridge between the learning culture that we all value at our University and the learning culture so valued, and recognised, by the Kaurna people.

This is a good name. I look forward to using it.

Codes of Conduct: Being a Grown-Up.

Posted: May 31, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , | Leave a comment

I always hope that my students are functioning at a higher level, heading towards functional adulthood, to some extent. After all, if they need to go to the bathroom, they can usually manage that in a clean and tidy manner. They dress themselves. They can answer questions. So why do some of them act like children when it comes to good/bad behaviour?

I searched for “adult child” and found this. I think Craig Ferguson should sue.

I was reading Darlena’s blog post about one of Rafe Esquith’s books and she referred to Rafe’s referral to Kohlberg’s Six Levels of Moral Development, which I ‘quote-quote’ here:

  1. I do not want to get into trouble.
  2. I want a reward.
  3. I want to please someone.
  4. I always follow the rules.
  5. I am considerate of other people.
  6. I have a personal code of behaviour.

I’ve been talking around these points for a while, in terms of the Perry classifications of duality, multiplicity and commitment. What disappoints me the most is when I have to deal with students who are either trying not to get into trouble or only work for reward – and these are their prime motivations. There’s a world of difference between having students who do things because they have worked through everything we’ve talked about and decided to commit to that approach (step 6 in this scale) and those who only do it because they feel that they will get punished if they don’t.

I always say that I expect a lot of my students and, fairly early on, I do expect them to have formed a personal code of conduct. Yes, I expect them to be timely in their submissions, but because they understand that assignment placement is deliberate and assists them in knowledge formation. Yes, I expect them to not plagiarise or cheat, but because to do so deprives them of learning opportunities. I expect them not to talk in class because they don’t want to deprive other people of learning opportunities (which is a bit of points 5 and 6).

I press this point a lot. I say that I reward what they know, as long as it’s relevant, rather than punishing them for getting things wrong. I encourage them to participate, to be aware of other people, to interact and work with me to make the knowledge transfer more effective – to allow them to construct the mental frameworks required to produce the knowledge for themselves.

I really don’t think it’s good enough to say “Well, students always do X and what can you do?” I have a number of people in my classes who have discovered, to their mounting amazement, that I basically won’t accept behaviour that doesn’t meet reasonable standards. I mean what I say when I say things and I don’t change my mind just because someone asks me. I’m tough on plagiarism and cheating. I don’t let people bully me or other people. And, amazingly, I don’t see many of these behaviours in my class.

I encourage a constructive and positive approach for all of my students – but the basis of this is that they have to establish a personal code of conduct that I can work with. If they go down this path, then everything else tends to follow and we can go a fantastic educational journey together. If they’re still stuck, doing the minimum they can get away with, because they don’t want to get yelled at, then my first (and far more difficult) task is to reach them, try and get them to think beyond using this as their only motivator.

Now, of course, the golden rule is that if you want a student to do something, then giving marks for it is the best way to go – and that’s a technique I use, and I’ve discussed it before. But it’s never JUST the marks. There’s always  reward in terms of scaffolding, or personal satisfaction, or insight. I want fiero! I also don’t want the students to do things just because I ask them to, because they want to please me. I have a middling amount of lecturing charisma but I’m always aware that I have to be content first/showmanship second. If I do that, then students are less likely to fall into the trap of trying to do things just because I ask them to.

I’m really not the kind of teacher who needs an apple on the desk. (I already have two iMacs and a MacBook Air. Ba-dum-*ting*)

Number 4 is one that I really want to steer people away from. Yes, rules should be followed – except where they shouldn’t. You may not know this but it is completely legitimate for a solider in the Australian Army to refuse to follow an illegal order. (Yes, it will probably not go very well but it’s still an option.) If a soldier, who is normally bound by the chain of command to follow orders, believes the order to be illegal (“No prisoners” being one of them) they don’t have to follow it. Australian soldiers are encouraged to exercise discretion and thought because that makes them better soldiers – they can fill in the blanks when the situation changes and potentially improve things. The price, of course, is that a thinker thinks.

Same for students. I want students who change the world, who make things better, who may occasionally walk on the grass to get to that bright new future even when the signs say ‘stay off the grass’. However, without a personal code of conduct, which rules you can bend or break are going to be fairly arbitrarily selected and are far more likely to have a selfish focus. We want rule bending in the face of sound ethics, not rationalisation.

As I said, it’s a lot to ask of students but, as I’ve always said, if I don’t ask for it, and tell people what I want, I can’t expect it and I certainly can’t build on it.

Triage for Cheating and Plagiarism

Posted: May 30, 2012 | Author: | Filed under: Education | Tags: , , , , | 3 Comments

Triage is a process used in hospitals where a patient’s condition is assessed and this assessment is used to assign them a priority. The term, and the practice, originally comes from battlefield medicine where patients were sorted into:

  • those who were going to live, regardless of what doctors did
  • those who were going to die, regardless
  • those who might live if they received immediate attention

You’ll notice that there are three basic categories but the word triage isn’t a reference to the three categories (tri), it’s a French word that just refers to selection or separation, based on quality. (The first use of triage stems from a basis in the Napoleonic wars and the work of French doctors in the Great War.)

Lest We Forget.

Battlefield medicine is hard medicine in many respects. Under-resourced, extreme injuries, a requirement to maintain fighting power because it might stop your own position from being overrun – it’s incredibly stressful. You’ve all seen triage in M*A*S*H episodes, no doubt, where the doctors try and group the injured into the ones that need them straight away, the ones who will probably need a patch-up later and the ones that no-one can save.

The core of triage is that, with limited resources, you have to select where to apply them or you risk wasting your effort. It’s pretty unemotional stuff.

I’ve spent a lot of time looking at student plagiarism activity. I’ve been involved in teaching for a long time now and I spent a few years as an Assessment and Examinations co-ordinator, which meant that every single plagiarism case went by me. One of the things about plagiarism and cheating detection is that it is resource intensive. If I’m going to carry out a systematic program to reduce and detect plagiarism, I’m going to have to:

  1. Have strong policies in place that I adhere to, from the institutional level, for consistency.
  2. Refresh and alter all of my assignments, every year, to reduce any incentive to re-use a previous assignment.
  3. Brief my students and tell them that I’m serious about plagiarism.
  4. Apply detection methods to every submission (to detect global plagiarism or cheating).
  5. Check every submission against every other submission (to detect local plagiarism or cheating).
  6. Investigate every case that triggers my detection threshold.
  7. Prepare all of the evidence that is required for a hearing.
  8. Attend the hearing and present the evidence.
  9. Incorporate any changed marks, do any follow-up, counsel the student.

Now, 1, 2, 3 and 4 are either things that I should be doing anyway or, in the case of 4, I can make the students involved in their own process (by telling them to submit their work and a Turnitin report, for example). Number 5 is actually hard because comparing all assignments to each other has a large burden associated with it. As you add assignments, the amount of checking required is given by the square of the total number. (So, if the number of assignments is n, the checking burden increases proportional to n*n. For those who are curious, it’s because the number of edges in a complete graph with n nodes is given by (n(n-1)/2).)

From 6 onwards, the load on me is proportional to the number of students that I catch. If 1-3 have had any effect, and I’m serious about 4 and 5, then 6-9 should actually be for a far smaller number of students. But there are two big “if”s in there and, I know from experience, not everyone takes the same approach to plagiarism that I do, for a range of reasons.

But let’s drill down into the types of plagiarism and cheating I’m talking about. Plagiarism can be as ‘light’ as forgetting to add a reference (not attributing work correctly) or as ‘heavy’ as handing up someone else’s essay with your name on it (or a similar net-sourced equivalent). Cheating is a different beast in many ways and can be harder to define, but carrying illicit notes into exams is an obvious one, as is obtaining a solution guide outside of legitimate channels. These days, of course, we have an entirely new form of work avoidance – work for hire. A student can submit a piece of work that is original and yet it is not their own work, as they have paid someone else to do it. Similarly, they could ostensibly pay someone else to sit an exam for them.

At this stage, my detection efforts in 4 and 5 start to fall apart. I have no way to detect work-for-hire as it can’t be determined by comparison. If someone else studies for the exam and shows up, and we don’t detect it, then we won’t get the usual cues that indicate that other materials have been brought in.

Now, of course, we build our courses so that assignments interlock with knowledge, supporting the student’s development, and we also test things in different ways. For example, my first year course has in-class quizzes, programming assignments, tutorials and on-line quizzes that test the same things in different ways. We then have an exam that tests understanding over everything else, including coding and theory. To cheat across the whole thing would require a quite systematic approach to cheating – you would have to be fairly well organised to arrange for successful work-for-hire or cheating across the entire course. Which brings me to my point.

I believe that students who plagiarise or cheat fall into roughly three categories:

  1. Students who are sloppy or careless, which explains things like not attributing some text occasionally, or who drop the odd bit of code in from the internet because they’re being lazy. These students, with policy framing and reminders from me, are not really a high risk in terms of cheating. In triage terms, these are the ones who are going to live so I can put a little effort in here but it’s mostly structural and self-sustaining.
  2. Students who get rushed and panic – then start doing stupid things like copying code from other students wholesale, or copying large slabs of text. They start late, don’t prepare properly, panic, and rush for something rather than a legitimate 0. These are the students who  need to be found, counselled, and retrained in better practices so that they use their time more effectively. Rather than being lazy and accidental plagiarists, they are intentional but opportunistic plagiarists. These are the students who I can bring back to life with enough effort.
  3. Finally, we have the students who have made plagiarism and cheating a part of their success plan. They build in timeframes for work-for-hire, scour sources for illicit advantage, spend four hours writing cheat notes for an exam rather than studying. This is pre-meditated and systematic cheating and, despite everything I say, I’m unlikely to reach these students.

Now, whenever I detect someone cheating or plagiarising, they’re going to get the full process as defined – steps 6-9, regardless of which of the student categories they’re in. But how I deal with them to bring them back will vary from group to group. The only problem is that I have limited time. I have to conduct triage to work out who I can bring back and where I can spend my effort most usefully.

I don’t know if there’s any heresy in this but I believe that my duty lies to the majority of my students and the ones for whom I can achieve the best results. The Group 1s (accidental) will be woken up if they get caught but careful policy framing, education and changing assignments will deal with most of them in advance. The Group 2s (opportunistic) need shepherding and feedback, positive reinforcement and encouragement to stay righteous. They’ll take a lot of effort but the net result may be good. Group 3… if I have any time left, I might try and work with Group 3 but how can I? They have set a path which includes cheating as a definitive strategy for success. I’m not sure they’re going to do anything other than nod solemnly at me and snicker behind my back.

Worse, Group 3 may have been formed this way by experience, by systems that encourage this behaviour, or by academics who slyly ignore the early signs of cheating. Group 3 students may have taken years to solidify into this form and my 6-month exposure to them is a brief inconvenience in their overall plan to achieve graduate status through other people’s effort.

We make a distinction in our society between murder and manslaughter, because pre-meditation makes a difference. Group 3, pre-meditated cheating, is easier to define if we accept that “work-for-hire”, “solution scraping”, “organising someone to sit the exam” all require a deliberate and concentrated effort to subvert our academic quality requirements. Perhaps Group 3 even get a different set of outcomes from plagiarism detection? Usually, we’d give a student 0 for the assignment when first detected, 0 for the entire course on second detection and it escalates from there. Group 3 have set out on a deliberate path and we have (unfortunately) probably only detected a fraction of what they’ve done, especially if work-for-hire is involved. If we detect work-for-hire should this be an immediate course-level failure, given that it is so obviously a core part of their strategy? Is there such a thing as an opportunistic “work-for-hire” retainer?

But, as it stands, Group 3 are those students must likely to not benefit positively from my intervention. I think, with regret, I’m going to have to leave them until last and hope that I have enough effort left over after dealing with everyone else to do something about them.

Of course, the dead in a battlefield situation aren’t actually ignored, they’re buried. To be more precise, they’re passed to another group of people who attend to their needs at a different pace. So, a more positive view of group 3 is that they are taken out of my load and moved to somewhere where they can be dealt with more appropriately. This is where a good Transitions and Advisory Service can come in but, obviously, there will be a lot of effort required to get some students back from an engrained and systematic pattern of negative behaviour. But there are benefits to centralisation of resources and this may be somewhere that, rather than burying the dead, we look after them for a while to see if there’s any chance, any remaining spark of life, even though the surgeons didn’t have enough time on their first pass.

I have no real solutions here but I’d be interested to see the discussion. Can we actually make these distinctions clearly? Do we risk moving students into other categories if we change outcomes based on what we detect? Can I make such a clear distinction based on what I detect or am I being unfair?

Right now, I’m trying to be as rigorous about 1-5 as I can, going to 6-9 when I have to, and building my courses so that there’s enough interlock that it deters everyone except the most dedicated and systematic cheat from trying to use work-for-hire. That’s probably the best use of my time and I hope it gives the best results in terms on knowledge and the student experience.

Rush, Rush: Baby, Please Plan To Submit Your Work Earlier Than The Last Minute

Posted: May 29, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , , , , , | 4 Comments

Sorry, Paula Abdul, but I had to steal a song lyric from you.

AND MANGLE IT!

This is the one of the first pictures that comes up when you search for ‘angry Paula Abdul”. Sorry, Lamar.

I’ve been marking the first “process awareness” written report from my first-year students. A one-page PDF that shows their reflections on their timeliness and assignment performance to date and how they think that they can improve it or maintain it. There have been lots of interesting results from this. From about 100 students, I’ve seen many reports along the lines of “I planned, I assigned time, SO WHY DIDN’T I FOLLOW THE PLAN?” or “Wow, I never realised how much I needed a design until I was stuck in the middle of a four-deep connection of dynamic arrays.”

This is great – understanding why you are succeeding or failing allows you to keep doing the things that work, and change the things that don’t. Before this first-year curriculum restructure, and this course, software development process awareness could avoid our students until late second- or third-year. Not any more. You got run over by the infamous Library prac? You know, you should have written a design first. And now my students have all come to this realisation as well. Two of my favourite quotes so far are:

“[Programming in C++] isn’t hard but it’s tricky.”

and

“It’s not until you have a full design [that you can] see the real scope of the project.”

But you know I’m all about measurement so, after I’d marked everything, I went back and looked at the scores, and the running averages. Now here’s the thing. The assignment was marked out of 10. Up until 2 hours before the due date, the overall average was about 8.3. For the last two hours, the average dropped to 7.2. The people commenting in the last two hours were making loose statements about handing up late, and not prioritising properly, but giving me enough that I could give them some marks. (It’s not worth a lot of marks but I do give marks for style and reflection, to encourage the activity.) The average mark is about 8/10 usually. So, having analysed this, I gave the students some general feedback, in addition to the personalised feedback I put on every assignment, and then told them about that divide.

The fact that the people before the last minute had the marks above the average, and that the people at the last minute had the marks below.

One of the great things about a reflection assignment like this is that I know that people are thinking about the specific problem because I’ve asked them to think about it and rewarded them with marks to do so. So when I give them feedback in this context and say “Look – planned hand-in gets better marks on average than last-minute panic” there is a chance that this will get incorporated into the analysis and development of a better process, especially if I give firm guidelines on how to do this in general and personalised feedback. Contextualisation, scaffolding… all that good stuff.

There are, as always, no guarantees, but moving this awareness and learning point forward is something I’ve been working on for some time. In the next 10 days, the students have to write a follow-up report, detailing how they used the lessons they learnt, and the strategies that they discussed, to achieve better or more consistent results for the next three practicals. Having given them guidance and framing, I now get to see what they managed to apply. There’s a bit of a marking burden with this one, especially as the follow-up report is 4-5 pages long, but it’s worth it in terms of the exposure I get to the raw student thinking process.

Apart from anything else, let me point out that by assigning 2/10 for style, I appear to get reports at a level of quality where I rarely have to take marks away and they are almost all clear and easy to read, as well as spell-checked and grammatically correct. This is all good preparation and, I hope, a good foundation for their studies ahead.

Different Eyes, Different Lenses

Posted: May 28, 2012 | Author: | Filed under: Education | Tags: , , , , , | Leave a comment

I have almost given up discussing movies with other people. My wife and I have very similar tastes in movies, to a point, but we differ wildly on the horror spectrum (I don’t mind comedy horror that much and she’s most definitely not a fan). But I’m starting to realise that the lens through which I see film is one that is sufficiently different that I look like a bit of an alien. It would be glib to make some sort of generalisation about the films that I like or don’t, but they’d almost certainly miss the point. Let’s just say that I am very demanding of the movies that I see and books that I read, because, that way, when you read on, if you disagree with me then you can just assume that I’m too pedantic or just picky for my own good.

Of course, I don’t think I am. It’s just that I look at the world through my own eyes and what I see is what I see.

If I told you that I enjoyed Alien, Blade Runner, Terminator 1, 2, 3, and 2001, you’d probably try and classify me as a Sci-Fi buff – except that I loathed the Planet of the Apes re-remake and the Star Trek reboot. You might be surprised that I found the Lord of the Rings trilogy to be overlong and dull, badly extended and not always changed for the better, then it would be easy to leap to conclusions regarding “book-centric” snobbery. Except, of course, for my enjoyment of “Do Androids Dream…” and “Blade Runner” as separate entities. Same goes for the 2001/”Sentinel”, “Clockwork Orange” film/book – I can and do appreciate works in different areas where inspiration overlaps and the stories change. When it comes to new stories, there’s so much scope to do interesting things and, sadly, so frequently nothing happens that’s really excellent. As an example, “Inception” leaves me cold (well, except for Tom Hardy, his character could have done a lot more). A nice idea, well put together, but a pale shadow of what it could have been in comparison to the work of Dick, Moorcock, Le Guin…

So what else do I like in movies or am I some fearsome film snob? I love almost all films that Bill Murray is in. “Groundhog Day” because he realises what he loves and finally gets the chance to find his way back, “Life Aquatic” because he shows such a clear picture of what it’s like to be heading out towards the far reaches of late middle age, “Lost in Translation” because I’ve spent too many half-forgotten sections of my life floating through the hyperspace in hotel transit (but, no, I’ve never hooked up with Scarlett Johansson or Catherine Lambert). I like “Ladyhawke”, think that “Captain America” had something special about it, enjoyed “Thor” and laughed  and was into it through “Iron Man” – 1, 2 and “The Avengers”. I have watched the new Sherlock movies multiple times and have seen Battlefield LA twice. Yes, I’ve watched a lot of foreign and art film – but I watch a heck of a lot of other mainstream cinema and love it.

I’m not sure I get to call myself a film snob when I have a soft spot for “Dracula AD 1972” or “Quatermass and the Pit”. And, yet, I can’t stand the “give up if it gets too hard” message of “Toy Story III” and, the reason for this post, I really didn’t enjoy the movie “Hugo”.

What interested me, when I posted about how much I disliked Hugo, a couple of my friends immediately jumped in and one asked me if I’d been grumpy when watching it and the other said that the kids had better stay off my lawn.

The very simple explanation is that we don’t all see the world the same way. We don’t see the same movie and react to the same triggers. The elements, the composition, the theme – I rarely watch movies on the big screen as I prefer to see the movie without being overwhelmed by it. (Ok, I saw Avengers on the big screen but how could I not?) What always interests me is the thought that I would or should see things the same way? It’s not as if we all have to be in love with the same person, or all have the same favourite foods.

One of the reasons that I think I work well with students is that I understand and believe that everyone sees the world in a different way. That my students’ view of the things that I teach them travels through their own filters, having made it out of my head through my own filters, and travelling through a transmission medium that also casts a smoky lens over them. If I go out and, in my head, think that I have 100 copies of the same person to talk to, then I have lose 99 of the people in the room.

There are many people who are going to tell my students that they are wrong, when they are being different. My students are going to be questioned, dismissed and insulted for trying to create new things, for having opinions that are their own.

My opinions on movies are worth little, because they matter (or should matter) to no-one else except those who find them useful. But they are a reminder that my way of looking at the world, and my recognition that my students will be different from me in new and amazing ways, are an essential part of what makes me a good teacher.

← Older Entries
Newer Entries →