HERDSA 2012: What is the New Academy?

Posted: July 4, 2012 | Author: | Filed under: Education, Opinion | Tags: , , , , , , , , , , , , , , | Leave a comment

I attended some (more) interesting talks today on building research capacity, how we build the connection between education and research (the dreaded research-teaching nexus) and how we identify ourselves as academics. If I were going to summarise all three of these talks, it would be as:

How are we defining the Academy of the 21st Century?

There is no doubt that research is a crucial component of what we do – you can’t even be registered as a University in Australia unless you pursue research – but it often seems to be the favoured child in any discussion of importance for promotion and allocation of serious resources. Now I realise that a lot of work is going into fixing this but research has, for many years, counted for more.

So it’s interesting that, as Winthrop Professor Shelda Debowski, UWA, observed after returning from her Churchill Fellowship, we don’t really bother to do as much training as we should for research. Research success doesn’t automatically flow from finishing a PhD, any more than a PhD is an indication of readiness or aptitude to teach – yet many early researchers don’t get a great deal of development assistance. This leads, in some cases, to what Debowski refers to as middlescence: a great PhD but after 5+ years it all dies.

Succesful research requires many capabilities and ongoing learning and, while our universities try to support this, we’re not often sure what the best way is to support this. Staff are seeking guidance – research leaders are keen to help. How can we connect them usefully and efficiently? For me, I rephrase the question as:

How are we defining the Research Academy of the 21st Century?

Research is a simple world with a complex set of concepts behind it. Are we looking at the basis of inputs, outputs, strategy and impact? Are we looking at industrial interaction with collaboration, engagement and support? Are we being productive and effective, innovative and creative? There is, for many people’s careers, not much room for failure.

The PhD used to be all that was needed, in theory, because we had the time to make some mistakes, to find our feet, and to iterate towards a better model. Not any more.

My take on this, to go on from what I was saying in the last post, is that we can define the New Research Academy in terms of its environment. Like any species, the New Research Academic must adapt to the environment that they are in or they will perish. Climate change is a threat to the world, similarly Academy Change is a threat to the old inhabitants. The New Academy is fast, hungry, competitive, resource starved, commoditised, industry linked and, above all, heavily dependent on the perception of our efforts. The speed of change makes a difference here because if you were raised in the gentler environment of the Old Academy, but have been around for 20 years, then you have probably achieved enough success to survive. If I may take another biological example, you have accumulated enough resources that you can survive the lean years or the harsher years. The New Academy has frosts and only so many places available for the tribe. You build your resources quickly or it’s over.

Unless, of course, you can find a group to support you. Returning to Debowski’s material, she points out why development of researchers is so critical:

  • Start with PhD – used to be the only thing that you needed to do.
  • Now you have to understand how it fits into strategic research areas and areas of strength (broader sphere of understanding)
  • Need to hook in with a research community (this is your resource sharing group)
  • ECRs need to have to develop: communication skills, team and collaborative skills, project management, track record/profile, time, priority, career management, and grant seeking behaviour
  • Research managers and leaders need to take a professional stance to support this: induction, culture setting, human resource management practices, strategic management, financial management, relationship building, mentoring and sponsorship, project management, risk management, media/promotion.

But, looking at that final list, do some of those look like the behaviours of a professional research academic? I’ll come back to this.

Debowski finished by emphasising the role of mentors and, in the Old/New Academy framework, this makes even more sense. A new PhD student has only a limited amount of time before poor performance effectively removes them from the appointment and job pool – they don’t have time to waste taking false paths. A mid-career researcher needs to work out which path to take and then has to optimise for it – do I continue teaching, do I focus on research, should I take that Associate Deans position? This is where a mentor is vital because the New Academy has a cold wind blowing through it. Huddled together, we’ll see Summer again – but, of course, you have to huddle with the right people.

This brings me to the next talk, on How Universities Connect Education and Research, presented by Professor Lawrence Cram. This was a very interesting talk, dealing with complexity theory to explain the small-scale chaotic relationships in trying to explain which actions get people promoted these days. This is a very mechanistic approach to life in the New Academy. Which X do I need to maximise to achieve Y? Cram, however, very nicely identifies that X is in fact a set of things, Y is a different set of things, and the connections between them operate at different levels at different times.

Cram identified the outputs of Universities as experience goods, where the product is hard to observe in advance, in terms of characteristics such as quality or price, but you’re quickly aware of how good they are once consumed. This generally requires you to sell your product on reputation but once this reputation is established, your pricing model (market position) tends to stay fairly stable. (Amusingly, dropping the price of experience goods, because we’re unsure of how the goods are created, may result in uncertainty because people will make up reasons for the price drop that generally include drop in quality, rather than efficiency of delivery or something positive.)

This makes mapping inputs to outputs difficult and explains why such measurable outputs as number of students, pass rates and research publications are far more likely to form the basis of any funding. Cram is looking across a very large area with a very large number of questions: does research success generate a corresponding success ‘buzz’ in the student body? Does research discovery parallel or assist the student with their own voyage of discovery through their courses?

Ultimately, directives from senior management drive a functional and idealistic approach that produces graduates and intellectual property, but most universities are struggling to unify this with directives and government funding, compared to what students want. Linking this back to the roles that we are expecting research managers to take, we start to see a managerial focus that is starting to dominate our professional academic staff. I rephrase this, and segue to the next talk, as:

How are we defining the Professional Academic in the 21st Century?

The final talk used identity theory to examine the different work ideologies that academics espouse. Wayne O’Donohue presented his and Richard Winter’s paper on “Understanding academic identity conflicts in the public university: Importance of work ideologies” and it was both an interesting presentation, as well as being a full paper that I hope to finish reading this evening.

Fundamentally, managerial and professional ideological beliefs differ on how academic work should be organised. As I have mention throughout this post, we are seeing more and more evidence of creeping requirement to become managers. Managerialism, according to Winter and O’Donohue, has moved us into market-driven entities that regard students as commodities. Consumers need to be swayed by branding and pandering to preferences – we risk basing the reputation of our experience good upon a good marketing campaign rather than a solid academic reputation.

The conceptual framework for this work is that the two identities are, effectively, at odds with each other. Academics who are forced to be managerial find themselves at odds with their idea of what it means to be an academic – they are not being who they want to be and are at odds with what their University wants them to be. If we are to be good managerial entities then we focus on competition and consumer preferences for allocating resources. If we are to be good academics, then we focus on economic and social welfare of all members, stressing normative goals and beliefs. It is hard to think of two more opposing points within this sphere and it is no wonder that the people surveyed by Winter and O’Donohue had to be censored to remove obscene language that reflected their frustration at their own perception of their role.

We know that the market is not all that good at managing public good items. We know the benefits of the educational system in breaking the poverty cycle, reducing crime and violence, improving families, but the market would have to change its short-term benefit model in order to factor this in. We are looking at the substantial differences of short term economic focus versus long term social welfare focus.

Ultimately, the dissonance generated by people doing things that they were asked to do, but didn’t want to do, causes dissatisfaction and cynicism. Dispirited academics leave. Leaving, of course, those who are willing to adapt to the more managerial focus to then rise through the ranks, take positions of power and then impose more managerial focuses.

So what is the New Academy? Is it really a world of bottoms on seats, feudalist in its enforced fealty to existing barons to see you through the lean years, unconnected to funding models and overly metricated in strange ways?

If you want my honest answer, I would say “Not yet.”

Yes, we are heavily measured, but we still have the freedom to challenge and correct those measurements. A great deal of work is being done to produce instruments that give us useful and applicable information, as well as ‘handy’ numbers.

Yes, it helps to be in a research group, but informal communities of practice, faculty and university initiatives, external funding sources such as OLT, ALTA and the ARC do not require you to sign your swords over to a baron or a King.

Yes, we are measured as to our student intakes but we are still, in many important ways, academically free. We can still maintain quality and be true to our academic heritage.

You don’t have to take me word for it. Read everything that I (and katrinafalkner) have been blogging about. You can see all of the work being done, that we have seen at this conference, to draw us all together, to make us remember that we are strong as group, to provide useful metrics, to collaborate, to mentor out of the desire to help rather than the desire to control and the work being down to find and advertise our identity and the way that we can achieve our goals.

Yes, the idea of the New Academy is intimidating, and I write as one who was lucky enough to ride the wave of the new expectations, but in the same way that we bring our students together to learn and explore the benefits of collaboration and social interaction, I am convinced that the best rebirthing of the Academy will occur as we continue to share our work, and meet to discuss it, and go back home and be active and build upon everything that we’ve discussed.

And, being honest, sometimes it just takes sticking to our point, when we’re right, and not doing something that we know is wrong. I know that these are times when people are scared for their jobs, and I’m certainly not immune to that either, but the question comes down to “how much will you put with?” Let me finish with two final questions, which are also, I’m afraid, a call-to-arms:

What have you done today to define the Academy of the 21st Century in a way that matches your ideals and intentions?

What will you do tomorrow?

HERDSA 2012: Informal Communities of Practice: What are the advantages?

Posted: July 4, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , , , | 3 Comments

One of the talks I went to today was on “Money, Mountains and the Law, The powerful process of interdisciplinary collaboration”. I’m afraid that I can’t give you all of the names of the presenters as there were two physical and three virtual (Edit: The speakers were Leslie Almberg and Judy McGowan – thanks, Leslie!)- and the paper was submitted by Symons (spelling corrected!), Almberg, Goh and McGowan, from Curtin in Western Australia.

The academics in question all came from different disciplines, and different generations and cultures of academia, and found that they had a key thing in common: they considered themselves to be “constructive dissenters”, people who are not happy with how things are in their own patch but rather than just grumbling, they’re looking to make positive change. In this case, these academics had to stop outside of their own discipline, looking in a framework for embedding language elements into their courses, and their similarities were identified by a facilitator who said, effectively, “You’re all saying the same thing from your own discipline.”

The language expert, in this case, worked as interdisciplinary hub – a meeting point for the other three academics. For me, what was most interesting here was how the community of practice was defined between people with similar ideas, rather than people from similar disciplines.

One of the academics, who self-described themselves as an end-of-life academic, was musing on the difference in the modern academy from the one that she had originally entered. The new academy is competitive, full of Roosters (in the strutting sense, rather than the sitting on eggs sense [ Edit: Roosters don’t sit on eggs, do they?]), and requires you to be constantly advertising your excellence. (I’ll speak more on this in another post.) This makes it harder to form an in-discipline community of practice, because there’s always the chance that you will think about the person across from you as a competitor first and a collaborator second.

I have a blog!

The advantages of the interdisciplinary community of practice, as outlined in the talk, is that it is outside of your traditional hierarchies, formality and established space for competition. It doesn’t matter if you tell someone your amazing teaching secret – you won’t be competing against them for promotion. Better still, telling someone something good doesn’t have to make them (if they’re keyed this way) feel bad because you’re outperforming them on their home turf.

In the words of the speakers: these interdisciplinary communities of practice are “organic, outside of hierarchies and silos, provide support mechanism, remove the undercurrent of competitiveness and liberate”.

This forced me to carry out some reflection because I am, to a great extent, someone who would be easy to describe as a rooster. I am a very visible, and mildly successful, early career academic who has a number of things to talk about. (Long time readers will know that an absence of content hasn’t actually slowed me down yet, either.) I try very hard to be inclusive, to help, to be a mentor in the small circle of expertise where that would apply, and to shut up when I can’t help. I work with just about anyone who wants to work with me, but I do expect people to work. I collaborate inside my school, outside of my discipline and outside of my University and, to be honest, the feeling of liberation of working with someone else who has the same problems is fantastic – it makes you feel less alone. The fact that I can share ideas with someone and know that we’re building bridges, not being boastful or accidentally (but implicitly) belittling people who haven’t achieved the same things, is one of the best reasons to work ex discipline.

But I realise that I would not be some people’s first choice to work with because I am still, to many interpretations, a rooster. Obviously, I have a lot of personal reflection left to do on this to work out how I can still achieve and maintain a position as a positive role model, while being fairly sure that I don’t end up as a point of division or someone that is seen as a glory hound. I would be slightly surprised if the last were felt widely but it’s a good time to step back and think about my dealings with the people who are more successful than me (have I been resentful or subordinate?) and the people who are on my level (are we helping each other?) and those people who might benefit from my help (am I helping them or am I being unapproachable)?

When the Stakes are High, the Tests Had Better Be Up to It.

Posted: July 2, 2012 | Author: | Filed under: Education, Opinion | Tags: , , , , , , , , , , , , , , , , , , , , , | Leave a comment

(This is on the stronger opinion side but, in the case of standardised testing as it is currently practised, this will be a polarising issue. Please feel free to read the next article and not this one.)

If you make a mistake, please erase everything from the worksheet, and then leave the room, as you have just wasted 12 years of education.

A friend on FB (thanks, Julie!) linked me to an article in the Washington Post that some of you may have seen. The article is called “The Complete List of Problems with High-Stakes Standardised Tests” by Marion Brady, in the words of the article. a “teacher, administrator, curriculum designer and author”. (That’s attribution, not scare quotes.)

Brady provides a (rather long but highly interesting) list of problems with the now very widespread standardised testing regime that is an integral part of student assessment in some countries. Here. Brady focuses on the US but there is little doubt that the same problems would exist in other areas. From my readings and discussions with US teachers, he is discussing issues that are well-known problems in the area but they are slightly intimidating when presented as a block.

So many problems are covered here, from an incorrect focus on simplistic repetition of knowledge because it’s easier to assess, to the way that it encourages extrinsic motivations (bribery or punishment in the simplest form), to the focus on test providers as the stewards and guides of knowledge rather than the teachers. There are some key problems, and phrases, that I found most disturbing, and I quote some of them here:

[Teachers oppose the tests because they]

“unfairly advantage those who can afford test prep; hide problems created by margin-of-error computations in scoring; penalize test-takers who think in non-standard ways”

“wrongly assume that what the young will need to know in the future is already known; emphasize minimum achievement to the neglect of maximum performance; create unreasonable pressures to cheat.”

“are open to massive scoring errors with life-changing consequences”

“because they provide minimal to no useful feedback”

This is completely at odds with what we would consider to be reasonable education practice in any other area. If I had comments from students that identified that I was practising 10% of this, I would be having a most interesting discussion with my Head of School concerning what I was doing – and a carpeting would be completely fair! This isn’t how we should teach and we know it.

I spoke yesterday about an assault on critical thinking as being an assault on our civilisation, short-sightedly stabbing away at helping people to think as if it will really achieve what (those trying to undermine critical thinking) actually wanted. I don’t think that anyone can actually permanently stop information spreading, when that information can be observed in the natural world, but short-sightedness, malign manipulation of the truth and ignorance can certainly prevent individuals from gaining access to information – especially if we are peddling the lie that “everything which needs to be discovered is already known.”

We can, we have and we probably (I hope) always will work around these obstacles in information, these dark ages as I referred to them yesterday, but at what cost of the great minds who cannot be applied to important problems because they were born to poor families, in the ‘wrong’ state, in a district with no budget for schools, or had to compete against a system that never encouraged them to actually think?

The child who would have developed free safe power, starship drives, applicable zero-inflation stable economic models, or the “cure for cancer” may be sitting at the back of a poorly maintained, un-airconditioned, classroom somewhere, doodling away, and slowly drifting from us. When he or she encounters the standardised test, unprepared, untrained, and tries to answer it to the extent of his or her prodigious intellect, what will happen? Are you sufficiently happy with the system that you think that this child will receive a fair hearing?

We know that students learn from us, in every way. If we teach something in one way but we reward them for doing something else in a test, is it any surprise that they learn for the test and come to distrust what we talk about outside of these tests? I loathe the question “will this be in the exam” as much as the next teacher but, of course, if that is how we have prioritised learning and rewarded the student, then they would be foolish not to ask this question. If the standardised test is the one that decides your future, then, without doubt, this is the one that you must set as your goal, whether student, teacher, district or state!

Of course, it is the future of the child that is most threatened by all of this, as well as the future of the teaching profession. Poor results on a standardised test for a student may mean significantly reduced opportunity, and reduced opportunity, unless your redemptive mechanisms are first class, means limited pathways into the future. The most insidious thread through all of this is the idea that a standardised test can be easily manipulated through a strategy of learning what the answer should be, to a test question, rather than what it is, within the body of knowledge. We now combine the disadvantaged student having their future restricted, competing against the privileged student who has been heavily channeled into a mode that allows them to artificially excel, with no guarantee that they have the requisite aptitude to enjoy or take advantage of the increased opportunities. This means that both groups are equally in trouble, as far as realising their ambitions, because one cannot even see the opportunity while the other may have no real means for transforming opportunity into achievement.

The desire to control the world, to change the perception of inconvenient facts, to avoid hard questions, to never be challenged – all of these desires appear to be on the rise. This is the desire to make the world bend to our will, the real world’s actual composition and nature apparently not mattering much. It always helps me to remember that Cnut stood in the waves and commanded them not to come in order to prove that he could not control the waves – many people think that Cnut was defeated in his arrogance, when he was attempting to demonstrate his mortality and humility, in the face of his courtiers telling him that he had power above that of mortal men.

How unsurprising that so many people misrepresent this.

Student Reflections – The End of Semester Process Report

Posted: June 27, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , , , , | Leave a comment

I’ve mentioned before that I have two process awareness reports in one of my first-year courses. One comes just after the monster “Library” prac, and one is right at the end of the course. These encourage the students to reflect on their assignment work and think about their software development process. I’ve just finished marking the final one and, as last year, it’s a predominantly positive and rewarding experience.

When faced with 2-4 pages of text to produce, most of my students sit down and write several, fairly densely packed pages telling me about the things that they’ve discovered along the way: lessons learned, pit traps avoided and (interestingly) the holes that they did fall into. It’s rare that I get cynical replies and for this course, from over 100 responses, I think that I had about 5 disappointing ones.

The disappointing ones included ones that posted about how I had to give them marks for something that was rubbish (uh, no I didn’t, read the assignment spec and the forum carefully), ones that were scrawled together in about a minute and said nothing, and the ones that were the outpourings of someone who wasn’t really happy with where they were, rather than something I could easily fix. Let’s move on from these.

I want to talk about the ones who had crafted beautiful diagrams where they proudly displayed their software process. The ones who shared great ideas about how to help students in the next offering. The ones who shared the links that they found useful with me, in case other students would like them. The ones who were quietly proud of mastering their areas of difficulty and welcomed the opportunity to tell someone about it. The one who used this quote from Confucius:

“A man without distant care must have near sorrow”

(人无远虑 必有近忧)

To explain why you had to look into the future when you did software design – don’t leave your assignments to the last minute, he was saying, look ahead! (I am, obviously, going to use that for teaching next semester!)

The Confucian Symbol. Something else to put in my lecture slides for Semester 2, 2012.

Overall, I find these reports to be a resolutely uplifting experience. The vast majority of my students have learnt what I wanted them to learn and have improved their professional skills but, as well, a large number of them have realised that the assignments, together with the lectures, develop their knowledge. Here is one of my favourite student quotes about the assignments themselves, which tells me that we’re starting to get the design right:

The real payoff was towards the end of the assignment. Often it would be possible to “just type code” and earn at least half the marks fairly easily. However there was always a more complex final-­part to the assignment, one that I could not complete unless I approached it in a systematic, well thought out way. The assignments made it easy to see that a program of any real complexity would be nearly impossible to build without a well-­defined design.

But students were also thinking about how they were going to take more general lessons out of this. Here’s another quote I like:

Three improvements that I am aiming to take on board for future subjects are: putting together a study timetable early on in the game; taking the time to read and understand the problem I’ve been given; and put enough time aside to produce a concise design which includes testing strategies.

The exam for this course has just been held and we’re assembling the final marks for inspection on Friday, which will tell us how this new offering has gone. But, at this stage, I have an incredibly valuable resource of student feedback to draw on when I have to do any minor adjustments to make this course better for the next offering.

From a load perspective, yes, having two essays in an otherwise computationally based course does put load on the lecturer/marker but I am very happy to pay that price. It’s such a good way to find out what my students are thinking and, from a personal perspective, be a little more confident that my co-teaching staff and I are making a positive change in these students’ lives. Better still, by sharing comments from cohort to cohort, we provide an authenticity to the advice that I would be hard pressed to achieve.

I think that this course, the first one I’ve really designed from the ground up and I’m aware of how rare that opportunity is, is actually turning into something good. And that, unsurprisingly, makes me very happy.

Time Banking: Foresightedness and Reward

Posted: June 23, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , | 2 Comments

You may have noticed that I’ve stopped numbering the time banking posts – you may not have noticed that they were numbered in the first place! The reason is fairly simple and revolves around the fact that the numbers are actually meaningless. It’s not as if I have a huge plan of final sequence of the time banking posts. I do have a general idea but the order can change as one idea or another takes me and I feel that numbering them makes it look as if there is some grand sequence.

There isn’t. That’s why they all tend to have subtitles after them so that they can be identified and classified in a cognitive sequence. So, why am I telling you this? I’m telling you this so that you don’t expect “Time Banking 13” to be something special, or (please, no) “Time Banking 100” to herald the apocalypse.

The Druids invented time banking but could never find a sufficiently good Oracle to make it work. The Greeks had the Oracle but not the bank. This is why the Romans conquered everywhere. True story!

If I’m going to require students to self-regulate then, whether through operant or phenomenological mechanisms, the outcomes that they receive are going to have to be shaped to guide the student towards a self-regulating model. In simple terms, they should never feel that they have wasted their time, that they are under-appreciated or that they have been stupid to follow a certain path.

In particular, if we’re looking at time management, then we have to ensure that time spent in advance is never considered to be wasted time. What does that mean to me as a teacher, if I set an assignment in advance and students put work towards it – I can’t change the assignment arbitrarily. This is one of the core design considerations for time banking: if deadlines are seen as arbitrary (and extending them in case of power failures or class-wide lack of submission can show how arbitrary they are) then we allow the students to make movement around the original deadlines, in a way that gives them control without giving us too much extra work. If I want my students to commit to planning ahead and doing work before the due date then some heavy requirements fall on me:

  1. I have to provide the assignment work ahead of schedule and, preferably, for the entire course at the start of the semester.
  2. The assignments stay the same throughout that time. No last minute changes or substitutions.
  3. The oracle is tied to the assignment and is equally reliable.

This requires a great deal of forward planning and testing but, more importantly, it requires a commitment from me. If I am asking my students to commit, I have to commit my time and planning and attention to detail to my students. It’s that simple. Nobody likes to feel like a schmuck. Like they invested time under false pretences. That they had worked on what they thought was a commitment but it turned out that someone just hadn’t really thought things through.

Wasting time and effort discourages people. It makes people disengage. It makes them less trustful of you as an educator. It makes them less likely to trust you in the future. It reduces their desire to participate. This is the antithesis of what I’m after with increasing self-regulation and motivation to achieve this, which I label under the banner of my ‘time banking’ project.

But, of course, it’s not as if we’re not already labouring under this commitment to our students, at least implicitly. If we don’t follow the three requirements above then, at some stage, students will waste effort and, believe me, they’re going to question what they’re doing, why they’re bothering, and some of them will drop out, drift away and be lost to us forever. Never thinking that you’ve wasted your time, never feeling like a schmuck, seeing your ideas realised, achieving goals: that’s how we reward students, that’s what can motivate students and that’s how we can move the on to higher levels of function and achievement.

 

Personal Reflection on Time Management: Why I Am a Bad Role Model.

Posted: June 15, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , | 2 Comments

Do any of you remember that scene from “Pretty Woman”, when Richard Gere’s character Edward asks his ex-girlfriend Susan if she had spent more time talking to his secretary than to him? Her reply was, simply, “she was one of my bridesmaids”. Any time in a relationship of any kind that you don’t meet the needs of the people in the relationship, it’s going to cause problems. (Not all problems have to end with you scaling a ladder to patch up your relationship with Julia Roberts but there will be problems.) Now, before anyone is wondering (or my friends are worried), my marriage is still great, I’m talking about my professional relationship with my students.

Ah, the old Time == Money equivalence, via an article on portfoliosc.blogspot.sg

While I’ve been critical of myself and my teaching this semester, where I’ve done a good job but not necessarily excelled across the board, I haven’t identified one of the greatest problems that has crept in – no-one in their right mind should be emulating what I laughingly refer to as my work ethic, time commitment or current pursuit of success. Right now, I am not a good role model for students. While I am still ethical, professional, knowledgable and I’m apparently doing a good job, I cannot present myself as a role model to my students because I am losing the time that I need to seize new opportunities, and to allow for the unrushed catch-up time with other people that is vital to doing a job such as mine and doing it well. At the moment, any student who comes to see me does so knowing that I will have 15-30 minutes, tops, and that I will then have to rush off, elsewhere, to go and do something else. It doesn’t matter when they come to see me – if I’m in at 7:30am it’s because the day is starting at 8. If I’m still there at 7pm at night it’s because I have to be in order to meet requirements for that day or the next. Let me give you an example from my lectures.

My Student Experience of Learning and Teaching results have come in and there have been a lot of warm and rewarding comments from my students, among a pleasing overall rating. But one of my students hit the nail on the head. “[Nick] always seems to have a lot to say and constantly looks at his watch. (I assume that it’s to keep within time constraints) the problem is that he feels like he’s rushing.”

Ouch. That’s far too true and, while only one student noted it, you bet every other student was watching me use my watch to check my time progress through a busy, informative but ultimately time constrained lecture and at least some of them thought “Hmm, I have a question but I don’t want to bother him.”

It’s my job to be bothered! It’s my job to answer questions! Right now, it’s pretty obvious that students are getting the vibe that I’m a good lecturer, I care about them, I’m working well to give them the right knowledge and they love the course that I built… but… they don’t want to bother me because I’m too busy. Because I look too busy.

Every student who comes to see does so in the one of the windows that I have in my day, often between meetings, my meetings back up on each other with monotonous regularity and, looking at my calendar for last, week, the total amount of time that was uncommitted prior to the week starting was…

75 minutes.

Including the fact that Tuesday started at 7:30am and went until 6:15pm.

Please believe me when I say that I’m not boasting – I’m not proud of this, I think it’s the sign of poor scheduling and workaholism. This should be read as what it is, a sign that I have let my responsibilities pile up in a way that means that I am running the risk of becoming a stereotypically “grumpy old Professor”, who is too busy to see students.

So when you read all of this stuff about Time Banking and think “Well, I guess I can see some of his point – for assignments…” I’m trying to work out how I can take the primary goal of time banking – to make people think about their time commitments in a way that allows them to approximate a manageable uniformity of effort across time to achieve good results – and to work out how I can think about my own time in the same way. How do I adjust my boundaries in time and renegotiate while providing my own oracle and incentives for change? If I can crack that, then solving the student problem should have been made much easier.

How do I become the kind of person that I would want my students to be? Right now, it requires me to think about my commitments and my time, to treat my time as a scarce and precious commodity, but in a way that allows me to do all of the things I need to do in my job and all of the things that I love to do in my job, yet still have the time to sit around, grab a slow coffee, make a lunch booking with someone with less than a month’s notice and to get my breathing room back.

I have one of the best jobs in the world but the way I’m doing it is probably unsustainable and it’s not really in the spirit of the job that I want to do. It’s more than just me, too. I need to be seen to be approachable and to do that I have to actually be approachable, which means finding a way that makes me worthy of being a good overall role model again.

Time Banking III: Cheating and Meta-Cheating

Posted: June 13, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , , | Leave a comment

One of the problems with setting up any new marking system is that, especially when you’re trying to do something a bit out of the ordinary, you have to make sure that you don’t produce a system that can be gamed or manipulated to let people get an unfair advantage. (Students are very resourceful when it comes to this – anyone who has received a mysteriously corrupted Word document of precisely the right length and with enough relevant strings to look convincing, on more than one occasion from the same student and they then are able to hand up a working one the next Monday, knows exactly what I’m talking about.)

As part of my design, I have to be clear to the students what I do and don’t consider to be reasonable behaviour (returning to Dickinson and McIntyre, I need to be clear in my origination and leadership role). Let me illustrate this with an anecdote from decades ago.

In the early 90s, I helped to write and run a number of Multi User Dungeons (MUDs) – the text-based fore-runners of the Massively Multiplayer On-line Role Playing Games, such as World of Warcraft. The games had very little graphical complexity and we spent most of our time writing the code that drove things like hitting orcs with swords or allowing people to cast spells. Because of the many interactions between the software components in the code, it was possible for unexpected things to happen – not just bugs where code stopped working but strange ‘features’ where things kept working but in an odd way. I knew a guy, let’s call him K, who was a long-term player of MUDs. If the MUD was any good, he’d not only played it, he’d effectively beaten it. He knew every trick, every lurk, the best way to attack a monster but, more interestingly, he had a nose for spotting errors in the code and taking advantage of them. One time, in a game we were writing, we spotted K walking around with something like 20-30 ’empty’ water bottles on him. (As game writers, wizards, we could examine any object in the game, which included seeing what players were carrying.)

A bit like this, but all on one person’s shoulders and no wheels.

This was weird. Players had a limited amount of stuff that they could carry, and K should have had no reason to carry those bottles. When we examined him, we discovered that we’d made an error in the code so that, when you drank from a bottle and emptied it, the bottle ended up weighing LESS THAN NOTHING. (It was a text game and our testing wasn’t always fantastic – I learnt!) So K was carrying around the in-game equivalent of helium balloons that allowed him to carry a lot more than he usually would.

Of course, once we detected it, we fixed the code and K stopped carrying so many empty bottles. (Although, I have no doubt that he personally checked each and every container we put into the game from that point on to see if could get it to happen again.) Did we punish him? No. We knew that K would need some ‘flexibility’ in his exploration of the game, knowing that he would press hard against the rubber sheet to see how much he could bend reality, but also knowing that he would spot problems that would take us weeks or months of time to find on our own. We took him into our new and vulnerable game knowing that if he tried to actually break or crash the game, or share the things he’d learned, we’d close off his access. And he knew that too.

Had I placed a limit in play that said “Cheating detected = Immediate Booting from the game”, K would have left immediately. I suspect he would have taken umbrage at the term ‘cheating’, as he generally saw it as “this is the way the world works – it’s not my fault that your world behaves strangely”. (Let’s not get into this debate right now, we’re not in the educational plagiarism/cheating space right now.)

We gave K some exploration space, more than many people would feel comfortable with, but we maintained some hard pragmatic limits to keep things working and we maintained the authority required to exercise these limits. In return, K helped us although, of course, he played for the fun of the game and, I suspect, the joy of discovering crazy bugs. However, overall, this approach saved us effort and load, and allowed us to focus on other things with our limited resources. Of course, to make this work required careful orientation and monitoring on our behalf. Nothing, after all, comes for free.

If I’d asked K to fill out forms describing the bugs he’d found, he’d never have done it. If I’d had to write detailed test documents for him, I wouldn’t have had time to do anything else. But it also illustrates something that I have to be very cautious of, which I’ve embodied as the ‘no cheating/gaming’ guideline for Time Banking. One of the problems with students at early development stages is that they can assume that their approach is right, or even assert that their approach is the correct one, when it is not aligned with our goals or intentions at all. Therefore, we have to be clear on the goals and open about our intentions. Given that the goal of Time Banking is to develop mature approach to time management, using the team approach I’ve already discussed, I need to be very clear in the guidance I give to students.

However, I also need to be realistic. There is a possibility that, especially on the first run, I introduce a feature in either the design or the supporting system that allows students to do something that they shouldn’t. So here’s my plan for dealing with this:

  1. There is a clear no-cheating policy. Get caught doing anything that tries to subvert the system or get you more hours in any other way than submitting your own work early and it’s treated as a cheating incident and you’re removed from the time bank.
  2. Reporting a significant fault in the system, that you have either deduced, or observed, is worth 24 hours of time to the first person who reports it. (Significant needs definition but it’s more than typos.)

I need the stick. Some of my students need to know that the stick is there, even if the stick is never needed, but I really can’t stand the stick. I have always preferred the carrot. Find me a problem and you get an automatic one-day extension, good for any assignment in the bank. Heck, I could even see my way clear to making this ‘liftable’ hours – 24 hours you can hand on to a friend if you want. If part of your team thinking extends to other people and, instead of a gifted student handing out their assignment, they hand out some hours, I have no problem with that. (Mr Pragmatism, of course, places a limit on the number of unearned hours you can do this with, from the recipient’s, not the donor’s perspective. If I want behaviour to change, then people have to act to change themselves.)

My design needs to keep the load down, the rewards up but, most importantly, the rewards have to move the students towards the same goals as the primary activity or I will cause off-task optimisation and I really don’t want to do that.

I’m working on a discussion document to go out to people who think this is a great idea, a terrible idea, the worst idea ever, something that they’d like to do, so that I can bring all of the thoughts back together and, as a group of people dedicated to education, come up with something that might be useful – OR, and it’s a big or, come up with the dragon slaying notion that kills time banking stone dead and provides the sound theoretical and evidence-based support as to why we must and always should use deadlines. I’m prepared for one, the other, both or neither to be true, along with degrees along the axis.

 

Today, As I Was Crawling Across the Floor…

Posted: June 10, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , | 3 Comments

As I believe I’ve already mentioned, I play a number of board games but, before you think “Oh no, not Monopoly!”, these are along the lines of the German-style board games, games that place some emphasis on strategy, don’t depend too heavily on luck, may have collaborative elements (or an entirely collaborative theme), tend not to be straight war games and manage to keep all the players in the game until the end. Notably, German-style board games don’t have to be German! While some of the ones that I enjoy (Settlers of Cataan, Ticket to Ride and Shadows Over Camelot) are European, a number are not (Arkham Horror, Battlestar Galactica and Lords of Waterdeep). A number of these require cooperative and collaborative play to succeed – some have a traitor within.

I have discussed these games with students on a number of occasions as many students have no idea that such games exist. The idea of players working together against a common enemy (Arkham Horror) appeals to a lot of people, especially as it allows you to share success. One of the best things about games that are well-designed to reward player action and keep everyone in the game is that the tension builds to a point a final victory gives everyone fiero – that powerful surge of joy.

Now, while there are many games out there, I decided to go through the full game design process to get my head around the components required to achieve a playable game. I’ve designed some games before and, after a brief time spent playing them, I’ve left most of them back on the shelf. Why? Poor game design, generally. As a writer, I have a tendency to think of stories and to run narrative in my head – in game terms, this is only one possible passage through the game. One of the strengths of computer games such as Deus Ex is the ability to play multiple times and get something new out: to shake up the events and run it in your order, forming a new narrative. (In DE, technically, you were on rails the whole time, the strength of the game is in the illusion of free will.)

Why is it important for me to try and design a good game? Because it requires a sound assessment of what is required, reflection upon how I can model a situation in a game, good design, solid prototyping, testing, feedback, revision, modification, re-testing, thought, evaluation and then more and more refinement. From a methodological point of view, my question to myself is “Can I build a game that is worth playing based on a general sketch of the problem, a few good ideas and then a solid process to allow me to build game features in the way that I would build code features?”

Right now I’m in the requirements gathering phase and this is proving to be very interesting. I’m working on a Zombie game (oh no, not another one) but I want to have a three-stage game where the options available to players, resources and freedom of action, change dramatically during each stage. I want it to be based in London. I want to allow for players to develop their characters as they play through a given game. I want player actions to have a lasting impact in the game, for decisions to matter. I want the game to generate a different board and base scenario set every time, to prevent players learning a default strategy. I want the whole thing to run, as a board game, in the German style. I want the instructions to fit onto 8 A4 pages – with pictures.

(I should note that I’ve been playing games for a long time and made a lot of notes about rules and mechanics that I like, so this has all formed part of my requirements gathering, but I’m not trying to put a new skin on an old game – I’m trying to create something interesting that is also not a blatant rip-off. Also, yes, I know that there are already a lot of zombie games out there. That isn’t the point.)

I’ve been crawling the web for pictures of London, layouts, property values, building types and other things to get London into my head. Because the board has to change every time, and I can’t use computer generation, I need a modular board structure. That, of course, requires that the modules make sense and feel like London, and that the composition of these modules also makes sense. I need the size of the board to make the players work for their victories and not make victory too easy or too hard to attain. (So, I’m building bounds into the modularity and composition that I can tune based on what happens in play testing.)

I knew this but my research nailed it as a requirement: London is about as far away from being a grid layout as you can get, with a river snaking through it. Because of this, and my randomisation and modularity requirements, I had to think about a system that allowed me to put the elements together but that didn’t make London look like New York.  Instead, I’ve opted for a tiled layout based on hexagons. They tesselate nicely, you can’t run in straight lines, and you can’t see further than the side of one hex, which reflects the problems of working in London without having to force someone to copy out a section of the London map with all of its terrible twists and turns.

The other thing I really wanted to know was “How fast do zombies move?” and, rather than just look it up, I’ve spent a bit of this afternoon shambling around the house and timing myself to see what the traditional “slow” zombie does. Standard walking and running are easy (I have a good feel for those figures) but then I thought about that stalwart of zombie movies – the legless crawler. So, in the interests of research, I measured off a 10m course and dragged myself across the floor only using my arms. Then I added a fudge factor to account for the smoothness of the floor and, voila, a range of speeds that tell me how long zombies will take to move across my maps.

Why do I need to do this? Because I’ve never done it before. From now on, if someone asks me what the estimated speed of a legless zombie is on a level surface, I can say “Oh, about 0.25m/s” and really stop the conversation at the Vice Chancellor’s cocktail party.

Requirements gathering, around a problem specification, is a vital activity because if it’s done properly then you gain more and more understanding of the problem and, even though initially the questions seem to explode, you can move to a point that you have answered most of the important questions. By the time I’ve finished this stage, I should have refined my problem statement into a form that allows me to write the proper design and then build the first prototype without too many further questions. I should have the base rules down in a form that I can give to somebody and see what they do.

By doing this, I’m practising my own Software Engineering skills in a very different way, which makes me think about them outside of the comfortable framework of a programming language. Students often head off to start writing code because it’s easier to sit and write code that might work, instead of spending the time doing the far more difficulty activities of problem specification, requirements gathering, specification refinement and full design. I don’t get much of a chance to work on commercial software these days, so a zombie game on the weekends is an unusual, if rewarding, way to practice these skills.

Sliding across the floor is murder on the knees, though…

Last Lecture Blues

Posted: June 7, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , | Leave a comment

I delivered the last lecture, technically the review and revision lecture, for my first year course today. As usual, when I’ve had a good group of students or a course I enjoy, the relief in having reduced my workload is minor compared to the realisation that another semester has come to an end and that this particular party is over.

Hellooooo???

Today’s lecture was optional but we still managed to get roughly 30% of the active class along. Questions were asked, questions were discussed, outline answers were given and then, although they all say and listened until I’d finished a few minutes late, they were all up and gone. The next time I’ll see most of them is at the exam, a few weeks from now. After that? It depends on what I teach. Some of these students I’ll run into over the years and we’ll actually get to know each other. Some may end up as my honours or post-graduate students. Some will walk out of the gates this semester and never return.

Now, hear me out, because I’m not complaining about it, but this is not the easiest job in the world. Done properly, education requires constant questioning, study, planning, implementing, listening, talking and, above all, dealing with the fact that you may see the best student you ever have for a maximum of 6 months. It is, however, a job that I love, a job that I have a passion for and, of course, in many ways it’s a calling more than a job.

One of the things I’ve had a chance to reflect on in this blog is how much I enjoy my job, while at the same time recognising how hard it is to do it well. Many times, the students I need to speak to most are those who contact me least, who up and fade away one day, leaving me wondering what happened to them.

At the end of the semester, it’s a good time to ask myself some core questions and see if I can give some good answers:

  1. Did I do the best job that I could do, given the resources (structures, curriculum, computers etc) that I had to work with?
  2. Did I actively seek out the students who needed help, rather than just waiting for people to contact me?
  3. Did I look for pitfalls before I ran into them?
  4. Did I look after the staff who were working with or for me, and mentor them correctly?
  5. Did I try to make everything that I worked with an awesome experience for my students?

This has been the busiest six months of my life and one of my joys has been walking into a lecture theatre, having written the course, knowing the material and losing myself in an hour of interactive, collaborative and enjoyable knowledge exchange with my students. Despite that, being so busy, sometimes I didn’t quite have the foresight that I should had had and my radar range was measured in days rather than weeks. Don’t get me wrong, everything got done, but I could have tried to locate troubled students more actively, and some minor pitfalls nearly got me.

However, I think that we still delivered a great course and I’m happy with 1, 4 and 5. I aimed for awesome and I think we hit it fairly often. 2 and 3 needed work but I’ve already started making the required changes to make this better.

On reflection, I’d give myself an 8ish/10 but, of course, that’s not enough. Overall, in the course, because of the excellent support from my co-lecturer and my teaching staff, the course itself I’d push up into the 9-pluses. I, however, should be up there as well and right now, I’m too busy.

So, it’s time for some rebalancing into the new semester. Some more structure for identifying problems students. Looking at things a little earlier. And aiming for an awesome 10/10 for my own performance next semester.

To all my students, past and present, it’s been fantastic. Best of luck with your exams!

The Shortest Distance Between Two Points Is The Internet

Posted: June 5, 2012 | Author: | Filed under: Education | Tags: , , , , , , , , , , , , | 2 Comments

MY CHEESE!

I’ve been noticing a slight upwards trend in readership, as I’ve previously noted. On Friday, however, the readership exploded. 209 views on Friday, 259 views on Saturday. (Normally, I’m lucky to get a third of that.) One person, who obviously needs some help, viewed 99 things in one hour. (Even I’ve never done that.)

It was pretty obvious that something had happened but the other shoe didn’t drop until today, when a comment confirmation request came in. I’d been mentioned in a radio show and podcast for electronics enthusiasts and professionals – The Amp Hour!

Dave Jones had found my post on the bra ad that managed to combine sexism and insulting engineers and had, in his own words, been dismayed by it. His comment, and a link on the website, and suddenly I have some (quite possibly heavily confused) people reading my blog and wondering what they’d wandered into.

I saw the comment confirmation request, followed it back, commented, Dave responded, loop closed.

Except, of course, for how amazingly cool it is that something I wrote about an issue that bothered me found someone else, who it also bothered, who mentioned it, which sent people to me, which sent me to him, and then we basically met up in the corridor, nodded at each other and said “Hi”.

Of course, this would be far more impressive if Dave was in Antarctica, but he’s actually in Sydney. He went looking for stuff about the ad because he saw it and it bugged him – and he found my blog.

But this is still pretty cool. We’re a thousand kilometres apart (or so) and we’ve both agreed that the ad is rubbish. Twenty years ago, we would have had to have met or one of us would have had to write an article that got published on paper and distributed to me. I certainly wouldn’t know about Dave’s expertise in Internet Dating (seriously?) or passion for geocaching.

This is the world that that I have to prepare my students for. A world where their comments, good or bad, can travel for thousand of kilometres. A world where presence doesn’t have to mean physical presence. Of course, as educators, that applies to our classrooms and spaces as well. Our world does not have to be bricks and mortar, bench seats and blackboards.

We’re trying to make connections: knowledge, ideas, people, the future. We already appear to have the infrastructure to do it – do we have all of the right tools and the drive and vision to realise it?

I have no idea but I hope that we do. In the meantime, I’ll be over here, looking at the walls and thinking about the shortest distance between two points.

← Older Entries
Newer Entries →