HERDSA 2012: Connecting with VET

As part of the final session I attended in the general conference, I attended a talk by A/Prof Anne Langworthy and Dr Susan Johns who co-presented a talk on “Why is it important for Higher Education to connect with the VET sector?” As a point of clarification, VET stands for Vocational Education and Training, as I’ve previously mentioned, and is generally concerned with trade qualifications, with some students going on to diplomas and advanced diplomas that may be recognised as some or all of a first-year University course equivalent. If a student starts in a trade and then goes to a certain point, we can then easily accept them into an articulation program.

The Tasmanian context, a small state that is still relatively highly ruralised, provides a challenging backdrop to this work, as less than 18% of school leavers who could go on to University actually do go on to University. Combine this with the highest lower socio-economic status (SES) population by percentage in Australia, and many Tasmanians can be considered to be disadvantaged by both access to and participation in University level studies. Family influence plays a strong part here – many families have no-one in their immediate view who has been to University at all, although VET is slightly more visible.

Among the sobering statistics presented, where that out of a 12 year schooling system, where Year 12 is the most usual pre-requisite to University entry, as a state, the percentage of people 15 years or older who had year 10 schooling or less was 54%. Over half the adult population had not completed secondary schooling, the usual stepping stone to higher education.

The core drivers for this research were the following:

  1. VET pathways are more visible and accessible to low SES/rural students because the entry requirements aren’t necessarily as high and someone in their family might be able to extol the benefits.
  2. There are very low levels of people articulating from VET to Higher Ed – so, few people are going on to the diploma.
  3. There is an overall decline in VET and HE participation.
  4. Even where skills shortages are identified, students aren’t studying in the areas of regional need.
  5. UTAS is partnering with the Tasmanian VET provider Tasmanian Polytechnic and Skills Institute.

An interesting component of this background data is that, while completion rates are dropping for the VET skills, individual module completion rates are still higher than the courses in which the modules sit. In other words, people are likely to finish a module that is of use to them, or an employer, but don’t necessarily see the need of completing the whole course. However, across the board, the real problem is that VET, so often a pathway to higher ed for people who didn’t quite finish skill, is dropping in percentage terms as a pathway to Uni. There has been a steady decline in VET to HE articulation in Tasmania across the last 6 years.

The researchers opted for an evidence based approach to examine those students who had succeeded in articulating from VET to HE, investigating their perceptions and then mapping existing pathways to discover what could be learned. The profile of VET and HE students from the SES/rural areas in Tas are pretty similar although the VET students who did articulate into Uni were less likely to seek pathways that rewarded them with specific credits and were more likely to seek general admission. Given that these targeted articulations, with credit transfer, are supposed to reflect student desire and reward it, or encourage participation in a specific discipline, it appears that these pathways aren’t working as well as they could.

So what are the motivators for those students who do go from VET to Uni? Career and vocational aspirations, increased confidence from doing VET, building on their practical VET basis, the quality and enthusiasm of their VET teachers, the need to bridge over an existing educational hurdle and satisfaction with their progress to date. While participation in VET generally increased a student’s positive attitude to study, the decision to (or not to) articulate often came down to money, time, perceived lack of industry connection and even more transitional assistance.

It’s quite obvious that our students, and industry, can become fixated with the notion of industrial utility – job readiness – and this may be to the detriment to Universities if we are perceived as ivory towers. More Higher Ed participation is excellent for breaking the poverty cycle, developing social inclusion and the VET to Higher Ed nexus offers great benefits in terms of good student outcomes, such as progression and retention, but it’s obvious that people coming from a practice-based area, especially in terms of competency training, are going to need bridging and some understanding to adapt to the University teaching model. Or, of course, our model has to change. (Don’t think I was going to sneak that one past you.)

The authors concluded that bridging was essential. articulation and credit transfer arrangement should be reviewed and that better articulation agreements should be offered in areas of national and regional priority. The cost of going to University, which may appear very small to students who are happy to defer payment, can be an impediment to lower SES participants because, on average, people in these groups can be highly debt averse. The relocation costs and support costs of moving away from a rural community to an urban centre for education is also significant. It’s easy sometimes to forget about how much it costs to live in a city, especially when you deprive someone of their traditional support models.

Of course, that connection to industry is one where students can feel closer when they undertake VET and Universities can earn some disrespect, fairly or not, for being seen to be ivory towers, too far away from industry. If you have no-one in your family who has been to Uni, there’s no advocate for the utility of ‘wasting’ three years of your life not earning money in order to get a better job or future. However, this is yet another driver for good industry partnerships and meaningful relationships between industry, VET and Higher Education.

It’s great to see so much work being down in both understanding and then acting to fix some of the more persistent problems with those people who may never even see a University, unless we’re dynamic and thoughtful in our outreach programs. On a personal note, while Tasmania has the lowest VET to HE conversion, I noticed that South Australia (my home state) has the second lowest and a similar decline. Time, I think, to take some of the lessons learned and apply them in our back yard!


HERDSA 2012: Integrating concepts across common engineering first year courses

I attended a talk by Dr Andrew Guzzomi on “Interdisciplinary threshold concepts in engineering”, where he talked about University of Western Australia’s reconfiguration of their first year common engineering program in the face of their new 3+2 course roll-out across the University. Most Unis have a common engineering first year that is the basis for all disciplines. This is usually a collection of individual units each focusing on one discipline, developed and taught by academics from that discipline. For example, civil engineers teach statics, mechs teach dynamics, but there is no guaranteed connection or conceptual linkage between the two areas. This is despite the fact that statics is effectively dynamics with some key variables set to zero. (Engineers, you may now all howl in dismay!)

This work looked at what the threshold concepts were for engineering. These threshold concepts are transformative, in that if you understand them it will change the way that you think about the discipline, but they are also troublesome, they need work to teach and effort to learn. But, in theory, if we identify the right threshold concepts then we:

  • Focus teaching, learning and assessment activities
  • Renew otherwise crowded curricula

This is a big issue as we balance the requirements of our students, our discipline, our professional bodies and industry – we have to make sure that whatever teach is appropriate and the most useful (in all of the objective spaces) thing that we can be teaching.

Dr Guzzomi then discussed the ALTC (Australian Learning and Teaching Council) project that supported the basic investigation to conduct an inventory of what all groups considered to be the core threshold concepts. UWA was the case study, with an aim to reducing a guide for other educators, and to add back to threshold concept theory. This is one of the main contributions of the large-scale Australia-wide educational research support bodies: they can give enough money and influence to a project to allow change to occur.

(I picked up from the talk that, effectively, it helped to have a Chair of Engineering Education on board to get an initiative like this through. Even then, there was still resistance from some quarters. This isn’t surprising. If we all agreed with each other, I’d be shocked.)

The threshold concept identification required a very large set of workshops and consultative activities, across students and staff both within and without the discipline, starting with a diversification phase as concepts were added, and then moving to an integration phase that rationalised these concepts down into the set that really expressed the key threshold concepts of engineering for first year.

The implementation in Syllabus terms required the implementors to:

  • Focus teaching and learning on TCs
  • Address troublesome features
  • provide opportunities to experience variation (motion unit taught using variation theory, when students work at indiv tables, doing different problems at different tables but pool similar answers for comparison to show the difference in approach and answer)
Then developed concept maps for each unit, showing inclusion, requirements and examples, used with, dependencies and so on.
This was then turned into a course implementation that had no lectures at all: courses were composed of four individual units that had readings, tutorial-like information sessions and 2 hour studio session that comprised practicals and more interaction sessions. I did ask Andrew about the assessment mechanisms in use and, while they’ve been completely rebuilt for the new course, they are still reviewing these to make sure that they exercise the threshold concepts appropriately. (I’ll be sending him e-mail to get more detail on this.)
Their findings so far are that these concept identification exercises have revealed the connections between the disciplines and the application of the same concepts across the whole of the discipline. Three concepts were identified as being good examples of concepts that have a reach that spread across all disciplines (integrating threshold concepts):
  1. System identification: where you work out which system he problem fits into to allow you simplify analysis
  2. Modelling and abstraction: where quantitative analysis is facilitated through translation to mathematical language and students use judgement to break system into salient components for modelling
  3. Dimensional reasoning: Identifying the variables needed to describe a complex system – making sure that equations balance.
The conclusions were relatively straight forward:
  • Rather than a traditional and relatively unlinked common foundation, teaching integrating concepts is showing promise
  • Threshold concepts provided the lens and developed approach to integrated disciplines
  • Teaching through variation supports student diversity in solutions
  • This approach reveals connections across engineering disciplines beyond those in which they later chose to specialise
UWA and U Melbourne run a very different degree program from the rest of us, so it’s always interesting to see what they are up to. In this case, there’s a lot going on. Not only have they done a great deal of surveying in order to find the new threshold concepts upon which their courses are now built, but they’ve also completely changed their teaching style to support it, with much greater use of collaboration and team work. I’ll be very interested to see some more follow-up on this after it’s run for the full year.

HERDSA 2012: Session 1 notes – Student Wellbeing

I won’t be giving detailed comments on all sessions – firstly, I can’t attend everything and, secondly, I don’t want you all to die of word poisoning – but I’ve been to a number of talks and thought I’d discuss those here that really made me think. (My apologies for the delay. I seem to be coming down with a cold/flu and it’s slowing me down.)

In Session 1, I went to a talk entitled “Integrating teaching, learning, support and wellbeing in Universities”, presented by Dr Helen Stallman from University of Queensland. The core of this talk was that, if we want to support our students academically, we have to support them in every other way as well. The more distressed students are, the less well they do academically. If we want good outcomes, we have to able to support students’ wellbeing and mental health. We already provide counselling and support skill workshops but very few students will go and access these resources, until they actually need them.

This is a problem. Tell a student at the start of the course, when they are fine, where they can find help and they won’t remember it when they actually may need to know where that resource is. We have a low participation in many of the counselling and support skill workshop activities – it is not on the student’s agenda to go to one of these courses, it is on their agenda is to get a good mark. Pressured for time, competing demands, anything ‘optional’ is not a priority.

The student needs to identify that they have a problem, then they have to be able to find the solution! Many University webpages not actually useful in this regard, although they contain a lot of marketing information on the front page.

What if we have an at-risk profile that we can use to identify students? It’s not 100% accurate. Students who are ‘at risk’ may not have problems but students who don’t have the profile may still have problems! We don’t necessarily know what’s going on with our students. Where we have 100s of students, how can we know all of them? (This is one of the big drivers for my work in submission management and elastic time – identifying students who are at risk as soon as they may be at risk.)

So let me reiterate the problem with the timing of information: we tend to mention support services once, at the start. People don’t access resources unless they’re relevant and useful at the particular time. Talking to people when they don’t have a problem – they’ll forget it.

So what are the characteristics of interventions that promote student success:

  • Inclusive of all students (and you can find it)
  • Encourages self-management skills  (Don’t smother them! Our goal is not dependency, it’s self-regulation)
  • Promotes academic achievement (highest potential for each of our students)
  • Promotes wellbeing (not just professional capabilities but personal capabilities and competencies)
  • Minimally sufficient (students/academics/unis are not doing more work than they need to, and only providing the level of input that is required to achieve this goal.)
  • Sustainable (easy for students and academics)

Dr Stallman then talked about two tools – the Learning Thermometer and The Desk. Student reflection and system interface gives us the Learning Thermometer, then automated and personalised student feedback is added, put in by academic. Support and intervention, web-based, as a loop around student feedback. Student privacy data is maintained and student gets to choose intervention that is appropriate. Effectively, the Learning Thermometer tells the student which services are available, as and when they are needed, based on their results, their feedback and the lecturer’s input.

This is designed to promote self-management skills and makes the student think “What can I do? What are the things that I can do?” Gives students of knowledge of which resources they can access. (And this resource is called “The Desk”) Who are the people who can help me?

What is being asked is: What are the issues that get in the way of achieving academic success?

About “The Desk”: it contains quizzes related to all part of the desk that gives students personalised feedback to give them module suggestions as appropriate. Have a summary sheet of what you’ve done so you can always remember it. Tools section to give you short tips on how to fix things. Coffee House social media centre to share information and pictures (recipes and anything really).

To allow teachers to work out what is going on, an addition to the Learning Thermometer can give the teacher feedback based on reflection and the interface. Early feedback to academics allows us to improve learning outcomes. THese improvements in teaching practices. (Student satisfaction correlates poorly with final mark, this is more than satisfaction.)

The final items in the talk focussed on:

  • A universal model of prevention
  • All students can be resilient
  • Resources need to be timely relevant and useful
  • Multiple access points
  • Integrated within the learning environment

What are the implications?

  • Focus on prevention
  • Close the loop between learning, teaching, wellbeing and support
  • More resilient students
  • Better student graduate outcomes.

Overall a very interesting talk, which a lot of things to think about. How can I position my support resources so that students know where to go as and when they need them? Is ‘resiliency’ an implicit or explicit goal inside my outcomes and syllabus structure? Do the mechanisms that I provide for assessment work within this framework?

With my Time Banking hat on, I am always thinking about how I can be fair but flexible, consistent but compassionate, and maintain quality while maintaining humanity. This talk is yet more information to consider as I look at alternative ways to work with students for their own benefit, while improving their performance at the same time.

Contact details and information on tools discussed:

h.stallman@uq.edu.au
http://www.thelearningthermometer.org.au
http://www.thedesk.org.au
thedesk@uq.edu.au


HERSDA Keynote: “Cultivating Connections Throughout the Academe: Learning to Teach by Learning to Learn” Dr Kathy Takayama.

A very interesting keynote today and I took a lot of notes. Anyone who has read my SIGCSE blogs knows that I’m prone to being verbose so I hope that this is useful if wordy. (Any mistakes are, of course, mine.)

Dr Takayama started talk with an art image: “Venn diagrams (under the spotlight)” by Amalia Pica. She stressed how the Venn Diagram was simple, versatile, intearction, connection, commonality, and it also transcends boundaries – the overlap of two colours produces a new colour. We can also consider this as an absence of difference (sharing) or new knowledge (creation). However the background of the artwork was based in the artist’s experience of the suppression of group theory and Venn diagrams in Argentina – as both of these were seen to encourage subversive forms of group activity and critical theory. Dr Takayama then followed this thread into ideas of inclusion and exclusion. What are the group dynamics from our structures? How do we group students and acaemdics into exclusive and inclusive domains? What does this mean for our future?
How does this limit learning?
She then talked about our future professoriate – those students who will go on to join us in the professorial ranks. She broke this into three aspects: Disciplinary Identity, Dispositions for engagement and Integrative communities. Our disciplinary identity reflects our acculturation to disciplinary practices and habits of mind, where our dispositions identify who we find ourselves in the learning – rather than focusing on what to learn.
“In the face of today’s hyper-accelerated ultra-competitive global society, the preservation of opportunities for self-development and autonmous reflection is a value we underestimate at our peril.” (Richard Wolin)
When we discuss the emergence of disciplinary identity, we are talking about expert thinking – the scholarly habits of a discipline that allow someone to identify themselves as a member of the discipline. What do we do that allows us to say “I am a microbiologist” or “I am an engineer”?
The development of expertise is through iterative authentic experiences, truly appropriate activities carried out inside the disciple, where we have discipline-centred practices, including signature pedagogies (Schulman). The signature pedagogies of a discipline have four features. They must  be pervasive, routine, habitual and deeply engaging
Dr Takayama then discussed, at some length, a study in placing students into unfamiliar territory, where they were required to take scholarly habits from another discipline. In this case, Dr Takayama (a microbiologist) exchanged scholarly habits with students of David Reichart – Historian. Academics confirm to standard practices of their disciplines and students acculturate quickly. Takayama and Reichart sought to take pedagogies from other areas to take students into new thinking processes.
Students from the History course were required to use a science poster basis (research poster) to present their work, instead of a traditional report. The word “Poster” was reacted to badly – students thought that was a cheapening of their effort for a year’s work. Students had to think outside of the norms and discovered new aspects of communication, voice and interpretation in the unusual territory. This also added a challenge component and allowed a multi-dimensional exploration of area.
The microbiology students had to document their research in a completely blank book and were allowed to create a narrative in that blank book. This was at odds with usual structure for Science: accurate, reproducible, adhere to convention, no narrative, no first person, dates, signatures. While accuracy and reproducibly were still enforced, students were encouraged to explore much more widely in their blank book.
Student work started to resemble commonplace books (loci communes) – a compiled work with annotations and narrative from the compiler. The new student books contain personalisation, reflection, narrative, collage, moments of exhilaration and discovery – but they maintained fidelity and scientific accuracy.
This then led to the core idea from the work: (An) engagement with the unfamiliar as a means for further development of expertise.
Students’ understandings are deeply tied to existing and established practices – to the point that students feared that outside conventions would render their work invalid. Working in unfamiliar territory allows the students to refine their understanding of their discipline and push the boundaries, as well as their own understanding. Lecturers had to take risks as well, to get this realisation.
In our traditional dispositions for engagement, we have had a tendency to create a learning culture that is less interested in the unfamiliar and we have implicitly driven a focus on understanding a discipline vs developing an understanding of oneself. The nature of learning as situated in institutional cultures is something that we can see from the inside but the student perspective is vital as we want to know what the students think that we look like. From the students’ perspectives, they see learning in terms of specialisation, globalisation, technology and collaboration. This is a critical forum through which students made sense of their own place in relation to the  discipline.
Students identified two over-arching goals:
  • Routine Expertise: The Habits of mind and skills associated with efficiency and performance in familiar  domains, and
  • Adaptive Expertise (after Bransford): applying knowledge effectively to novel situations or unique problems
Students discover themselves in the material – finding connection and allowing deep eqnuiry into their own nature. (Students’ awareness of themselves in the course or the curriculum (Barbazat, Amherst))
Looking from our perspective, based on what our students want and how they succeed, Barnett (U London) identified dispositions for learning as Venturing Forward
  • A will to learn
  • A will to encounter the unfamiliar
  • A will to engage
  • A preparedness to listen
  • A willingness to be changed
  • A determination to keep going.
 Dr Takayama then went on to talk about developing a strong learning and teaching community through courses such as Brown’s Certification program, which has any benefits in enhancing the perception of value and practices in learning and teaching, as well as overall enhancement of the new post-graduates. One of the core points identified was that many of the PhD students who are produced will go on to teach in liberal arts colleges, institutions with an undergraduate teaching focus and two-year colleges. If we don’t teach them how to teach then they will be woefully underprepared for the future that lies before them – just being good at research doesn’t translate into skill at teaching, hence it must be fostered and well-organised certification programs are a good way to do this.
I hope to comment more on the cert program shortly, but  a very interesting talk with lots of ideas for me to take home and to think about.

When the Stakes are High, the Tests Had Better Be Up to It.

(This is on the stronger opinion side but, in the case of standardised testing as it is currently practised, this will be a polarising issue. Please feel free to read the next article and not this one.)

If you make a mistake, please erase everything from the worksheet, and then leave the room, as you have just wasted 12 years of education.

A friend on FB (thanks, Julie!) linked me to an article in the Washington Post that some of you may have seen. The article is called “The Complete List of Problems with High-Stakes Standardised Tests” by Marion Brady, in the words of the article. a “teacher, administrator, curriculum designer and author”. (That’s attribution, not scare quotes.)

Brady provides a (rather long but highly interesting) list of problems with the now very widespread standardised testing regime that is an integral part of student assessment in some countries. Here. Brady focuses on the US but there is little doubt that the same problems would exist in other areas. From my readings and discussions with US teachers, he is discussing issues that are well-known problems in the area but they are slightly intimidating when presented as a block.

So many problems are covered here, from an incorrect focus on simplistic repetition of knowledge because it’s easier to assess, to the way that it encourages extrinsic motivations (bribery or punishment in the simplest form), to the focus on test providers as the stewards and guides of knowledge rather than the teachers. There are some key problems, and phrases, that I found most disturbing, and I quote some of them here:

[Teachers oppose the tests because they]

“unfairly advantage those who can afford test prep; hide problems created by margin-of-error computations in scoring; penalize test-takers who think in non-standard ways”

“wrongly assume that what the young will need to know in the future is already known; emphasize minimum achievement to the neglect of maximum performance; create unreasonable pressures to cheat.”

“are open to massive scoring errors with life-changing consequences”

“because they provide minimal to no useful feedback”

This is completely at odds with what we would consider to be reasonable education practice in any other area. If I had comments from students that identified that I was practising 10% of this, I would be having a most interesting discussion with my Head of School concerning what I was doing – and a carpeting would be completely fair! This isn’t how we should teach and we know it.

I spoke yesterday about an assault on critical thinking as being an assault on our civilisation, short-sightedly stabbing away at helping people to think as if it will really achieve what (those trying to undermine critical thinking) actually wanted. I don’t think that anyone can actually permanently stop information spreading, when that information can be observed in the natural world, but short-sightedness, malign manipulation of the truth and ignorance can certainly prevent individuals from gaining access to information – especially if we are peddling the lie that “everything which needs to be discovered is already known.”

We can, we have and we probably (I hope) always will work around these obstacles in information, these dark ages as I referred to them yesterday, but at what cost of the great minds who cannot be applied to important problems because they were born to poor families, in the ‘wrong’ state, in a district with no budget for schools, or had to compete against a system that never encouraged them to actually think?

The child who would have developed free safe power, starship drives, applicable zero-inflation stable economic models, or the “cure for cancer” may be sitting at the back of a poorly maintained, un-airconditioned, classroom somewhere, doodling away, and slowly drifting from us. When he or she encounters the standardised test, unprepared, untrained, and tries to answer it to the extent of his or her prodigious intellect, what will happen? Are you sufficiently happy with the system that you think that this child will receive a fair hearing?

We know that students learn from us, in every way. If we teach something in one way but we reward them for doing something else in a test, is it any surprise that they learn for the test and come to distrust what we talk about outside of these tests? I loathe the question “will this be in the exam” as much as the next teacher but, of course, if that is how we have prioritised learning and rewarded the student, then they would be foolish not to ask this question. If the standardised test is the one that decides your future, then, without doubt, this is the one that you must set as your goal, whether student, teacher, district or state!

Of course, it is the future of the child that is most threatened by all of this, as well as the future of the teaching profession. Poor results on a standardised test for a student may mean significantly reduced opportunity, and reduced opportunity, unless your redemptive mechanisms are first class, means limited pathways into the future. The most insidious thread through all of this is the idea that a standardised test can be easily manipulated through a strategy of learning what the answer should be, to a test question, rather than what it is, within the body of knowledge. We now combine the disadvantaged student having their future restricted, competing against the privileged student who has been heavily channeled into a mode that allows them to artificially excel, with no guarantee that they have the requisite aptitude to enjoy or take advantage of the increased opportunities. This means that both groups are equally in trouble, as far as realising their ambitions, because one cannot even see the opportunity while the other may have no real means for transforming opportunity into achievement.

The desire to control the world, to change the perception of inconvenient facts, to avoid hard questions, to never be challenged – all of these desires appear to be on the rise. This is the desire to make the world bend to our will, the real world’s actual composition and nature apparently not mattering much. It always helps me to remember that Cnut stood in the waves and commanded them not to come in order to prove that he could not control the waves – many people think that Cnut was defeated in his arrogance, when he was attempting to demonstrate his mortality and humility, in the face of his courtiers telling him that he had power above that of mortal men.

How unsurprising that so many people misrepresent this.


Actually, Now You’re On My Turf

This Diagram Officially Not Recommended By The Texas GOP 2012

I don’t normally dabble in politics on this blog, quite deliberately, because I don’t want people to stop reading things that might be of use because of partisan issues. However, with the release of the 2012 Texas Republican platform, and its section on Education (page 12), I don’t feel that I’m dabbling in politics to address this – because with the following statement, the Texas GOP has very firmly put their feet into my area, and I feel that a response is required.

Knowledge-Based Education – We oppose the teaching of Higher Order Thinking Skills (HOTS) (values clarification), critical thinking skills and similar programs that are simply a relabeling of Outcome-Based Education (OBE) (mastery learning) which focus on behavior modification and have the purpose of challenging the student’s fixed beliefs and undermining parental authority.

Now, I have tried to go the Texas GOP website to see if there have been any developments on this but, for some reason, I can’t seem to be able to get there at the moment. (This is often the Internet’s way of saying “You have become interesting to a great many people. All at once.”, where congestion is caused by fascination.)

I am hoping that this turns out to be some kind of Internet hoax, or the actions of one person, rather than the genuine statement of a major political party for a large US state. As an educator, as a University lecturer, as a scientist, as a thinker, as a human being I am terrified that critical thinking skills, the foundation of our civilisation, are being singled out as being something undesirable – because it will challenge the students’ fixed beliefs.

We have had long periods where beliefs could not be challenged, where critical thinking was either suppressed or ignored, and we generally refer to them historically as dark ages. What really confuses me is that, somehow, critical thinking is going to immediately lead to the collapse of parental authority – as if critical thinking is guaranteed to be obstructive or contrary thinking. Critical thinking is the consideration of claims to decide if they are always true, sometimes true, partly true, or false. There is no guarantee that parental values need to be isolated as claims that are always false and, in many ways, it is a sign of concern of the veracity of one’s beliefs if you assume that any critical assessment is going to lead to an immediate rejection!

The critical thinking that we teach, and consider vital, is a respectful criticism of ideas, rather than people. One of the strengths of a good academic is that they can be critical of an idea, without needing to belittle the thinker (the person behind the idea). I’ve talked about this at length with movement from dualism to relativism and then commitment, under the Perry developmental classifications.

To identify that we should keep children as authority dependent drones, never allowing them to question anything? That is to keep them as children for all of their lives. But this would also lead us to a far darker future than just permanent childhood. Our civilisation is based on thinking, on reaching further, on questioning, on asking “What if?” and then finding answers. What is covered in the section on Knowledge Based Education is a threat to all education at the higher level and, ultimately, something that every educator has to worry about.

This is not a political issue – this is, and always will be, an educational issue. A societal issue. A civilisation issue.

Again, please let this be a joke or a hoax. If this is what a large group of 21st Century Americans can believe is the right way to proceed, then we have a great deal of work to do in informing people of why critical thinking is desirable, rather than some terrible threat to their own authority. But this feels as if it is based in fear, and fear is always very hard to deal with.


The Invisible War – How Do You Find What You Don’t Know You’re Missing?

Photo: jasonEscapist, CC licence, click for details.

[T]here are known knowns; there are things we know that we know.
There are known unknowns; that is to say there are things that, we now know we don’t know.
But there are also unknown unknowns – there are things we do not know, we don’t know.

Donald Rumsfeld, when United States Secretary of Defence

I realise that this quote has been mocked before but I have always found it be both clear and interesting, mainly because accepting that there are things that you don’t know that you don’t know is important. Because of the way our world works now, where most information is heavily filtered in one form or another, it is becoming more a world of unknowns unknowns (things that are so filtered that you didn’t even know that you could have known about them) then a world of known unknowns (things that you have yet to look into but know exist).

I have a student who is undertaking a project exploring ways of exposing the revision history of Wikipedia in a way that makes it immediately obvious if you’re reading something that is generally agreed upon or in massive dispute. The History and Discussion tabs in Wikipedia are, for most people, equivalent to unknown unknowns – not only do they not even realise what they are there for, they don’t think to look. This illustrates one of the most insidious forms of filter, one where the information is presented in a way that appears static and reliable, relying upon the mechanism that you use to give that impression.

How, for example, can a person inside the Chinese web search zone find pictures of Tank Man at Tiananmen Square, if all legitimate searches that might turn up anything to do with it have been altered? If no picture of Tiananmen shows protests or tanks, how do you even know to search for Tank Man? Even if you find a picture of a man standing there, in front of tanks, how do you then discover the meaning of the picture?

I was reminded of the impact of filtering while I was reading Metafilter the other day. One of the Front Page Posts (FPPs) dealt with the call to boycott a Fantasy writer/game article contributor who had advocated the use of rape in fantasy literature as an awesome way to make the story better (in a variety of ways). I started reading the article, because I assumed that I would take issue with this Fantasy author but wanted to read the whole story, and left the page up to see what sort of comments unfolded. Because this could take time, I ignored the page for about 30 minutes.

Then, when I reloaded later, the post had been deleted. Now, because of the way that Metafilter works, a deleted FPP still exists and can be located in the database, but it is no longer linked to the front page and can no longer be modified. So, suddenly, I had an island of effectively hidden and frozen information. Having read the contents, the comments so far, and the write-up, I was still quite interested to follow the story but the unfolding and contribution of other people in the comments thread, which is the greatest strength of Metafilter, was no longer going to happen.

Now there are many of these deleted FPPs in Metafilter, easily accessible if you search for them by number, but they are closed to comment. They are fragments of conversations, hanging in space, incomplete, cast in amber. You can see them but you can’t see the final comments that would have closed the debate, the petering out as the arguments faded, the additional links that would have been added to this shard of the data corpus by the 12,000 active account holders of Metafilter.

Now, of course, whenever you look at Metafilter, you’ll know that for every few stories that you see on the front page, there’s probably at least one deleted one. Whenever you look at Wikipedia’s illusion of a clean white page where everything looks like it’s just been printed, you may realise that this could hide hundreds or millions of updates and corrections behind the scenes.

How does this change your perception of the information that is contained in there?

While it is easy to point to traditional publishing, especially for text and reference books, and point out the elitist cabals and intellectual thuggery that permeated some of these avenues, we must accept that the printed book never changed once it had been printed. To change a printed book, you must excise, burn, overprint, paint, physically retrieve and then re-insert. There is no remote update. There is no way that an invisible war can be waged against the contents of your copy of uncorrected Biggles or that someone thousands of kilometres away can stop you from opening the pages of your history text that describe the Tiananmen Square protests.

We have always had filter bubbles but, at the same time, we had history and the ability to compare fixed and concrete entities with each other. Torn out pages left holes, holes gave us questions, unknowns were discovered. I try very hard to read across and out of my filter bubble, and I strongly encourage my students to do the same, but at the same time I have to remind both myself and them that we are doing what we can within an implicit filter bubble of known knowns and known unknowns.

By definition, even though I’m aware of the possible existence of things that have already been so well hidden from me that I will never find them in my life time, I have no idea where to look to find these unknown unknowns. Maybe that’s why I’m buying more books and magazines at the moment, reading so very widely across the written and the electronic, and trying to commit as much as possible to here?

Do we need to know what we don’t know? How will we achieve this? Is this just another twinge as we move towards a different way of managing information?

What will this post say tomorrow?


You’re Welcome On My Lawn But Leaf Blowers Are Not

I was looking at a piece of software the other day and, despite it being a well-used and large-userbase piece of code, I was musing that I had never found it be particularly fit for purpose. (No, I won’t tell you what it is – I’m allergic to defamation suits.) However, my real objections to it, in simple terms, sound a bit trivial to my own ears and I’ve never really had the words or metaphors to describe it to other people.

Until today.

My wife and I were walking in to work today and saw, in the distance, a haze of yellow dust, rising up in front of three men who were walking towards us, line abreast, as a street sweeping unit slowly accompanied them along the road. Each of the men had a leaf blower that they were swinging around, kicking up all of the Plain Tree pollen/dust (which is highly irritating) and pushing it towards us in a cloud. They did stop when they saw us coming but, given how much dust was in the air, it’s 8 hours later and I’m still getting grit out of my eyes.

Weirdly enough, this image comes from a gaming site, discussing mecha formations. The Internet constantly amazes me.

Now, I have no problem with streets being kept clean and free of debris and I have a lot of respect for the sweepers, cleaners and garbage removal people who stop us from dying in a MegaCholera outbreak from living in cities – but I really don’t like leaf blowers. On reflection, there are a number of things that I don’t like for similar reasons so let me refer back to the piece of software I was complaining about and call it a leaf blower.

Why? Well, primarily, it’s because leaf blowers are a noisy and inefficient way to not actually solve the problem. Leaf blowers move the problem to someone else. Leaf blowers are the socially acceptable face of picking up a bag of garbage and throwing it on your neighbour’s front porch. Today was a great example – all of the dust and street debris was being blown out of the city towards the Park lands where, presumably, this would become someone else’s problem. The fact that a public thoroughfare was a pollen-ridden nightmare for 30 minutes or so was also, apparently, collateral damage.

Now, of course, there are people who use leaf blowers to push leaves into big piles that they then pick up, but there are leaf vacuums and brooms and things like that which will do a more effective job with either less noise or more efficiently. (And a lot of people just blow it off their property as if it will magically disappear.) The catch is, of course, better solutions generally require more effort.

The problem with a broom is that pushing a broom is a laborious and tiring task, and it’s quite reasonable for large-scale tasks like this that we have mechanical alternatives. For brief tidy up and small spaces, however, the broom is king. The problem with the leaf vacuum is that it has to be emptied and they are, because of their size and nature, often more expensive than the leaf blower. You probably couldn’t afford to have as many of these on your cleanup crew’s equipment roster. So brooms are cheap but hard manual labour compared to expensive leaf vacuums which fulfil the social contract but require regular emptying.

Enter the leaf blower – low effort, relatively low cost, no need to empty the bag, just blow it off the property. It is, however, an easy way to not actually solve the problem.

And this, funnily enough, describes the software that I didn’t like (and many other things in a similar vein). Cost-wise it’s a sensible decision, compared to building it yourself and in terms of maintenance. It’s pretty easy to use. There’s no need to worry about being sensible or parsimonious with resources. You just do stuff in it with a small amount of time and you’re done.

The only problem is that what you are encouraged to produce by default, the affordance of the software, is not actually the solution to the problem the the software theoretically solves. It is an approximation to the answer but, in effect, you’ve handed the real problem to someone else – in my case, the student, because it’s software of an educational nature. This then feeds load straight back to you, your teaching assistants and support staff. Any effort you’ve expended is wasted and you didn’t even solve the problem.

I’ve talked before about trying to assess what knowledge workers are doing, rather than concentrating on the number of hours that they are spending at their desk, and the ‘desk hours’ metric is yet another example of leaf blowing. Cheap and easy metric, neither effective nor useful, and realistically any sensible interpretation requires you to go back and work out what people are actually doing during those hours – problem not solved, just shunted along, with a bit of wasted effort and a false sense of achievement.

Solving problems is sometimes difficult and it regularly requires careful thought and effort. There may be a cost involved. If we try to come up with something that looks like a solution, but all it does is blow the leaves around, then we probably haven’t actually solved anything.


Student Reflections – The End of Semester Process Report

I’ve mentioned before that I have two process awareness reports in one of my first-year courses. One comes just after the monster “Library” prac, and one is right at the end of the course. These encourage the students to reflect on their assignment work and think about their software development process. I’ve just finished marking the final one and, as last year, it’s a predominantly positive and rewarding experience.

When faced with 2-4 pages of text to produce, most of my students sit down and write several, fairly densely packed pages telling me about the things that they’ve discovered along the way: lessons learned, pit traps avoided and (interestingly) the holes that they did fall into. It’s rare that I get cynical replies and for this course, from over 100 responses, I think that I had about 5 disappointing ones.

The disappointing ones included ones that posted about how I had to give them marks for something that was rubbish (uh, no I didn’t, read the assignment spec and the forum carefully), ones that were scrawled together in about a minute and said nothing, and the ones that were the outpourings of someone who wasn’t really happy with where they were, rather than something I could easily fix. Let’s move on from these.

I want to talk about the ones who had crafted beautiful diagrams where they proudly displayed their software process. The ones who shared great ideas about how to help students in the next offering. The ones who shared the links that they found useful with me, in case other students would like them. The ones who were quietly proud of mastering their areas of difficulty and welcomed the opportunity to tell someone about it. The one who used this quote from Confucius:

“A man without distant care must have near sorrow”

(人无远虑 必有近忧)

To explain why you had to look into the future when you did software design – don’t leave your assignments to the last minute, he was saying, look ahead! (I am, obviously, going to use that for teaching next semester!)

The Confucian Symbol. Something else to put in my lecture slides for Semester 2, 2012.

Overall, I find these reports to be a resolutely uplifting experience. The vast majority of my students have learnt what I wanted them to learn and have improved their professional skills but, as well, a large number of them have realised that the assignments, together with the lectures, develop their knowledge. Here is one of my favourite student quotes about the assignments themselves, which tells me that we’re starting to get the design right:

The real payoff was towards the end of the assignment. Often it would be possible to “just type code” and earn at least half the marks fairly easily. However there was always a more complex final-­part to the assignment, one that I could not complete unless I approached it in a systematic, well thought out way. The assignments made it easy to see that a program of any real complexity would be nearly impossible to build without a well-­defined design.

But students were also thinking about how they were going to take more general lessons out of this. Here’s another quote I like:

Three improvements that I am aiming to take on board for future subjects are: putting together a study timetable early on in the game; taking the time to read and understand the problem I’ve been given; and put enough time aside to produce a concise design which includes testing strategies.

The exam for this course has just been held and we’re assembling the final marks for inspection on Friday, which will tell us how this new offering has gone. But, at this stage, I have an incredibly valuable resource of student feedback to draw on when I have to do any minor adjustments to make this course better for the next offering.

From a load perspective, yes, having two essays in an otherwise computationally based course does put load on the lecturer/marker but I am very happy to pay that price. It’s such a good way to find out what my students are thinking and, from a personal perspective, be a little more confident that my co-teaching staff and I are making a positive change in these students’ lives. Better still, by sharing comments from cohort to cohort, we provide an authenticity to the advice that I would be hard pressed to achieve.

I think that this course, the first one I’ve really designed from the ground up and I’m aware of how rare that opportunity is, is actually turning into something good. And that, unsurprisingly, makes me very happy.


Who Knew That the Slippery Slope Was Real?

Take a look at this picture.

Dan Ariely. Photo: poptech/Flickr, via wired.com.

One thing you might have noticed, if you’ve looked carefully, is that this man appears to have had some reconstructive surgery on the right side of his face and there is a colour difference, which is slightly accentuated by the lack of beard stubble. What if I were to tell you that this man was offered the chance to have fake stubble tattooed onto that section and, when he declined because he felt strange about it, received a higher level of pressure and, in his words, guilt trip than for any other procedure during the extensive time he spent in hospital receiving skin grafts and burn treatments. Why was the doctor pressuring him?

Because he had already performed the tattooing remediation on two people and needed a third for the paper. In Dan’s words, again, the doctor was a fantastic physician, thoughtful, and he cared but he had a conflict of interest that meant that he moved to a different mode of behaviour. For me, I had to look a couple of times because the asymmetry that the doctor referred to is not that apparent at first glance. Yet the doctor felt compelled, by interests that were now Dan’s, to make Dan self-conscious about the perceived problem.

A friend on Facebook (thanks, Bill!) posted a link to an excellent article in Wired, entitled “Why We Lie, Cheat, Go to Prison and Eat Chocolate Cake” by Dan Ariely, the man pictured above. Dan is a professor of behavioural economics and psychology at Duke and his new book explores the reasons that we lie to each other. I was interested in this because I’m always looking for explanations of student behaviour and I want to understand their motivations. I know that my students will rationalise and do some strange things but, if I’m forewarned, maybe I can construct activities and courses in a way that heads this off at the pass.

There were several points of interest to me. The first was the question whether a cost/benefit analysis of dishonesty – do something bad, go to prison – actually has the effect that we intend. As Ariely points out, if you talk to the people who got caught, the long-term outcome of their actions was never something that they thought about. He also discusses the notion of someone taking small steps, a little each time, that move them from law abiding, for want of a better word, to dishonest. Rather than set out to do bad things in one giant leap, people tend to take small steps, rationalising each one, and after each step opening up a range of darker and darker options.

Welcome to the slippery slope – beloved argument of rubicose conservative politicians since time immemorial. Except that, in this case, it appears that the slop is piecewise composed on tiny little steps. Yes, each step requires a decision, so there isn’t the momentum that we commonly associate with the slope, but each step, in some sense, takes you to larger and larger steps away from the honest place from which you started.

Ariely discusses an experiment where he gave two groups designer sunglasses and told one group that they had the real thing, and the other that they had fakes, and then asked them to complete a test and then gave them a chance to cheat. The people who had been randomly assigned into the ‘fake sunglasses’ group cheated more than the others. Now there are many possible reasons for this. One of them is the idea that if you know that are signalling your status deceptively to the world, which is Ariely’s argument, you are in a mindset where you have taken a step towards dishonesty. Cheating a little more is an easier step. I can see many interpretations of this, because of the nature of the cheating which is in reporting how many questions you completed on the test, where self-esteem issues caused by being in the ‘fake’ group may lead to you over-promoting yourself in the reporting of your success on the quiz – but it’s still cheating. Ultimately, whatever is motivating people to take that step, the step appears to be easier if you are already inside the dishonest space, even to a degree.

[Note: Previous paragraph was edited slightly after initial publication due to terrible auto-correcting slipping by me. Thanks, Gary!]

Where does something like copying software or illicitly downloading music come into this? Does this constant reminder of your small, well-rationalised, step into low-level lawlessness have any impact on the other decisions that you make? It’s an interesting question because, according to the outline in Ariely’s sunglasses experiment, we would expect it to be more of a problem if the products became part of your projected image. We know that having developed a systematic technological solution for downloading is the first hurdle in terms of achieving downloads but is it also the first hurdle in making steadily less legitimate decisions? I actually have no idea but would be very interested to see some research in this area. I feel it’s too glib to assume a relationship, because it is so ‘slippery slope’ argument, but Ariely’s work now makes me wonder. Is it possible that, after downloading enough music or software, you could actually rationalise the theft of a car? Especially if you were only ‘borrowing’ it? (Personally, I doubt it because I think that there are several steps in between.) I don’t have a stake in this fight – I have a personal code for behaviour in this sphere that I can live with but I see some benefits in asking and trying to answer these questions from something other that personal experience.

Returning to the article, of particular interest to me was the discussion of an honour code, such as Princeton’s, where students sign a pledge. Ariely sees it as benefit as a reminder to people that is active for some time but, ultimately, would have little value over several years because, as we’ve already discussed, people rationalise in small increments over the short term rather than constructing long-term models where the pledge would make a difference. Sign a pledge in 2012 and it may just not have any impact on you by the middle of 2012, let alone at the end of 2015 when you’re trying to graduate. Potentially, at almost any cost.

In terms of ongoing reminders, and a signature on a piece of work saying (in effect) “I didn’t cheat”, Ariely asks what happens if you have to sign the honour clause after you’ve finished a test – well, if you’ve finished then any cheating has already occurred so the honour clause is useless then. If you remind people at the start of every assignment, every test, and get them to pledge at the beginning then this should have an impact – a halo effect to an extent, or a reminder of expectation that will make it harder for you to rationalise your dishonesty.

In our school we have an electronic submission system that require students to use to submit their assignments. It has boiler plate ‘anti-plagiarism’ text and you must accept the conditions to submit. However, this is your final act before submission and you have already finished the code, which falls immediately into the trap mentioned in the previous paragraph. Dan Ariely’s answers have made me think about how we can change this to make it more of an upfront reminder, rather than an ‘after the fact – oh it may be too late now’ auto-accept at the end of the activity. And, yes, reminder structures and behaviour modifiers in time banking are also being reviewed and added in the light of these new ideas.

The Wired Q&A is very interesting and covers a lot of ground but, realistically, I think I have to go and buy Dan Ariely’s book(s), prepare myself for some harsh reflection and thought, and plan for a long weekend of reading.