Electronic exams in the Finnish universities

Verkkotentti

The Finnish Virtual University organized an online seminar on the 9th of December 2009 about taking exams using computers instead of plain ol’ pen & paper. The potential benefits are obvious: students can choose more freely when (and possibly where) to take the exam, and the teacher doesn’t have to worry about finding the suitable time and space to organize an exam. Four speakers from different universities told us about their solutions in this area during a two-hour Adobe Connect Pro meeting, so attending the conference didn’t require a lot of travelling and it worked surprisingly well.

From the presentations it became obvious that there are really two different philosophies of doing exams electronically:

First, there is the more traditional exam type where the student can book a time slot according to his needs, and then go to the space which has been setup as a dedicated exam environment with a computer shut off from the regular internet and a remote surveillance system (usually a video camera and a microphone recording the student). Even staff or students can be around monitoring the process, providing extra security to discourage cheating. These exams can be just like regular exams where you (usually) aren’t allowed any materials and must know all the details by heart.

Second, there is the completely do-it-anywhere-virtual-exam, where the student can use any online computer to take the test, even from the comfort of ones home if he or she so wants. This usually means that cheating cannot be monitored in any secure way and so the exam itself must be of a different type: learning materials are allowed but the questions are broad in scope and require knowledge that you simply haven’t got the time to learn in the time it takes to complete the exam.

The differences between these two ways of thinking about e-tests are interesting and the exam culture probably depends a lot on the subject being taught/learned, so it was interesting to hear about the different approaches chosen.

The aquarium approach

Three universities had built an “electronic aquarium” -type solution, of which two – the University of Jyväskylä (UJ) and Lappeenranta University of Technology (LUT) – had a solution based on the SoftTutor application. LUT had an aquarium in their library building, with 10 machines (seats) and 4 cameras monitoring the place, as well as some paid students on monitoring duty. About 30 teachers are taking advantage of the system at the University, especially for the “maturity test” (fin. kypsyysnäyte, a small exam that tests the student’s knowledge of his/her thesis).

Jyväskylä has a similar solution, with 12 seats and 6 drawing tablets, enabling some sort of free hand drawing to be added to the the exam. 8 courses and 7 teachers were using this electronic exam system as a compliment to the normal exams.  The University of Helsinki has a few different approaches to electronic exams, of which the oldest has been the aquarium system called “Tenttiakvaario”, which is currently in use on the Viikki Campus (3 seats) and at the Faculty of Law and Order… awww, ok, just the Faculty of Law (1 seat), so this is a smaller scale solution that students and teachers nevertheless have been happy with.

The more Out-of-the-box approach

At Tampere the University has taken the course management system Moodle and uses its quiz module for making exams, with the goal of having large groups of students taking the exams in a short time period. Electronic exams have been seen as being especially helpful with organizing book exams, that students need to take sporadically.  Using existing computer classes especially the summer exams have been popular – during the summer of ’09 927 exams were taken.  The exams were monitored, as with the previous examples, using access control cards, video surveillance and spot checks.

At the University of Helsinki Moodle has also been thought of as a way to make remote exams, and then of course the exams themselves have to be re-thought because surveillance is next to impossible to organize.  For example, exams then have to be more “putting knowledge in practice”-type broad questions than questions asking for detailed tidbits of knowledge. This approach could in the future mean great savings to space costs if people could do exams on their home computers instead of being dependent on expensive computer classes. And space costs are always an issue in Helsinki.

It was nice to hear these stories, and I think electronic ways of taking exams – or really any new way of grading & monitoring learning – could be helpful, but maybe the biggest challenge then is to embrace the new possibilities instead of trying to fit the old ways into new technology. It is an frustrating idea that you have all that processing power and networked knowledge at your fingertips, but you’re only allowed to write text in a Word document during the exam.

Edit – forgot the music to this post, here it is – a soothing piano piece (no video) by Eluvium, the album Copia is really great!
[youtube http://www.youtube.com/watch?v=_rEkxKhCp40]

Further reading:

The seminar presentations:
http://palvelut.virtuaaliyliopisto.fi/palvelut/seminaarihuone/?q=node/179

Tenttiakvaario at the University of Helsinki:
http://ok.helsinki.fi/tentti/

Verkkoja kokemassa: Turku, 8-9.10.2009

The Educational Centre for ICT arranged a trip to the former capital of Finland, Turku, where the E-learning network attended the “Verkkoja kokemassa” -seminar. The seminar is an annual event which – unsurprisingly – explores the themes of e-learning. It’s always nice to visit Turku and as an added bonus I also briefly hooked up with an ol’ friend from the biology studying days. Oh, and a small disclaimer: this is actually mostly a reflection piece for my self and not an exhaustive seminar report. So there, you have been warned… 😉

Turku_ICT_sali

The first day’s theme was Focus on Students & Sociality – and that´s sociality as in social media: yep, it should come as no surprise that everyone and his grandmother are cultivating the term “social media” in every e-learning sentence these days. Päivi Häkkinen from the University of Jyväskylä introduced a concept that was new to me, “Pedagogical scripts”, which seemed similar to having a screenplay for the course where certain events are scripted (like in computer games) to achieve the desired learning effect. Of course, what this again boils down to is that actual work and planning is required to get any benefits from ICT even in collaborative learning situations. Relying on students sorting matters out among themselves and Just Learning (TM) doesn’t work, and the input of teachers is still needed as computers don’t do the work for them. So the central point from the perspective of e-learning once again becomes: plan how to use ICT correctly.

Turku_SL

Second Life (SL) once again reared its blocky 3d-head in one of the workshops. The main presenter Irma Mänty (Laurea polytechnic) had been enthusiastic enough about SL to print a very nice, almost life-sized cardboard copy of her SL-avatar (see picture). Like Irma I also think that identifying with your avatar makes these kinds of environments more attractive and you might behave more like in real life because of that, but I’m also more and more convinced that a free, Open Source environment hosted by the world’s leading universities (for example) is required to really make this kind of environment bloom. Second Life, IMO, is just a bit old fashioned and clumsy compared to modern 3d-games, and a piece of land costs too much, but OTOH it is currently the best bet available and there’s still an ongoing buzz about using SL in education. Some of the teaching examples – like taking students in tourism and language to visit appropriate culturally interesting SL locations (like the virtual Rome) were nice ideas. Again, it requires lots of planning ahead to get educational benefits out of Second Life.

The second day started with a couple of  nicely contradictory (or so it seemed initally) talks on video: Olli-Pekka Kangas from the University of Turku demonstrated how much hard work goes into creating good educational videos whereas Mauri Kantola from the Turku polytechnic school wanted teachers to start making videos with the bar lowered as low as possible – think shooting a lecture with your mobile phone and just putting it on the web without editing it (or only slightly with Windows Movie Maker). Of course, these guys were really talking about slightly different things: Mauri wanted teachers to make their first video with no quality requirements, just to get them started and realize that they can use videos for spicing up their educational materials. Olli-Pekka then reminded us of what it then takes to get to decent quality levels – it will cost you lots of time and money too. Like all ICT, a good educational video also requires planning ahead (heard that one before?).

Tarmo Toikkanen held a nice talk about the Creative Commons -license [wikipedia.org], a presentation quite heavily influenced by the (excellent) documentary film RiP: A Remix Manifesto. I’m personally a big fan of the Creative Commons license(s), and it greatly simplifies life in this copyright-jungle world – hopefully it will also make a big splash in education. I do think, however, that if I ever make a hit song, me and my children (and grandchildren) should be able to live off the royalties of that piece of music [wikipedia.org]. That’s only fair 😉

Wrapping up the seminar was self-made man Teemu Arina from his own company Dicole Oy, who I’d previously seen a couple of years ago demonstrating a course running on a blog platform with peer reviewing being a central aspect of the learning process – I liked that presentation. This time the talk was a bit more abstract with lots of flashy visuals and a slight rock star – attitude to the subject, which was a concept called fractal learning. The intellectually stimulating presentation had lots of food for thought but also some things which might have been more style than substance, confusing matters somewhat perhaps. What I’d truly like, however – and this is often missing on any subject regarding pedagogy – is some scientific data to back up claims that “fractal learning” or any such concept is something to “bet on”. I’m always thinking that when we are planning our teaching on certain pedagogical concepts assisted by certain ICT-tools, we’re “betting on horses” in regard to what tools and concepts we use, and the goal is of course to make the students learn what they should  optimally learn, that is to “win the race”. So, as a teacher I’d like to bet on the winning horse (not that I really teach, as I’m a support person for teachers, but still…)!

Thus, science is required to help us bet on the right horses, me thinks, and not just on any idea that feels fresh and intuitively innovative. But of course, if a teacher finds that a certain piece of untested theory/technology makes him/her enthuastic about teaching, it doesn’t have to be that scientifically proven – whatever makes you think about what students should learn and how you could achieve that is always a positive factor. We humans like style as well as substance, so perhaps a mixture of both is the winning combination even in education! At least a bit of flair helps the audience in staying awake, people should learn from Teemu in that regard… 😉

All in all, food for thought and a great time in Turku with cool people! Hopefully next year again… and oh yes, from now on I will end every post with a piece of music; the first post-post music is Fever Ray from Sweden with a great song from a suitably autumn-ish album that I’ve recently enjoyed:

[youtube http://www.youtube.com/watch?v=aX07gCjT7dA]

Further reading:

Verkkoja kokemassa – esitykset (presentations on the official seminar page)

RiP: A Remix Manifesto (homepage of the documentary)

Creative Commons homepage

Self-diagnosis: v.2.0 (beta)

selfdiagnoseLast week, an 18-year old girl was reported to have diagnosed her own disease in science class at school [cnn.com]. Apparently doctors had missed the granuloma characteristic of Chron’s disease [wikipedia.org] on slides of her intestinal tissue, but the girl had later requested the slides and found the signs of inflammation herself after several years of suffering from the undiagnosed illness. Of course, self-diagnosis is not recommended for serious issues and educated doctors are always needed (even if they are sometimes wrong), but it is already probably clear to most that the age of internet has given people a lot of information (and disinformation) about medicine as well, something I’m sure the professional practicers of medicine probably have noted when their patients come in and start throwing out probable diagnoses and treatments to their illness straight out of Wikipedia.

We ourselves are the persons most concerned for our own welfare and the typical doctor in Finland has too little time for each patient [terveysportti.fi]), so there might be something that people could do themselves that could help the professionals before coming to the appointment, or afterwards if the medical condition is hard to diagnose. Of course, doctors should always call the shots since wrong diagnoses can sometimes be worse than the actual illness so it’s better to have a real doctor to blame it on if that happens! 😉 One thing that would make life easier for the patient would be if all the accumulated lab tests, x-rays etc. over the years would exist in some database that the patient him-/herself could access to better (and watch results detoriate as one gets older, ha). Something like a medical version of Nintendo’s excercise game Wii Fit [wikipedia.org].

Web tools & gene testing kits

The world of self-diagnosis is evolving on at least two fronts: diagnostics websites (sort of an evolution of the family doctor books) and the latest craze, genetic self testing kits which are more about finding about probabilities that you might get some inherited disease if you carry certain alleles in your genetic luggage.

A popular self-diagnosis help site is My electronic MD: http://www.myelectronicmd.com/

Interestingly, a Slashdot user noticed that making a query using this tool with the symptoms the 18-year old experienced (female, chronic diarrhea, fever) brings up Chron’s disease in the top 3 candidates for the diagnosis.

And let’s not forget owners of pets, there are a few similar services for veterinary medicine also (meant for vets, but pet owners could start using them as well – hopefully not too confidently):

Consultant (University of Cornell): http://www.vet.cornell.edu/consultant/Consult.asp
5-minute Veterinary Consult: https://app.vetconnect.com/5min/toc/000.htm

myemdThen there are the genetic self testing kits which bring a new dimension to a lot of things –  here’s a story on MIT’s Technology Review about the rise of these gene kits which were recently demonstrated on the first annual consumer genetics show in Boston. Imagine knowing that you carry a gene for some disesase that could with some probability shorten your life span. And imagine what your employer or insurance company could do with that information. Well, we’ll see if these kits will spread to Europe and if the whole thing is a fad or not… but if the price is right, who wouldn’t check out what his/her genome would tell about life to come – just like checking this week’s horoscope. Ask the stars, ask the amino acids…

Twitter and swine influenza

Twitter logoCan a popular microblogging service like Twitter actually do more harm than good by causing panic through (mis)information in the general public at a time of crisis? This is one question that a blog post on the Foreign Policy -page raises now when a strain of swine influenza [wikipedia.org] has started spreading around the globe among humans and of course raises headlines in the media.

A funny counterpart to the article is this take on the subject from the nice’n’nerdy webcomic xkcd :
http://xkcd.com/574/

And one more swine flu related social media -bit: the use of Google Maps to create a realtime map following the outbreak is interesting [Update 12.5.09: map no longer running on regular Google Maps because of amount of data used], and depending on how big this thing get can be interesting to follow. Google even has a flu trends -service, at least for the U.S., but more of this in the original article – read that for an interesting blog piece on the subject.

As a side note I might mention that I quit Twitter after a week (see my previous and first post on the subject), I just didn’t feel comfortable with it at this point. Writing these blog posts is enough for me right now. I find the similar Yammer -service more useful since most of the other university e-learning people I work with are there –  thus I have a ready community in Yammer ready for me that I didn’t have in Twitter.

References:

Swine flu: Twitter’s power to misinform
http://neteffect.foreignpolicy.com/posts/2009/04/25/swine_flu_twitters_power_to_misinform

Uni. of Helsinki and the Web of Tomorrow: Nettifoorumi 31.3.2009

Nettifoorumi

A friend in need is a friend indeed

I attended the Nettifoorumi meeting in the main university building to catch up on the latest developments regarding the web services at the University of Helsinki. One of the big things on the agenda is the upcoming Ystävä (= friend) intranet that will gradually replace the infamous Alma (= a Finnish female name, like “Thelma & Louise” but make it “Alma & Louise”… or, it might just refer to something in latin…) intranet starting in 2010 – at least that’s the plan. Ystävä seems to borrow a lot of ideas from social sites like Facebook and Netvibes, and what with the social web being all about sharing ideas… fine by me 😉 The user interface of Ystävä is marketed as being developed using the experiences from user group testing which sounds good in one way, but I hope the groups really will have a long enough time to actually live with the interface so they spot the real problems that surface in routine use after days or weeks. Oh, and hopefully at least one of the UI designers is a genius.

The difficulty of finding things in Alma is the biggest negative criticism aimed at the current intranet (according to some survey presented at the meeting). The challenge is to hide the stuff that isn’t critically important but still making it possible to find it when it’s needed – the new search function (by Google) has recently been implemented for both internal and external sites, and it certainly helps when searching for the more obscure stuff. Like Alma, the new Ystävä intranet will offer targeted content for the user according to his/her/its (you never know, there might be AI:s or aliens among us) role, with content classes spread over several tabs. Hopefully your own customized page can be set as the first/only page, as I personally only want the stuff I actually use to show up and keep the rest out of sight. One of the ideas presented was the ability to have a separate public and private page, maybe a bit like universes in Netvibes [netvibes.com] or a LinkedIn -page for possible contacts so that they know what your publications etc. are. Also capitalizing on RSS feed functionality is in the works, which is great as Alma currently offers only rudimentary RSS capabilities. And of course integration with most of the other systems (like Moodle, Wiki, WebTraveller, UPJ… there are lots of them on all levels) is planned, hopefully one login will be all it takes to access everything.

Lonely university searches for CMS, please reply

A big part of the upcoming Ystävä intranet is of course the actual content management system (CMS), which will also later on be used for publishing the external www-site. An evaluation round of potential suppliers has been made, and the process now continues to the next critical phase – choosing the supplier. Hopefully the winning bid will do a good job with the system, the CMS used in Alma is a POS. The external site is currently built and updated with Dreamweaver templates, which is fine and dandy for web geeks but errors and synchronization issues and layout blunders happen too often even for simple matters, so a good CMS is for most people probably much better as they can just focus on the actual content side of things while forgetting about the code and layout.

Heaven and Hellsinki

Antti Tolonen from advertising agency Taivas (the “heaven” part I was referring to) had a talk about the current trends in web media; nothing really new if you follow the field (blogs, wikis, twitter etc.) but it’s always nice to hear someone involved with actual money being inspired about the stuff we try to get teachers excited about, and his insights and ideas about site design from the business side of things were nice to hear – esp. as our university gradually looks to become more of a business entity as well (I’m a bit sceptical about all organizations trying to conduct their processess like commercial entities as business is always just about making money and not caring about society, but that’s another subject).

Then Susanna Rautio followed with an interesting presentation of what surveys say about the international appeal of our www-pages. Basically, the visual appeal was criticized and there was too much information and too few bells and whistles (even if I personally don’t care for flash-y presentation videos made with six figure budgets). We then had a short workshop about how to improve the international appeal of the pages, which was helpful in seeing what the problems are and what the solutions can be – hopefully this information will be used by the arrangers.  Of course a big problem here is that resources for making pages in English (or Swedish for that matter) are scant.  The actual content is always on the Finnish pages, while the other two supported languages mostly get some translations of the (hopefully) most important stuff – therefore, some management of what kind of targeted English content is put out is needed because the resources for translating everything aren’t there. Also, having professionally taken photos is important in making the site look good (more important than flash) and so, finally a photo repository for our use was presented with sets of rights-cleared photos. Much appreciated, great!

In addition to search functions, Google seems to have penetrated our university with Google Analytics, so now we finally know who’s watching us. Nice! Spring is here, the seeds have been sown and we’ll see what has bloomed and what the harvest will be like later on – now go out and enjoy some sunshine [youtube.com] 🙂

Links:

»» Ystävä 2010-blog