Tony O'Hagan - SHELF: the Sheffield Elicitation Framework

Probabilistic judgements e-learning


Elicitation requires experts to make probabilistic judgements, such as median and quartiles, that are difficult and unfamiliar tasks for most experts. Training is always given in a SHELF workshop, but it takes time for experts to understand the judgements required and to make them reliably. The idea of the e-learning course is for experts who will take part in a SHELF elicitation workshop to get exposure to the kinds of judgements they will be required to make, before the workshop itself, and in a relaxed, self-paced way.

The development of the course was funded by a grant from the United States Office of Naval Research for the PCOD+ project whose primary concern was the study of how human disuption, for instance from shipping or wind-farms, affects marine mammals. The course therefore draws particularly on examples from that area, although it is intended for experts from any discipline.

The screen designs and programming are the work of Grifo Multimedia srl.

Take the course

The e-learning course, entitled "Probabilistic Judgements for Expert Elicitation" is open for anyone to use. You are free to take the course by following the links below for the five modules. If you stop in the middle of a module, you will be asked when you start it again whether you wish to continue from where you left off.

It should take no more than two hours to complete the course.

Warning. Some users experience difficulties in the final module, possibly caused by firewall settings. We are still investigating this problem. If you find that the module stops running, leaving you with a blank screen with some pulsing circles that does not move on after a minute or more, then simply close the module. You have anyway finished the course - you will simply not receive feedback on your last set of judgements. You may try using another computer, but will probably have to run the module right through from the beginning again.

Please tell us what you think of the course!


The course can easily be customised for experts in a specific discipline or for a specific organisation. The main customisation task is to change the examples so that they are relevant to the intended audience. If you are interested in creating a customised course, please email Tony O'Hagan.
My home page My academic pages My consulting pages Software and other resources My personal pages Contact me

Last updated: 5 February 2018
Maintained by: Tony O'Hagan