Universiteit van Amsterdam

Events

Institute for Logic, Language and Computation

Please note that this newsitem has been archived, and may contain outdated information or links.

2 October 2013, Computational Social Choice Seminar, Toby Walsh

Speaker: Toby Walsh
Title: The PeerRank Method
Date: Wednesday 2 October 2013
Time: 16:00
Location: Room F1.15, Science Park 107, Amsterdam

Abstract

I propose the PeerRank method for peer assessment. This constructs a grade for an agent based on the grades proposed by the agents evaluating the agent. Since the grade of an agen is a measure of their ability to grade correctly, the PeerRank method weights grades by the grades of the grading agent. The PeerRank method also provides an incentive for agents to
grade correctly. It rewards agents who grade well, and penalises those that grade poorly. As the grades of an agent depend on the grades of the grading agents, and as these grades themselves depend on the grades of other agents, I define the PeerRank method by a fixed point equation similar to the PageRank method for ranking web-pages. I identify some formal
properties of the PeerRank method, discuss some examples, compare with related work and evaluate the performance on some synthetic data.

For more information, see http://www.illc.uva.nl/~ulle/seminar/ or contact Ulle Endriss ().

Please note that this newsitem has been archived, and may contain outdated information or links.