The Web has made it possible for interested participants to assemble themselves into virtual educational communities. In this article we discuss the design of an online scoring system that might be used in computer-based educational contexts. The focus is on the design of the software that supports high psychometric and fairness standards. We first describe the system from the point of view of different participants and then discuss the design of the underlying database, which is at the heart of the system. We close with conclusions regarding the advantages of sound database design and online grading.