Web annotation has a lot of potential for scholarly research but current tools have several big limitations. At the Humanities Cluster of the Royal Netherlands Academy of Arts and Sciences we are developing a scholarly web annotation tool that allows different types of fine-grained annotations on objects of any media type and combining manual and algorithmic annotations.