GraphViz needs to be installed on the server and dot be in the PATH.
PATH
Mercurial Extension
Frequently Asked Questions