Virtuoso performance/Loading

Subject: 	/wd/rapid-load From: 	 Bawden@CreativeCommons.Org Date: 	July 30, 2008 2:38:26 AM EDT To: 	 alanruttenberg@gmail.com

A new version on RDFHerd is installed on Norbert, so here's what you need to know to use the new "rapid-load" virtuoso instance. The server object directory is /wd/rapid-load. So let me do a complete cycle starting from a running server, clearing it, reinitializing it and then reloading it:

cd /wd/rapid-load sudo -u virtuoso rdfherd. status The server is running.

It's running, so stop it:

sudo -u virtuoso rdfherd. stop

Now blow away all of its files:

sudo -u virtuoso rm /wd/rapid-load/* rm: remove write-protected regular file `/wd/rapid-load/Config.pl'? n sudo -u virtuoso rm /db/?/rapid-load/*.db

Note that the mode on Config.pl is set so that it takes extra effort to delete it. (If you delete it anyway, there is a spare copy in /raid/rapid-load/virtuoso-server-Config.pl.) Now configure a new instance and start it up:

sudo -u virtuoso rdfherd. configure sudo -u virtuoso rdfherd. start

Wait until the server has started before proceeding. Now set the password to something:

sudo -u virtuoso rdfherd. change_password Password for Virtuoso user "dba": New password: New password again:

Get ready for a fresh load:

sudo -u virtuoso rdfherd. prepare_for_initial_load Password for Virtuoso user "dba":

And then load it up:

sudo -u virtuoso rdfherd. bundle_update load/neurocommons Password for Virtuoso user "dba":

Five or six minutes later it finishes. You can get a load time report:

sudo -u virtuoso rdfherd. load_stats 166667 (52.91%) medline-mesh 55953 (17.76%) medline-titles 41382 (13.14%) homologene 40764 (12.94%) obo-in-owl 7110 ( 2.26%) galen 1469 ( 0.47%) senselab 953 ( 0.30%) addgene 217 ( 0.07%) skos 192 ( 0.06%) mesh07-eswc06 162 ( 0.05%) sciencecommons 111 ( 0.04%) hcls-transitives 1 ( 0.00%) goa-in-owl/ncbi 0 ( 0.00%) obo-all 0 ( 0.00%) goa-in-owl/ebi 0 ( 0.00%) aba 0 ( 0.00%) gene-owl 0 ( 0.00%) hcls-gene 0 ( 0.00%) mesh-skos 0 ( 0.00%) mesh-qualified-headings 0 ( 0.00%) hcls-20070416 0 ( 0.00%) neurocommons-text-mining 0 ( 0.00%) gene-pubmed 0 ( 0.00%) hcls-pubmesh 0 ( 0.00%) load/neurocommons 314981 Total milliseconds

Now you are back where you started.