Virtuoso RDF Bulk Loader — isql loader generation from a source folder

Generate a ready-to-run isql .sql from a local folder of RDF files. Two modes:

Workflow

1. Elicit (never guess): source folder (must be accessible to the Virtuoso server process — ld_dir registers server-side paths), target graph IRI (dir mode), file pattern or format list.
2. Generate:

   python3 scripts/generate-bulk-load-sql.py \
     --source-dir /path/to/rdf/ \
     --graph https://example.com/my-graph \
     --pattern '*.ttl' \
     --out bulk-load.sql

3. Run (your credentials, never displayed):

   isql 1111 dba <dba-password> -f bulk-load.sql

4. Monitor (the generated script ends with the load_list check):

   select * from db.dba.load_list where ll_state <> 2;

   ll_state 2 = done; rows remaining = still pending/errored (ll_error column).
5. Verify (generated script ends with per-graph counts):

   SPARQL SELECT ?g (COUNT(*) AS ?t) WHERE { GRAPH ?g { ?s ?p ?o } } GROUP BY ?g;

Options (generate-bulk-load-sql.py)

Notes

• Server-side paths: ld_dir paths are read by the Virtuoso server, not your client. For a remote Virtuoso, stage files on the server first.
• Idempotency: ld_dir does not double-load identical files; rdf_loader_run() may be re-run safely. --clear makes full re-runs replace the graph.
• Troubleshooting: load failures, permission issues, DAV paths, and named-graph management — see the virtuoso-rdf-loader skill (ld_dir + rdf_loader_run deep-dive).
• This skill is the generator generalization of the agent-rdf-memory loader (agent-rdf-memory/scripts/generate-loader-sql.py); that store's refresh-loader.sh is the same pattern in action.

Safe Virtuoso ISQL Error Output

Whenever this workflow invokes OpenLink's native Virtuoso isql client, pass the bare client option COMMAND_TEXT_ON_ERROR=OFF, for example isql {host}:{port} {user} {password} COMMAND_TEXT_ON_ERROR=OFF {script.sql}. Place it before SQL input, script arguments, or -i. OFF maps to the client's internal value 0 and prevents the client from appending the full failed command to error output. The client accepts OFF/ON; literal 0 is rejected. Do not use -u for this setting (-u populates the U argument array). This does not redact secrets from server diagnostics, shell history, or process arguments, so keep credentials out of SQL text and logs. Do not apply this Virtuoso-specific option to unixODBC/iODBC isql clients.