Difference between revisions of "Workdocumentation 2022-08-19"
Jump to navigation
Jump to search
(Created page with "{{PageSequence|prev=Workdocumentation 2022-08-18|next=Workdocumentation 2022-08-20|category=Workdocumentation}} = Participants = * Wolfgang = Agenda = * dblp = dblp = * htt...") |
(→dblp) |
||
| Line 8: | Line 8: | ||
= dblp = | = dblp = | ||
* https://github.com/ad-freiburg/qlever/issues/739 | * https://github.com/ad-freiburg/qlever/issues/739 | ||
| + | <source lang='bash'> | ||
| + | wf@confident:/hd/torterra/dblp2022-08$ . ../qlever/qlever-control/qlever dblp | ||
| + | |||
| + | QLEVER CONFIG | ||
| + | |||
| + | Checking your PATH ... | ||
| + | Added the directory "/hd/torterra/qlever/qlever-control" to your PATH | ||
| + | |||
| + | Setting up bash autocompletion ... | ||
| + | Done, number of completions: 35 | ||
| + | |||
| + | Creating new Qleverfile ... | ||
| + | Copied pre-configured Qleverfile for "dblp" into current directory. | ||
| + | |||
| + | Setup is complete | ||
| + | Type "qlever" and use autocompletion to see which actions are available. Add a | ||
| + | "show" in the end to see what an action does without executing it (for example, | ||
| + | "qlever index show"). Typing "qlever" without arguments gives some basic help | ||
| + | and pointers for further help. Edit your local "Qleverfile" to change settings. | ||
| + | |||
| + | wf@confident:/hd/torterra/dblp2022-08$ qlever get-data | ||
| + | |||
| + | This is the "qlever" script, call without argument for help | ||
| + | |||
| + | Executing "get-data": | ||
| + | |||
| + | wget -nc -O dblp.nt.gz https://dblp.org/rdf/dblp.nt.gz | ||
| + | |||
| + | Getting data using GET_DATA_CMD from Qleverfile ... | ||
| + | |||
| + | --2022-08-19 07:16:17-- https://dblp.org/rdf/dblp.nt.gz | ||
| + | Resolving dblp.org (dblp.org)... 192.76.146.204 | ||
| + | Connecting to dblp.org (dblp.org)|192.76.146.204|:443... connected. | ||
| + | HTTP request sent, awaiting response... 200 OK | ||
| + | Length: 2793364255 (2.6G) [application/x-gzip] | ||
| + | Saving to: ‘dblp.nt.gz’ | ||
| + | |||
| + | dblp.nt.gz 100%[===================>] 2.60G 43.3MB/s in 64s | ||
| + | |||
| + | 2022-08-19 07:17:21 (41.8 MB/s) - ‘dblp.nt.gz’ saved [2793364255/2793364255] | ||
| + | |||
| + | |||
| + | wf@confident:/hd/torterra/dblp2022-08$ qlever index | ||
| + | |||
| + | This is the "qlever" script, call without argument for help | ||
| + | |||
| + | Executing "index": | ||
| + | |||
| + | bash -c "zcat dblp.nt.gz | IndexBuilderMain -F ttl -f - -i dblp -s dblp.settings.json --words-from-literals | tee dblp.index-log.txt" | ||
| + | |||
| + | bash: IndexBuilderMain: command not found | ||
| + | |||
| + | wf@confident:/hd/torterra/dblp2022-08$ | ||
| + | Max RAM usage: 0.0 GB | ||
| + | |||
| + | wf@confident:/hd/torterra/dblp2022-08$ ls | ||
| + | Qleverfile dblp.index-log.txt dblp.nt.gz dblp.settings.json | ||
| + | wf@confident:/hd/torterra/dblp2022-08$ vi Qleverfile | ||
| + | # modify USE_DOCKER = true | ||
| + | wf@confident:/hd/torterra/dblp2022-08$ qlever index | ||
| + | |||
| + | This is the "qlever" script, call without argument for help | ||
| + | |||
| + | Executing "index": | ||
| + | |||
| + | docker run -it --rm -u 1001:1001 -v /hd/torterra/dblp2022-08:/index -w /index --entrypoint bash --name qlever.dblp.index-build adfreiburg/qlever -c "zcat dblp.nt.gz | IndexBuilderMain -F ttl -f - -i dblp -s dblp.settings.json --words-from-literals | tee dblp.index-log.txt" | ||
| + | |||
| + | 2022-08-19 05:19:12.735 - INFO: QLever IndexBuilder, compiled on Mon Aug 15 05:40:57 UTC 2022 using git hash 406dda | ||
| + | 2022-08-19 05:19:12.736 - INFO: You specified the input format: TTL | ||
| + | 2022-08-19 05:19:12.737 - INFO: Locale was not specified in settings file, default is en_US | ||
| + | 2022-08-19 05:19:12.737 - INFO: You specified "locale = en_US" and "ignore-punctuation = 0" | ||
| + | 2022-08-19 05:19:12.738 - INFO: You specified "ascii-prefixes-only = true", which enables faster parsing for well-behaved TTL files | ||
| + | 2022-08-19 05:19:12.738 - INFO: You specified "num-triples-per-batch = 5,000,000", choose a lower value if the index builder runs out of memory | ||
| + | 2022-08-19 05:19:12.738 - INFO: Integers that cannot be represented by QLever will throw an exception (this is the default behavior) | ||
| + | 2022-08-19 05:19:12.738 - INFO: Processing input triples from /dev/stdin ... | ||
| + | 2022-08-19 05:22:48.180 - INFO: Input triples processed: 100,000,000 | ||
| + | </source> | ||
Revision as of 07:24, 19 August 2022
Participants
- Wolfgang
Agenda
- dblp
dblp
wf@confident:/hd/torterra/dblp2022-08$ . ../qlever/qlever-control/qlever dblp
QLEVER CONFIG
Checking your PATH ...
Added the directory "/hd/torterra/qlever/qlever-control" to your PATH
Setting up bash autocompletion ...
Done, number of completions: 35
Creating new Qleverfile ...
Copied pre-configured Qleverfile for "dblp" into current directory.
Setup is complete
Type "qlever" and use autocompletion to see which actions are available. Add a
"show" in the end to see what an action does without executing it (for example,
"qlever index show"). Typing "qlever" without arguments gives some basic help
and pointers for further help. Edit your local "Qleverfile" to change settings.
wf@confident:/hd/torterra/dblp2022-08$ qlever get-data
This is the "qlever" script, call without argument for help
Executing "get-data":
wget -nc -O dblp.nt.gz https://dblp.org/rdf/dblp.nt.gz
Getting data using GET_DATA_CMD from Qleverfile ...
--2022-08-19 07:16:17-- https://dblp.org/rdf/dblp.nt.gz
Resolving dblp.org (dblp.org)... 192.76.146.204
Connecting to dblp.org (dblp.org)|192.76.146.204|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2793364255 (2.6G) [application/x-gzip]
Saving to: ‘dblp.nt.gz’
dblp.nt.gz 100%[===================>] 2.60G 43.3MB/s in 64s
2022-08-19 07:17:21 (41.8 MB/s) - ‘dblp.nt.gz’ saved [2793364255/2793364255]
wf@confident:/hd/torterra/dblp2022-08$ qlever index
This is the "qlever" script, call without argument for help
Executing "index":
bash -c "zcat dblp.nt.gz | IndexBuilderMain -F ttl -f - -i dblp -s dblp.settings.json --words-from-literals | tee dblp.index-log.txt"
bash: IndexBuilderMain: command not found
wf@confident:/hd/torterra/dblp2022-08$
Max RAM usage: 0.0 GB
wf@confident:/hd/torterra/dblp2022-08$ ls
Qleverfile dblp.index-log.txt dblp.nt.gz dblp.settings.json
wf@confident:/hd/torterra/dblp2022-08$ vi Qleverfile
# modify USE_DOCKER = true
wf@confident:/hd/torterra/dblp2022-08$ qlever index
This is the "qlever" script, call without argument for help
Executing "index":
docker run -it --rm -u 1001:1001 -v /hd/torterra/dblp2022-08:/index -w /index --entrypoint bash --name qlever.dblp.index-build adfreiburg/qlever -c "zcat dblp.nt.gz | IndexBuilderMain -F ttl -f - -i dblp -s dblp.settings.json --words-from-literals | tee dblp.index-log.txt"
2022-08-19 05:19:12.735 - INFO: QLever IndexBuilder, compiled on Mon Aug 15 05:40:57 UTC 2022 using git hash 406dda
2022-08-19 05:19:12.736 - INFO: You specified the input format: TTL
2022-08-19 05:19:12.737 - INFO: Locale was not specified in settings file, default is en_US
2022-08-19 05:19:12.737 - INFO: You specified "locale = en_US" and "ignore-punctuation = 0"
2022-08-19 05:19:12.738 - INFO: You specified "ascii-prefixes-only = true", which enables faster parsing for well-behaved TTL files
2022-08-19 05:19:12.738 - INFO: You specified "num-triples-per-batch = 5,000,000", choose a lower value if the index builder runs out of memory
2022-08-19 05:19:12.738 - INFO: Integers that cannot be represented by QLever will throw an exception (this is the default behavior)
2022-08-19 05:19:12.738 - INFO: Processing input triples from /dev/stdin ...
2022-08-19 05:22:48.180 - INFO: Input triples processed: 100,000,000