Workdocumentation 2022-08-16

edit

Participants

• Tim
• Wolfgang

Agenda

dblp Qlever

dblp Qlever

• https://github.com/WolfgangFahl/pyCEURmake/issues/18

on RWTH Aachen DBIS i5 server

wf@confident:/hd/torterra/dblp2022$ wget https://dblp.org/rdf/dblp.nt.gz
--2022-08-16 12:00:18--  https://dblp.org/rdf/dblp.nt.gz
Resolving dblp.org (dblp.org)... 192.76.146.204
Connecting to dblp.org (dblp.org)|192.76.146.204|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2789108619 (2.6G) [application/x-gzip]
Saving to: ‘dblp.nt.gz’

dblp.nt.gz           36%[======>             ] 980.73M  38.9MB/s    eta 45s 
dblp.nt.gz          100%[===================>]   2.60G  34.1MB/s    in 76s     
2022-08-16 12:01:34 (35.1 MB/s) - ‘dblp.nt.gz’ saved [2789108619/2789108619]
gunzip dblp.nt.gz
ls -l
total 34405612
-rw-rw-r-- 1 wf wf 35231339037 Aug 16 00:16 dblp.nt

QLever installation

https://wiki.bitplan.com/index.php/WikiData_Import_2022-01-29

Environment

lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 20.04.4 LTS
Release:	20.04
Codename:	focal
wf@confident:/hd/torterra/qlever$ docker --version
Docker version 20.10.12, build 20.10.12-0ubuntu2~20.04.1
wf@confident:/hd/torterra/qlever$ free -h
              total        used        free      shared  buff/cache   available
Mem:           15Gi       1.2Gi        12Gi        45Mi       1.6Gi        13Gi
Swap:          11Gi          0B        11Gi

Disk space

df | grep -v loop | grep -v tmp | grep -v udev
Filesystem      1K-blocks       Used Available Use% Mounted on
/dev/sda3       114226348   55228964  53148860  51% /
/dev/sdb1      3844590624 3266511864 382711544  90% /hd/torterra

QLever code clone

export QLEVER_HOME=$(pwd)
date;git clone --recursive https://github.com/ad-freiburg/qlever qlever-code;date
Tue Aug 16 15:10:09 CEST 2022
Cloning into 'qlever-code'...
remote: Enumerating objects: 14625, done.
remote: Counting objects: 100% (279/279), done.
remote: Compressing objects: 100% (227/227), done.
remote: Total 14625 (delta 133), reused 131 (delta 52), pack-reused 14346
Receiving objects: 100% (14625/14625), 190.60 MiB | 6.48 MiB/s, done.
...
Submodule path 'third_party/stxxl/extlib/foxxll/extlib/tlx': checked out 'ef81a598d9880cc7d242afc47de7328634f07f1d'
Tue Aug 16 15:10:56 CEST 2022

dblp dump download

see https://dblp.org/rdf/

$ wget -P /hd/torterra/dblp2022 https://dblp.org/rdf/dblp.nt.gz
$ cd /hd/torterra/dblp2022
$ gzip -d dblp.nt.gz