Difference between revisions of "Workdocumentation 2022-08-16"
Jump to navigation
Jump to search
Tim Holzheim (talk | contribs) |
|||
| Line 68: | Line 68: | ||
Tue Aug 16 15:10:56 CEST 2022 | Tue Aug 16 15:10:56 CEST 2022 | ||
</source> | </source> | ||
| + | ==== Build ==== | ||
| + | <source lang='bash' highlight='1'> | ||
| + | date;sudo docker build --file Dockerfiles/Dockerfile.Ubuntu20.04 -t qlever .;date | ||
| + | Tue Aug 16 15:13:02 CEST 2022 | ||
| + | Sending build context to Docker daemon 453MB | ||
| + | Step 1/43 : FROM ubuntu:20.04 as base | ||
| + | 20.04: Pulling from library/ubuntu | ||
| + | 3b65ec22a9e9: Pull complete | ||
| + | Removing intermediate container 1ccc2a50364e | ||
| + | ---> d0018440a4cd | ||
| + | Successfully built d0018440a4cd | ||
| + | Successfully tagged qlever:latest | ||
| + | Tue Aug 16 15:25:28 CEST 2022 | ||
| + | </source> | ||
===docker build (xx mins)=== | ===docker build (xx mins)=== | ||
Revision as of 14:31, 16 August 2022
Participants
- Tim
- Wolfgang
Agenda
dblp Qlever
dblp Qlever
on RWTH Aachen DBIS i5 server
wf@confident:/hd/torterra/dblp2022$ wget https://dblp.org/rdf/dblp.nt.gz
--2022-08-16 12:00:18-- https://dblp.org/rdf/dblp.nt.gz
Resolving dblp.org (dblp.org)... 192.76.146.204
Connecting to dblp.org (dblp.org)|192.76.146.204|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2789108619 (2.6G) [application/x-gzip]
Saving to: ‘dblp.nt.gz’
dblp.nt.gz 36%[======> ] 980.73M 38.9MB/s eta 45s
dblp.nt.gz 100%[===================>] 2.60G 34.1MB/s in 76s
2022-08-16 12:01:34 (35.1 MB/s) - ‘dblp.nt.gz’ saved [2789108619/2789108619]
gunzip dblp.nt.gz
ls -l
total 34405612
-rw-rw-r-- 1 wf wf 35231339037 Aug 16 00:16 dblp.nt
QLever installation
https://wiki.bitplan.com/index.php/WikiData_Import_2022-01-29
Environment
lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 20.04.4 LTS
Release: 20.04
Codename: focal
wf@confident:/hd/torterra/qlever$ docker --version
Docker version 20.10.12, build 20.10.12-0ubuntu2~20.04.1
wf@confident:/hd/torterra/qlever$ free -h
total used free shared buff/cache available
Mem: 15Gi 1.2Gi 12Gi 45Mi 1.6Gi 13Gi
Swap: 11Gi 0B 11Gi
Disk space
df | grep -v loop | grep -v tmp | grep -v udev
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/sda3 114226348 55228964 53148860 51% /
/dev/sdb1 3844590624 3266511864 382711544 90% /hd/torterra
QLever code clone
export QLEVER_HOME=$(pwd)
date;git clone --recursive https://github.com/ad-freiburg/qlever qlever-code;date
Tue Aug 16 15:10:09 CEST 2022
Cloning into 'qlever-code'...
remote: Enumerating objects: 14625, done.
remote: Counting objects: 100% (279/279), done.
remote: Compressing objects: 100% (227/227), done.
remote: Total 14625 (delta 133), reused 131 (delta 52), pack-reused 14346
Receiving objects: 100% (14625/14625), 190.60 MiB | 6.48 MiB/s, done.
...
Submodule path 'third_party/stxxl/extlib/foxxll/extlib/tlx': checked out 'ef81a598d9880cc7d242afc47de7328634f07f1d'
Tue Aug 16 15:10:56 CEST 2022
Build
date;sudo docker build --file Dockerfiles/Dockerfile.Ubuntu20.04 -t qlever .;date
Tue Aug 16 15:13:02 CEST 2022
Sending build context to Docker daemon 453MB
Step 1/43 : FROM ubuntu:20.04 as base
20.04: Pulling from library/ubuntu
3b65ec22a9e9: Pull complete
Removing intermediate container 1ccc2a50364e
---> d0018440a4cd
Successfully built d0018440a4cd
Successfully tagged qlever:latest
Tue Aug 16 15:25:28 CEST 2022
docker build (xx mins)
dblp dump download
$ wget -P /hd/torterra/dblp2022 https://dblp.org/rdf/dblp.nt.gz
$ cd /hd/torterra/dblp2022
$ gzip -d dblp.nt.gz