Difference between revisions of "Workdocumentation 2022-08-13"

From BITPlan ceur-ws Wiki
Jump to navigation Jump to search
Line 13: Line 13:
 
* VolumeManager then takes dicts to creates Volumes
 
* VolumeManager then takes dicts to creates Volumes
 
* VolumeManager.store() stores to Sqlite database
 
* VolumeManager.store() stores to Sqlite database
 +
<source lang='bash'>
 +
def testReadVolumePages(self):
 +
        '''
 +
        test reading the volume pages
 +
        '''
 +
        vm=VolumeManager()
 +
        vm.loadFromIndexHtml(force=False)
 +
        volumesByNumber, _duplicates = LOD.getLookup(vm.getList(), 'number')
 +
        debug=True
 +
        limit=len(volumesByNumber)+1
 +
        #limit=10
 +
        for number in range(1,limit):
 +
            volume=volumesByNumber[number]
 +
            volume.extractValuesFromVolumePage(debug=False,withPapers=False)
 +
            if debug and volume.valid:
 +
                print(f"{volume.url}:{volume.acronym}:{volume.desc}:{volume.h1}:{volume.title}")
 +
        withStore=False
 +
        if withStore:
 +
            vm.store()
 +
</source>
 +
 
=== Database ===
 
=== Database ===
 
<source lang='bash'>
 
<source lang='bash'>

Revision as of 10:43, 13 August 2022

Participants

  • Beyza
  • Wolfgang

Agenda

CEUR-WS

pyCEURMake

git clone https://github.com/WolfgangFahl/pyCEURmake

Indexparser

  • reads index.html to create volume dicts
  • VolumeManager then takes dicts to creates Volumes
  • VolumeManager.store() stores to Sqlite database
def testReadVolumePages(self):
        '''
        test reading the volume pages
        '''
        vm=VolumeManager()
        vm.loadFromIndexHtml(force=False)
        volumesByNumber, _duplicates = LOD.getLookup(vm.getList(), 'number')
        debug=True
        limit=len(volumesByNumber)+1
        #limit=10
        for number in range(1,limit):
            volume=volumesByNumber[number]
            volume.extractValuesFromVolumePage(debug=False,withPapers=False)
            if debug and volume.valid:
                print(f"{volume.url}:{volume.acronym}:{volume.desc}:{volume.h1}:{volume.title}")
        withStore=False
        if withStore:
            vm.store()

Database

sqlite_web ceurws.db

gsimport/pyOnlineSpreadSheetEditing

git clone  https://github.com/WolfgangFahl/pyOnlineSpreadSheetEditing

Install Liclipse

Python installation

Get a copy of index.html

curl -s http://ceur-ws.org > index.html