This page will contain the activity log of the pyFF+ experiments and endeavours.
Memory usage investigation
Code Block |
---|
from guppy import hpy
import code
hp=hpy()
...
hp.setrelheap()
...
# just print the heap somewhere:h = hp.heap()
log.debug(f"\nheapy: {h}")
# or possibly interrupt the code execution and inspect the hp object:
code.interact(local=dict(globals(), **locals())) |
Un/Pickling etree.ElementTree object
Code Block |
---|
# Create pickled datafile
source = open("edugain.xml", "r", encoding="utf-8")
sink = open("edugain.pkl", "w")
t = objectify.parse(source)
p = pickle.dumps(t).decode('latin1')
sink.write(p)
# Read pickled object back in pyFF
def parse_xml
return pickle.loads(io.encode('latin1'))
In metadata parser:
t = parse_xml(content) #Instead of parse_xml(unicode_stream(content)) |