[Rivet] Using zipped I/O

[Corpe, Louie]

Hi Andy,

thanks for following up. Much appreciated - good to know it's not just me!
I've not much experience of the guts of the code which does the zipped code reading, but I can try to dig into it and see if anything is difference between the yoda and rivet implementation.
Let me know if you get anywhere before I do,

Louie

ps:
> it was definitely working at the end of last year,
serves me right delaying doing this study for so long haha!


> On 25 Apr 2018, at 10:45, Andy Buckley <andy.buckley at cern.ch> wrote:
> 
> Hmm, I'm seeing the same problem now. This is *very* strange -- it was definitely working at the end of last year, and the equivalent code in Rivet is still 100% working for reading zipped HepMC files. Looking into it, but with limited time: it'd be good to get multiple eyes on this, if possible.
> 
> Andy
> 
> 
> On 23 April 2018 at 14:58, Corpe, Louie <l.corpe at ucl.ac.uk <mailto:l.corpe at ucl.ac.uk>> wrote:
> Hi Andy,
> 
> thanks for the suggestion. 
> It doesn't seem there is anything bad related to gzip or lib in the YODA config.log...
> (Everything looks like this [1] which looks largely fine).
> There are some other errors regarding a compiler being c++11 or not, but I can't tell if this was problematic, given that everything appears to have compiled ok in the end.
> I've put the config.log here in case you checked : /afs/cern.ch/user/l/lcorpe/public/RivetZippedIO/config.log <http://cern.ch/user/l/lcorpe/public/RivetZippedIO/config.log>
> 
> Still, maybe I went wrong in the installation.. I am on lxplus7, and followed the /2.6.0/rivet-bootstrap-lcg workflow..
> Perhaps I should try on  lxplus6...
> 
> any other thoughts or suggestions welcome.
> 
> All the best,
> 
> Louie
> 
> 
> 
> [1]
> configure:17164: checking zlib.h usability
> configure:17164: /cvmfs/sft.cern.ch/lcg/releases/LCG_85/gcc/4.9.3/x86_64-slc6/bin/gcc <http://sft.cern.ch/lcg/releases/LCG_85/gcc/4.9.3/x86_64-slc6/bin/gcc> -c -g -O2  -DNDEBUG -I/usr/include conftest.c >&5
> configure:17164: $? = 0
> configure:17164: result: yes
> 
>> On 23 Apr 2018, at 14:04, Andy Buckley <andy.buckley at cern.ch <mailto:andy.buckley at cern.ch>> wrote:
>> 
>> Hi Louie,
>> 
>> Are you sure that YODA built with gzip support? IIRC it needs to be able to find the libZ library at compile time. Have a look in your YODA config.log
>> 
>> Andy
>> 
>> Dr Andy Buckley, Lecturer / Royal Society University Research Fellow
>> Particle Physics Experiment Group, University of Glasgow
>> On Apr 23 2018, at 1:59 pm, Corpe, Louie <l.corpe at ucl.ac.uk <mailto:l.corpe at ucl.ac.uk>> wrote:
>> 
>> Hi Riveters,
>> 
>> 
>> I'm trying to use the zipped i/o functionality introduced in Rivet 2.6.0 / Yoda 1.7.0.
>> I can't seem to get it working: is there an example of how to do this somewhere?
>> 
>> I've included a minimal example [1]. Please let me know what I'm doing wrong!
>> The files I used in [1] can be found on my public on lxplus: /afs/cern.ch/user/l/lcorpe/public/RivetZippedIO/examples/ <http://cern.ch/user/l/lcorpe/public/RivetZippedIO/examples/>
>> All the best and thanks in advance !
>> 
>> 
>> Louie
>> 
>> 
>> [1]
>> [lcorpe at lxplus005 scratch]$ gzip -c out1028_DSIDxxx.MEWeight.yoda > examples/out1028_DSIDxxx.MEWeight.yoda.gz
>> [lcorpe at lxplus005 scratch]$ python
>> Python 2.7.5 (default, Aug 4 2017, 00:39:18)
>> [GCC 4.8.5 20150623 (Red Hat 4.8.5-16)] on linux2
>> Type "help", "copyright", "credits" or "license" for more information.
>> import yoda as y
>> a= y.read("examples/out1028_DSIDxxx.MEWeight.yoda.gz")
>> Traceback (most recent call last):
>> File "<stdin>", line 1, in <module>
>> File "yoda/include/IO.pyx", line 107, in yoda.core.read (/afs/cern.ch/user/l/lcorpe/scratch/rivet/YODA-1.7.0/pyext/yoda/core.cpp:85809 <http://cern.ch/user/l/lcorpe/scratch/rivet/YODA-1.7.0/pyext/yoda/core.cpp:85809>)
>> UnicodeDecodeError: 'ascii' codec can't decode byte 0x8b in position 1: ordinal not in range(128)
>> _______________________________________________
>> Rivet mailing list
>> Rivet at projects.hepforge.org <mailto:Rivet at projects.hepforge.org>
>> https://www.hepforge.org/lists/listinfo/rivet <https://www.hepforge.org/lists/listinfo/rivet>
> 
> 
> 
> -- 
> Dr Andy Buckley, Lecturer / Royal Society University Research Fellow
> Particle Physics Expt Group, University of Glasgow

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.hepforge.org/lists-archive/rivet/attachments/20180425/92993f4b/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5451 bytes
Desc: not available
URL: <https://www.hepforge.org/lists-archive/rivet/attachments/20180425/92993f4b/attachment.bin>