Page 1 of 1

problem with plaindata2sdds

Posted: 05 Mar 2015, 00:09
by femanov
plaindata2sdds corrupts some data. version (Feb 3 2015) in sdds toolkit 3.3-1 (64bit RHEL).

example of corruption:
commdnd:
plaindata2sdds K2007_01.txt results/k20_07hist.sdds -noRowCount -skipLines=12 -col=I,double,units=A -col=H1,double,units=Gs -col=H2,double,units=Gs -col=H3,double,units=Gs -col=H4,double,units=Gs -col=H5,double,units=Gs -col=H6,double,units=Gs -col=H7,double,units=Gs -col=H8,double,units=Gs -col=H9,double,units=Gs -col=H10,double,units=Gs -col=H11,double,units=Gs

input and output files are attached,
column H7 is corrupted.

I think in 2-3 years old versions the same was working correctly

Re: problem with plaindata2sdds

Posted: 05 Mar 2015, 11:11
by soliday
I was able to reproduce the problem on RHEL 7 but not on RHEL 5 or 6. I am looking into it now.

Re: problem with plaindata2sdds

Posted: 05 Mar 2015, 11:42
by femanov
I am using RHEL 7 now, I have not checked 5-6. Sorry for incomplete information.
There are some signs that it's not the only problem with sdds tools on RHEL7,
but it was first in chain, and easy to check.
Thank you

Re: problem with plaindata2sdds

Posted: 05 Mar 2015, 12:19
by soliday
I found the problem with this program. You can get the updated version at:
http://www.aps.anl.gov/asd/oag/download ... dds.rhel.7

After lunch I will try to see if this problem affects other software. I suspect it does for a handful of them. If you know of any other specific programs that are broken, please let me know. Thanks.

Re: problem with plaindata2sdds

Posted: 06 Mar 2015, 01:01
by femanov
sddsbreak

program from my latest rpm for RHEL7:
Program by Michael Borland. (This is version 4, June 2009.)
command:
sddsbreak results/k20_07hist.sdds results/k20_07histb.sdds -rowlimit=10,overlap=1

segmentation fault

Re: problem with plaindata2sdds

Posted: 06 Mar 2015, 14:00
by soliday
There was a problem with sddsbreak using the overlap tag in the rowlimit option. I'm not sure if it ever worked before. I fixed it and the RHEL7 version is at:
http://www.aps.anl.gov/asd/oag/download ... eak.rhel.7

I'll create a new RPM once I am done testing a few more programs.

Re: problem with plaindata2sdds

Posted: 06 Mar 2015, 21:05
by soliday
The new RHEL7 SDDS ToolKit RPM is at:
http://www.aps.anl.gov/asd/oag/download ... x86_64.rpm

Re: problem with plaindata2sdds

Posted: 06 Mar 2015, 23:52
by femanov
if you interested in, I have archived data for 2013.05.07 that was correctly processed with sddsbreak on SL6 with the same code. I am sure it was working.