problem with plaindata2sdds

Moderators: michael_borland, soliday

Post Reply
femanov
Posts: 5
Joined: 02 Dec 2008, 14:19

problem with plaindata2sdds

Post by femanov » 05 Mar 2015, 00:09

plaindata2sdds corrupts some data. version (Feb 3 2015) in sdds toolkit 3.3-1 (64bit RHEL).

example of corruption:
commdnd:
plaindata2sdds K2007_01.txt results/k20_07hist.sdds -noRowCount -skipLines=12 -col=I,double,units=A -col=H1,double,units=Gs -col=H2,double,units=Gs -col=H3,double,units=Gs -col=H4,double,units=Gs -col=H5,double,units=Gs -col=H6,double,units=Gs -col=H7,double,units=Gs -col=H8,double,units=Gs -col=H9,double,units=Gs -col=H10,double,units=Gs -col=H11,double,units=Gs

input and output files are attached,
column H7 is corrupted.

I think in 2-3 years old versions the same was working correctly
Attachments
K2007_01.txt
(6.85 KiB) Downloaded 249 times
k20_07hist.sdds
(15.48 KiB) Downloaded 253 times

soliday
Posts: 390
Joined: 28 May 2008, 09:15

Re: problem with plaindata2sdds

Post by soliday » 05 Mar 2015, 11:11

I was able to reproduce the problem on RHEL 7 but not on RHEL 5 or 6. I am looking into it now.

femanov
Posts: 5
Joined: 02 Dec 2008, 14:19

Re: problem with plaindata2sdds

Post by femanov » 05 Mar 2015, 11:42

I am using RHEL 7 now, I have not checked 5-6. Sorry for incomplete information.
There are some signs that it's not the only problem with sdds tools on RHEL7,
but it was first in chain, and easy to check.
Thank you

soliday
Posts: 390
Joined: 28 May 2008, 09:15

Re: problem with plaindata2sdds

Post by soliday » 05 Mar 2015, 12:19

I found the problem with this program. You can get the updated version at:
http://www.aps.anl.gov/asd/oag/download ... dds.rhel.7

After lunch I will try to see if this problem affects other software. I suspect it does for a handful of them. If you know of any other specific programs that are broken, please let me know. Thanks.

femanov
Posts: 5
Joined: 02 Dec 2008, 14:19

Re: problem with plaindata2sdds

Post by femanov » 06 Mar 2015, 01:01

sddsbreak

program from my latest rpm for RHEL7:
Program by Michael Borland. (This is version 4, June 2009.)
command:
sddsbreak results/k20_07hist.sdds results/k20_07histb.sdds -rowlimit=10,overlap=1

segmentation fault
Attachments
k20_07hist.sdds
(30.47 KiB) Downloaded 247 times

soliday
Posts: 390
Joined: 28 May 2008, 09:15

Re: problem with plaindata2sdds

Post by soliday » 06 Mar 2015, 14:00

There was a problem with sddsbreak using the overlap tag in the rowlimit option. I'm not sure if it ever worked before. I fixed it and the RHEL7 version is at:
http://www.aps.anl.gov/asd/oag/download ... eak.rhel.7

I'll create a new RPM once I am done testing a few more programs.

soliday
Posts: 390
Joined: 28 May 2008, 09:15

Re: problem with plaindata2sdds

Post by soliday » 06 Mar 2015, 21:05

The new RHEL7 SDDS ToolKit RPM is at:
http://www.aps.anl.gov/asd/oag/download ... x86_64.rpm

femanov
Posts: 5
Joined: 02 Dec 2008, 14:19

Re: problem with plaindata2sdds

Post by femanov » 06 Mar 2015, 23:52

if you interested in, I have archived data for 2013.05.07 that was correctly processed with sddsbreak on SL6 with the same code. I am sure it was working.

Post Reply