sddscombine -merge for FFT
Posted: 02 Oct 2013, 09:07
Dear all,
I really like working with (P)elegant and sdds, it is a great, flexible and fast tool. Currently I am wondering, if I am reaching a limit, but maybe I am just using the tools the wrong way:
I am working with some sdds commands to get a FFT of coordinates (e.g. x(t) or p(t)) recorded at several watch elements around a ring:
1. sddscombine -merge
2. sddsprocess -filter,col,particleID,[...]
3. sddssort -column=t
4. sddsfft -column=t,[...]
It works fine, but I would like to use large data sets like
a bunch of 1,000 particles, 10,000 turns, 30 watch elements.
The tracking is really fast with Pelegant (12 cores), but the analysis takes a long time. I played around with 1.-4. and found out that the most time-consuming command is the -merge option of sddscombine**.
Is there a faster way to prepare the file for the FFT?
Best regards,
Jan
** The fastes way seems to be executing sddscombine without -merge first (to combine the watch-files), then filter a single particleID (2.) and then do sddscombine -merge. But it still takes about 30h for 1000 particles (without the inital sddscombine).
I really like working with (P)elegant and sdds, it is a great, flexible and fast tool. Currently I am wondering, if I am reaching a limit, but maybe I am just using the tools the wrong way:
I am working with some sdds commands to get a FFT of coordinates (e.g. x(t) or p(t)) recorded at several watch elements around a ring:
1. sddscombine -merge
2. sddsprocess -filter,col,particleID,[...]
3. sddssort -column=t
4. sddsfft -column=t,[...]
It works fine, but I would like to use large data sets like
a bunch of 1,000 particles, 10,000 turns, 30 watch elements.
The tracking is really fast with Pelegant (12 cores), but the analysis takes a long time. I played around with 1.-4. and found out that the most time-consuming command is the -merge option of sddscombine**.
Is there a faster way to prepare the file for the FFT?
Best regards,
Jan
** The fastes way seems to be executing sddscombine without -merge first (to combine the watch-files), then filter a single particleID (2.) and then do sddscombine -merge. But it still takes about 30h for 1000 particles (without the inital sddscombine).