Can't STACK with dev version

[lilyyff]

Hi!! I use the dev version and not getting any errors with msnoise utils test. System in Ubuntu 22.04.
When I use the "Run the simplest MSNoise run ever" method to compute, I have successfully completed the msnoise cc compute_cc step and there are .mseed files in STACKS/01/001_DAYS/.

But when stack:

msnoise cc stack -r
msnoise reset STACK
msnoise cc stack -m

It seems that the calculation is not successful and the only output is:

Lets STACK !
2023-11-17 08:39:08.494405 msnoise [pid 26946][INFO]: There are STACKS jobs for some days to recompute for BP.JCNB.--:BP.SMNB.--
2023-11-17 08:39:08.495489 msnoise [pid 26946][INFO]: Processing BP.JCNB.--:BP.SMNB.---ZZ-1
Lets STACK !
2023-11-17 08:39:11.014132 msnoise [pid 26971][INFO]: There are STACKS jobs for some days to recompute for BP.JCNB.--:BP.SMNB.--
2023-11-17 08:39:11.015170 msnoise [pid 26971][INFO]: Processing BP.JCNB.--:BP.SMNB.---ZZ-1

And only a .nc file appears in DTT2/, STACK2/ folder.
I can't find out why it doesn't stack successfully (and there's no error message reported)?

Besides, every time I enter a command there is an error message about the version, I don't know if it cause stack to fail or not:

/home/z/anaconda3/lib/python3.11/site-packages/msnoise/_version.py:153: UserWarning: msnoise could not determine its version number. Make sure it is properly installed. This for example happens when installing from a zip archive of the msnoise repository which is not a supported way of installing msnoise.
  warnings.warn("msnoise could not determine its version number. Make "
/home/z/anaconda3/lib/python3.11/site-packages/msnoise/_version.py:153: UserWarning: msnoise could not determine its version number. Make sure it is properly installed. This for example happens when installing from a zip archive of the msnoise repository which is not a supported way of installing msnoise.

Thanks for your reply, this will help me a lot:)

[ThomasLecocq]

The new version uses NC files, and that NC file contains all the stacked CCFs (view it as a single large dataframe). So, from there, you should be able to test if the stacks are there by plotting the ccftime -m 5 for example (if you configured mov_stack=1,5 , of course)

[lilyyff]

Thank you! I got a image by using msnoise cc plot ccftime BP.JCNB BP.SMNB -m 30, and there are NC files in DTT2/01/030_DAYS/ZZ/ and MWCS2/01/030_DAYS/ZZ/.
It seems that CC step has been done.

But I got an error when plot mwcs:

$ msnoise cc dvv plot mwcs BP.JCNB BP.SMNB -c ZZ -m30
2023-11-22 04:44:37.529031 msnoise [pid 62861][INFO]: Fetching CCF data for BP.JCNB.--_BP.SMNB.---ZZ-1-30
Traceback (most recent call last):
  File "/home/z/anaconda3/bin/msnoise", line 8, in <module>
    sys.exit(run())
             ^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/msnoise/scripts/msnoise.py", line 1498, in run
    cli(obj={})
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  [Previous line repeated 1 more time]
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/msnoise/scripts/msnoise.py", line 1208, in dvv_plot_mwcs
    main(sta1, sta2, filterid, comp, mov_stack, show, outfile, loglevel=loglevel)
  File "/home/z/anaconda3/lib/python3.11/site-packages/msnoise/plots/mwcs.py", line 99, in main
    xextent = (date2num(id[0]), date2num(id[-1]), -maxlag, maxlag)
                        ~~^^^
IndexError: list index out of range

DVV plot doesnt show up either because FILE DOES NOT EXIST: DVV2/01/030_DAYS/ZZ.nc.
Are NC files not being fetched?

[ThomasLecocq]

for the MWCS plot I have to check if that plot code has been updated to using the NC files...
for the DVV, it requires an extra step : "msnoise cc dvv compute_dvv" that is missing in the documentation.

[lilyyff]

Ahhh...I must be missing the compute_dvv step, but it's still giving an error:

2023-11-22 06:41:49.069651 msnoise [pid 74402][INFO]: *** Starting: Compute DV/V ***
Traceback (most recent call last):
  File "/home/z/anaconda3/bin/msnoise", line 8, in <module>
    sys.exit(run())
             ^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/msnoise/scripts/msnoise.py", line 1498, in run
    cli(obj={})
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/msnoise/scripts/msnoise.py", line 1170, in dvv_compute_dvv
    main(loglevel=loglevel)
  File "/home/z/anaconda3/lib/python3.11/site-packages/msnoise/s07_compute_dvv.py", line 33, in main
    xr_save_dvv(components, filterid, mov_stack, dvv)
  File "/home/z/anaconda3/lib/python3.11/site-packages/msnoise/api.py", line 2276, in xr_save_dvv
    d = dataframe.stack().stack()
        ^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/z/anaconda3/lib/python3.11/site-packages/pandas/core/generic.py", line 5989, in __getattr__
    return object.__getattribute__(self, name)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'Series' object has no attribute 'stack'. Did you mean: 'unstack'?

I think it because the previous steps didn't complete properly...
Besides, could you please tell me how to use dev version to read data calculated by the normal version? (e.g. interferogram, dvv...) I have tried commands but it won't output the image LOL.
Thanks

[ThomasLecocq]

this whole discussion is now outdated with the new dev version changing it all :-) closing