Release notes

Table of contents

  1. v5.3.0
  2. v5.2.0
  3. v5.1.0
  4. v5.0.0
  5. v4.5.0
  6. v4.4.0
  7. v4.3.1
  8. v4.3.0
  9. v4.2.2
  10. v4.2.1
  11. v4.2.0
  12. v4.1.0

v5.3.0

Python 3.8 reaches end-of-life in October 2024, therefore this release drops support for it.

Updates

  • Add VLBI-cwl to the container.
  • Add libaio
  • Add ripgrep.
  • Add scikit-build.
  • Add torch.
  • Add option for local flocs directory to runners.
  • Drop support for Python 3.8.
  • Install RMextract from PyPI.
  • Update casacore to 3.6.1.
  • Update DP3 to v6.2
  • Update WSClean to v3.5

Fixes

  • Fix h5py installation (reported by @cristina-star)
  • Fix LOFAR LTA client installation (reported by @cristina-star)
  • Fix build due to old setuptools (reported by @mat-ole)

v5.2.0

Updates

  • Add Dask[full] Python package.
  • Add statsmodels Python package.
  • Added LINC and LOFAR-VLBI to the containers (mainly intended as mount points for local versions) to facilitate Toil usage.
  • Update DP3 to 930b81f8
  • Update EveryBeam to df937562
  • Update LOFAR-H5plot to v2.9.1
  • Update WSClean to 7efb5092
  • Upgrade HDF5 to 1.14.3

Fixes

  • Added -e option for split directions runner.
  • Fixed RFI strategy parameter for LINC JSON generator.

v5.1.0

Updates

Fixes

  • Fixed boolean parsing in create_ms_list.py.
  • Fix DDFacet CPU allocation for Slurm.
  • Fix ms list creation arguments VLBI delay calibration runner.
  • Fix demix argument type for LINC configs.
  • Fix spurious apostrophes in some runners.
  • Removed unnecessary sed in vlbi runners.

v5.0.0

Base container updated to Fedora 38

Updates

  • Add altair and polars Python packages.
  • Refactored create_ms_list.py to be more flexible (not backwards compatible with older versions).
  • Update ddf-pipeline to 72e5285.
  • Update DDFacet to v0.7.2.
  • Update DP3 to 4df56d1f.
  • Update EveryBeam to d52668ec.
  • Update LOFAR H5plot to 2.8.1.
  • Update IDG to 011687ed.
  • Update WSClean to 843f87c8.

Fixes

  • Split-Directions runner now clones the master branch again.

v4.5.0

Container will now follow flocs naming scheme: flocs_vx.Y.Z_<march>_<mtune>_{mkl/aocl}[_cuda].sif

Updates

  • Add bc
  • Add missing --min_unflagged_fraction option to create_ms_list.py.
  • Add lotss-hba-survey scripts.
  • Add rename_MS_from_LTA.sh for renaming files downloaded from the LTA through wget.
  • Add extract_MS_and_compress.sh to extract MS tarballs, dysco compress them and remove the full resolution flags.
  • Add example for the Split-Directions workflow as run_lofar-vlbi-split-directions.sh.
  • create_ms_list.py will now check frequency coverage between LINC calibrator and target.
  • Downgrade DP3 back to 161559ff to make DD solints work with model columns.
  • Renamed run_lofar-vlbi.sh example to run_lofar-vlbi-delay-calibration.sh.
  • Replace sub-sources-outside-region.py with facetselfcal version.
  • Set the unflagged fraction limit for LINC to 5% in the example runner, because 50% is annoying.
  • Update example runners to produce cleaner output. Temporary directory will now be renamed to L<obsid>_<pipeline> after a run, e.g. L123456_LINC_calibrator.
  • Update ddf-pipeline to 712618b.
  • Update LOFAR H5plot to 2.8.0.

Fixes

  • Fix filter_baselines argument in LINC calibrator runner.
  • Fix missing calibrator solutions argument in LINC target runner.
  • Fix running LINC target without container.
  • Fix some issues when using the runners without container argument.
  • Include DP3 aoflagger update required to run delay calibration.

v4.4.0

Updates

  • Add SciencePlots Python package.
  • Fix default baseline selection for LINC target.
  • Custom LINC runners are now included, intended to be mildly user friendly and require no editing of scripts for default runs. See run_LINC_calibrator.sh -h and run_LINC_target.sh -h.
  • Experimental VLBI-cwl runner included. See run_lofar-vlbi.sh -h.
  • Update DP3 to 161559ff.
  • Update EveryBeam to 22cd113b.
  • Update WSClean to a5b4e037.

Fixes

  • Do not remove lofarstman after installation.

v4.3.1

Updates

  • Add bces, bilby, nmmn, numdifftools and pymultinest
  • Add nomacs image viewer
  • Add LINC concatenation averageing options to create_mslist.py
  • Clean up lofar-vlbi runner
  • Update python-casacore to 3.5.2

v4.3.0

Updates

  • Add RM-Tools
  • Add shadeMS
  • Update AOCL to version 4
  • Update create_mslist.py to include all LINC settings.
  • Update DP3 to 161559ff
  • Update EveryBeam to 22cd113b (support for MeerKAT beam)
  • Update OpenBLAS to v0.3.22
  • Update Toil to 5.10
  • Update WSClean to 1c1c1d73 (support for MeerKAT beam)

Fixes

  • Added missing MKL library path.
  • Clean up LINC runners.
  • Fix ddf-pipeline boostrap crash.

v4.2.2

Fixes

  • Downgrade IPython to 8.10.

v4.2.1

Updates

  • Deprecate generic container in favour of sandybridge container since AMD now has a specific container and 12 year old hardware seems a reasonable bottom line.

Fixes

  • Fix LD_LIBRARY_PATH for Intel oneAPI MKL.

v4.2.0

Updates

  • Actually update Intel MKL 2020 to Intel oneAPI MKL 2023.
  • Add rclone.
  • Add swarp.
  • Freeze IDG to f4a3a96c.
  • Update WSClean to test-dd-psf-with-faceting to support feathering and direction-dependent psfs.

Fixes

  • Fix for threading in DP3’s constrained solves.
  • Closes #57
  • Closes #58

v4.1.0

Major changes

  • Container base updated to Fedora 36
  • Separate recipe for AMD builds using the AMD Optimizing CPU Libraries (AOCL) added.

Updates

  • Add EveryStamp Python package.
  • Add SAGEcal’s libdirac for the LBFGS solver (used in e.g LINC’s demixing).
  • Add swarp.
  • Freeze ddf-pipeline to 37070a9
  • Update DP3 to 5dab4c43
  • Include debugging tools gdb, valgrind and perf controlled by the DEBUG environment variable.
  • Include debug symbols if DEBUG is true.
  • Update DS9 to 8.5b1.
  • Update EveryBeam to 6c7c1fed.
  • Update HDF5 to 1.12.1.
  • Update Intel MKL to Intel oneAPI MKL.
  • Update OpenBLAS to v0.3.22.
  • Update WSClean to 65172baf.

Changes

  • Build IDG in Release mode instead of Debug.
  • Build NumPy manually to link against custom OpenBLAS.
  • Build OpenBLAS manually for 128 threads to resolve OpenBLAS threading warnings and crashes.