Release notes

Table of contents

  1. v5.0.0
  2. v4.5.0
  3. v4.4.0
  4. v4.3.1
  5. v4.3.0
  6. v4.2.2
  7. v4.2.1
  8. v4.2.0
  9. v4.1.0

v5.0.0

Base container updated to Fedora 38

Updates

  • Add altair and polars Python packages.
  • Refactored create_ms_list.py to be more flexible (not backwards compatible with older versions).
  • Update ddf-pipeline to 72e5285.
  • Update DDFacet to v0.7.2.
  • Update DP3 to 4df56d1f.
  • Update EveryBeam to d52668ec.
  • Update LOFAR H5plot to 2.8.1.
  • Update IDG to 011687ed.
  • Update WSClean to 843f87c8.

Fixes

  • Split-Directions runner now clones the master branch again.

v4.5.0

Container will now follow flocs naming scheme: flocs_vx.Y.Z_<march>_<mtune>_{mkl/aocl}[_cuda].sif

Updates

  • Add bc
  • Add missing --min_unflagged_fraction option to create_ms_list.py.
  • Add lotss-hba-survey scripts.
  • Add rename_MS_from_LTA.sh for renaming files downloaded from the LTA through wget.
  • Add extract_MS_and_compress.sh to extract MS tarballs, dysco compress them and remove the full resolution flags.
  • Add example for the Split-Directions workflow as run_lofar-vlbi-split-directions.sh.
  • create_ms_list.py will now check frequency coverage between LINC calibrator and target.
  • Downgrade DP3 back to 161559ff to make DD solints work with model columns.
  • Renamed run_lofar-vlbi.sh example to run_lofar-vlbi-delay-calibration.sh.
  • Replace sub-sources-outside-region.py with facetselfcal version.
  • Set the unflagged fraction limit for LINC to 5% in the example runner, because 50% is annoying.
  • Update example runners to produce cleaner output. Temporary directory will now be renamed to L<obsid>_<pipeline> after a run, e.g. L123456_LINC_calibrator.
  • Update ddf-pipeline to 712618b.
  • Update LOFAR H5plot to 2.8.0.

Fixes

  • Fix filter_baselines argument in LINC calibrator runner.
  • Fix missing calibrator solutions argument in LINC target runner.
  • Fix running LINC target without container.
  • Fix some issues when using the runners without container argument.
  • Include DP3 aoflagger update required to run delay calibration.

v4.4.0

Updates

  • Add SciencePlots Python package.
  • Fix default baseline selection for LINC target.
  • Custom LINC runners are now included, intended to be mildly user friendly and require no editing of scripts for default runs. See run_LINC_calibrator.sh -h and run_LINC_target.sh -h.
  • Experimental VLBI-cwl runner included. See run_lofar-vlbi.sh -h.
  • Update DP3 to 161559ff.
  • Update EveryBeam to 22cd113b.
  • Update WSClean to a5b4e037.

Fixes

  • Do not remove lofarstman after installation.

v4.3.1

Updates

  • Add bces, bilby, nmmn, numdifftools and pymultinest
  • Add nomacs image viewer
  • Add LINC concatenation averageing options to create_mslist.py
  • Clean up lofar-vlbi runner
  • Update python-casacore to 3.5.2

v4.3.0

Updates

  • Add RM-Tools
  • Add shadeMS
  • Update AOCL to version 4
  • Update create_mslist.py to include all LINC settings.
  • Update DP3 to 161559ff
  • Update EveryBeam to 22cd113b (support for MeerKAT beam)
  • Update OpenBLAS to v0.3.22
  • Update Toil to 5.10
  • Update WSClean to 1c1c1d73 (support for MeerKAT beam)

Fixes

  • Added missing MKL library path.
  • Clean up LINC runners.
  • Fix ddf-pipeline boostrap crash.

v4.2.2

Fixes

  • Downgrade IPython to 8.10.

v4.2.1

Updates

  • Deprecate generic container in favour of sandybridge container since AMD now has a specific container and 12 year old hardware seems a reasonable bottom line.

Fixes

  • Fix LD_LIBRARY_PATH for Intel oneAPI MKL.

v4.2.0

Updates

  • Actually update Intel MKL 2020 to Intel oneAPI MKL 2023.
  • Add rclone.
  • Add swarp.
  • Freeze IDG to f4a3a96c.
  • Update WSClean to test-dd-psf-with-faceting to support feathering and direction-dependent psfs.

Fixes

  • Fix for threading in DP3’s constrained solves.
  • Closes #57
  • Closes #58

v4.1.0

Major changes

  • Container base updated to Fedora 36
  • Separate recipe for AMD builds using the AMD Optimizing CPU Libraries (AOCL) added.

Updates

  • Add EveryStamp Python package.
  • Add SAGEcal’s libdirac for the LBFGS solver (used in e.g LINC’s demixing).
  • Add swarp.
  • Freeze ddf-pipeline to 37070a9
  • Update DP3 to 5dab4c43
  • Include debugging tools gdb, valgrind and perf controlled by the DEBUG environment variable.
  • Include debug symbols if DEBUG is true.
  • Update DS9 to 8.5b1.
  • Update EveryBeam to 6c7c1fed.
  • Update HDF5 to 1.12.1.
  • Update Intel MKL to Intel oneAPI MKL.
  • Update OpenBLAS to v0.3.22.
  • Update WSClean to 65172baf.

Changes

  • Build IDG in Release mode instead of Debug.
  • Build NumPy manually to link against custom OpenBLAS.
  • Build OpenBLAS manually for 128 threads to resolve OpenBLAS threading warnings and crashes.