Release notes
Table of contents
v5.3.0
Python 3.8 reaches end-of-life in October 2024, therefore this release drops support for it.
Updates
- Add VLBI-cwl to the container.
- Add
libaio
- Add ripgrep.
- Add
scikit-build
. - Add
torch
. - Add option for local flocs directory to runners.
- Drop support for Python 3.8.
- Install
RMextract
from PyPI. - Update casacore to 3.6.1.
- Update DP3 to v6.2
- Update WSClean to v3.5
Fixes
- Fix
h5py
installation (reported by @cristina-star) - Fix LOFAR LTA client installation (reported by @cristina-star)
- Fix build due to old setuptools (reported by @mat-ole)
v5.2.0
Updates
- Add
Dask[full]
Python package. - Add
statsmodels
Python package. - Added LINC and LOFAR-VLBI to the containers (mainly intended as mount points for local versions) to facilitate Toil usage.
- Update DP3 to
930b81f8
- Update EveryBeam to
df937562
- Update LOFAR-H5plot to v2.9.1
- Update WSClean to
7efb5092
- Upgrade HDF5 to 1.14.3
Fixes
- Added
-e
option for split directions runner. - Fixed RFI strategy parameter for LINC JSON generator.
v5.1.0
Updates
- Added breizorro.
- Added lofarsun.
- Added LoSiTo.
- Added SunPy.
- Added jupyter lab.
- Added LOFAR LTA client.
- Added PyMultiNest properly.
- Added support for the subtract workflow in the LOFAR-VLBI pipeline.
- Automatically bind data and runtime directories if a container is used.
Fixes
- Fixed boolean parsing in
create_ms_list.py
. - Fix DDFacet CPU allocation for Slurm.
- Fix ms list creation arguments VLBI delay calibration runner.
- Fix demix argument type for LINC configs.
- Fix spurious apostrophes in some runners.
- Removed unnecessary sed in vlbi runners.
v5.0.0
Base container updated to Fedora 38
Updates
- Add altair and polars Python packages.
- Refactored
create_ms_list.py
to be more flexible (not backwards compatible with older versions). - Update ddf-pipeline to 72e5285.
- Update DDFacet to v0.7.2.
- Update DP3 to 4df56d1f.
- Update EveryBeam to d52668ec.
- Update LOFAR H5plot to 2.8.1.
- Update IDG to 011687ed.
- Update WSClean to 843f87c8.
Fixes
- Split-Directions runner now clones the master branch again.
v4.5.0
Container will now follow flocs naming scheme: flocs_vx.Y.Z_<march>_<mtune>_{mkl/aocl}[_cuda].sif
Updates
- Add
bc
- Add missing
--min_unflagged_fraction
option tocreate_ms_list.py
. - Add lotss-hba-survey scripts.
- Add
rename_MS_from_LTA.sh
for renaming files downloaded from the LTA through wget. - Add
extract_MS_and_compress.sh
to extract MS tarballs, dysco compress them and remove the full resolution flags. - Add example for the Split-Directions workflow as
run_lofar-vlbi-split-directions.sh
. create_ms_list.py
will now check frequency coverage between LINC calibrator and target.- Downgrade DP3 back to 161559ff to make DD solints work with model columns.
- Renamed
run_lofar-vlbi.sh
example torun_lofar-vlbi-delay-calibration.sh
. - Replace sub-sources-outside-region.py with facetselfcal version.
- Set the unflagged fraction limit for LINC to 5% in the example runner, because 50% is annoying.
- Update example runners to produce cleaner output. Temporary directory will now be renamed to
L<obsid>_<pipeline>
after a run, e.g.L123456_LINC_calibrator
. - Update ddf-pipeline to 712618b.
- Update LOFAR H5plot to 2.8.0.
Fixes
- Fix
filter_baselines
argument in LINC calibrator runner. - Fix missing calibrator solutions argument in LINC target runner.
- Fix running LINC target without container.
- Fix some issues when using the runners without container argument.
- Include DP3 aoflagger update required to run delay calibration.
v4.4.0
Updates
- Add
SciencePlots
Python package. - Fix default baseline selection for LINC target.
- Custom LINC runners are now included, intended to be mildly user friendly and require no editing of scripts for default runs. See
run_LINC_calibrator.sh -h
andrun_LINC_target.sh -h
. - Experimental VLBI-cwl runner included. See
run_lofar-vlbi.sh -h
. - Update DP3 to
161559ff
. - Update EveryBeam to
22cd113b
. - Update WSClean to
a5b4e037
.
Fixes
- Do not remove lofarstman after installation.
v4.3.1
Updates
- Add bces, bilby, nmmn, numdifftools and pymultinest
- Add nomacs image viewer
- Add LINC concatenation averageing options to create_mslist.py
- Clean up lofar-vlbi runner
- Update python-casacore to 3.5.2
v4.3.0
Updates
- Add RM-Tools
- Add shadeMS
- Update AOCL to version 4
- Update
create_mslist.py
to include all LINC settings. - Update DP3 to 161559ff
- Update EveryBeam to 22cd113b (support for MeerKAT beam)
- Update OpenBLAS to v0.3.22
- Update Toil to 5.10
- Update WSClean to 1c1c1d73 (support for MeerKAT beam)
Fixes
- Added missing MKL library path.
- Clean up LINC runners.
- Fix ddf-pipeline boostrap crash.
v4.2.2
Fixes
- Downgrade IPython to 8.10.
v4.2.1
Updates
- Deprecate
generic
container in favour ofsandybridge
container since AMD now has a specific container and 12 year old hardware seems a reasonable bottom line.
Fixes
- Fix LD_LIBRARY_PATH for Intel oneAPI MKL.
v4.2.0
Updates
- Actually update Intel MKL 2020 to Intel oneAPI MKL 2023.
- Add
rclone
. - Add
swarp
. - Freeze IDG to
f4a3a96c
. - Update WSClean to
test-dd-psf-with-faceting
to support feathering and direction-dependent psfs.
Fixes
- Fix for threading in DP3’s constrained solves.
- Closes #57
- Closes #58
v4.1.0
Major changes
- Container base updated to Fedora 36
- Separate recipe for AMD builds using the AMD Optimizing CPU Libraries (AOCL) added.
Updates
- Add EveryStamp Python package.
- Add SAGEcal’s libdirac for the LBFGS solver (used in e.g LINC’s demixing).
- Add swarp.
- Freeze ddf-pipeline to 37070a9
- Update DP3 to 5dab4c43
- Include debugging tools
gdb
,valgrind
andperf
controlled by theDEBUG
environment variable. - Include debug symbols if
DEBUG
is true. - Update DS9 to 8.5b1.
- Update EveryBeam to 6c7c1fed.
- Update HDF5 to 1.12.1.
- Update Intel MKL to Intel oneAPI MKL.
- Update OpenBLAS to v0.3.22.
- Update WSClean to 65172baf.
Changes
- Build IDG in Release mode instead of Debug.
- Build NumPy manually to link against custom OpenBLAS.
- Build OpenBLAS manually for 128 threads to resolve OpenBLAS threading warnings and crashes.