redrock Change Log

0.22.1 (unreleased)

  • No changes yet.

0.22.0 (2026-03-18)

  • Set ZWARN BAD_TARGET for OBJTYPE != (SKY or TGT). (PR #344).

  • Fix bug for case of single template (PR #346).

  • Downgrade rr columns to lower precision (PR #347).

  • Support numpy/2 and cupy/14 linalg.solve shape requirements (PR #348).

  • Fix np.NaN -> np.nan for numpy 2.x compatibility (PR #350).

  • Prevent too many open files error in multiprocessing mode (PR #351).

0.21.0 (2025-12-04)

First version with numpy/2.x support and first version on PyPI.

  • Use single precision for outputs; update readers (PR #329).

  • Fix native_endian for numpy 2.x (PR #332).

  • Bug fix for --archetypes-no-legendre mode failure and other issues (PR #334).

  • Fix crash when using --allspec (PR #336).

  • Update test matrix to catch additional NumPy 2 warnings; add pyproject.toml file; update other top-level metadata files (PR #341).

  • Track PCA/NMF coeffcients in archetype mode (PR #342).

  • Make DESI packages options for installation (PR #343).

0.20.4 (2025-03-14)

  • Remove DesiTest usage; drops setup.py test support (PR #323)

  • Update readthedocs configuration (PR #324)

  • Remove deprecated test_suite code (PR #326)

  • Add install_redrock_templates script (PR #327)

0.20.3 (2024-11-05)

  • Support –templates accepting multiple files, not just single file or text file with list of files (PR #320).

0.20.2 (2024-08-15)

  • Module file cleanup env vars moved to desimodules (PR #313).

  • Propagate header keywords to the REDSHIFTS HDU (PR #314).

  • Changes to address issues with max_velo_diff variable (PR #317).

  • Add asdict header keyword to load_templates_from_header() (direct commit to main 66a93c77).

0.20.1 (2024-06-04)

Update for Jura run to finish extra large healpix.

  • Better MPI memory management for very large inputs (PRs #310, #311).

0.20.0 (2024-05-03)

Used for DESI Jura run.

  • Add rrdesi –model option to pre-generate model files (PR #283).

  • Add load_templates_from_header (PR #290).

  • Add units to fibermap output (PR #292).

  • Set ZWARN/NODATA to z=0 GALAXY, no SUBTYPE, zero coefficients (PR #294).

  • Add TEMFILnn keywords to header to support non-standard template names (PR #295).

  • Fix read_zscan; add make_fulltype, parse_fulltype to standardize fulltype,spectype,subtype parsing (PR #297).

  • Fix warning from zero-sized array (PR #298).

  • Standardize wavelength -> [-1,1] mapping for Legendre poly (PR #299).

  • Set max_velo_diff to 100 km/s for stars (PR #300).

  • Ensure FITMETHOD holds 4-string NONE (addresses #301) (PR #303).

  • Fix FITMETHOD bytes vs. str for details file output (PR #304).

  • Remove unnecessary desispec dependency (PR #306).

  • refactor template/archetype model eval (PR #293).

  • include negative [OII] flux penalty in final minimization (PR #296).

  • fix max_velo_diff for archetypes (PR #302).

0.19.0 (2024-04-19)

  • Write test files to temporary directory (PR #263).

  • Check template dimension so code works on a single template (PR #264).

  • Versioned templates, NMF support, and updated IGM models (PR #271).

  • Mask significantly negative flux (PR #282).

  • Add results.read_zscan(..., select=targetids=...) option (PR #289).

  • Support for Fastspec PCA templates (PR #260).

  • Archetype updates:

    • Added default –nminima for archetypes (PR #265).

    • Adjust coeff size for Legendre for archetypes (PR #266).

    • Docstring cleanup (PR #267).

    • Fix –archetype_nnearest option (PR #272).

    • fix –archetype-legendre-degree=0 crash corner case (PR #278).

    • per camera prior gpu (PR #255, #259).

0.18.0 (2023-09-14)

Significant speedups through GPU support, and bug fixes for archetype mode.

  • Update API documentation for completeness (PR #229).

  • Fix to force mpprocs=1 when using GPU mode with multiprocessing (PR #230).

  • Remove multiprocessing from rebin (PR #232).

  • Bugfixes for crashes when MPI ranks > ntargets (PR #233).

  • Refactored np.linalg.solve into solve_matrices (PR #234).

  • Fix used of max_gpuprocs (PR #236).

  • Bug fixes for archetype mode (PR #238).

  • Added min/maxwave to templates.py that store wave[0] (PR #239).

  • Fix archetype mode numba conflict (PR #240, #241).

  • Fix archetype mode with wrong input dir (PR #244).

  • Refactor GPU to CPU copying for big speedup (PR #245).

  • Fix unit test_gpu_zscan (PR #247).

  • Update readthedocs config (PR #252).

  • xmax typo leading to segfaults (PR #258).

  • Modified unit tests to ensure that both cupy install and CUDA device (PR #228).

0.17.9 (2023-12-01)

This is a tag of the “opticaldepth” branch used by Allyson Brodzeller to re-process Iron production z>1.6 QSOs with a new HIZ template (redrock-templates tag 0.8.1) and updated optical depth coefficients to match Kamble et al. 2020 (Arxiv: 1904.01110). Although this tag was made after 0.18.0, it was branched prior to that tag and includes all of the 0.18.0 PRs except:

  • Refactor GPU to CPU copying for big speedup (PR #245).

  • Update readthedocs config (PR #252).

This branch will not be merged into main as-is, but the updated coefficients will be included in a future tag to handle multiple optical depth models to support templates trained with different models.

0.17.0 (2023-01-12)

  • Major refactor to expand GPU support; 2x faster on GPUs, 25% faster on CPUs. Also fixes support for files with more than 1k input targets (PR #211, #225, #226).

0.16.0 (2022-08-08)

  • Add rrdesi if __name__ == "__main__" wrapper for multiprocessing robustness (PR #209).

  • Update GitHub test automation (PR #210).

  • Avoid bad fits when ranking zchi2 vs. z minima; fixes redshift pileup for new QSO templates at edges of zscan range (PR #218).

  • gpu-ify zscan (PR #204).

  • Simplify distribution of work to processes (PR #207).

0.15.4 (2022-02-28)

  • Add redrock.templates.eval_model convenience routine (PR #206).

0.15.3 (2022-02-11)

  • Propagate SURVEY and PROGRAM keywords from input files (PR #203).

0.15.2 (2022-01-23)

  • Propagate spec group keywords from input files (PR #202).

0.15.1 (2022-01-20)

  • update top hat prior (PR #199).

  • add dependency keywords to redrock output (PR #200).

  • set zwarn LITTLE_COVERAGE for badamp/badcol (PR #201).

0.15.0 (2021-07-14)

Note: Major changes to output formats; requires desispec >= 0.45.0

  • Split FIBERMAP into FIBERMAP (coadded) and EXP_FIBERMAP (per-exposure) (PR #196).

  • Add additional ZWARN bit masking for known bad input data (PR #196).

  • Rename zbest -> redrock output, update rrdesi option names (PR #198).

0.14.6 (2021-07-06)

  • reserve ZWARN bits 16-23 for end-user; redrock will not set these.

  • Add tophap prior option (PR #194).

  • Switch to github actions for testing (PR #195).

0.14.5 (2021-02-15)

  • Use temporary files + rename to avoid partially written files with the final name in case of timeout (PR #186).

0.14.4 (2020-08-03)

  • Re-enable ability for templates to specify their redshift range (one line update to master).

0.14.3 (2020-04-07)

0.14.2 (2019-10-17)

  • Bug fix for specfiles of different sizes (PR #167).

  • Fix plotting subset of input spectra (PR #168).

  • Add –no-mpi-abort option (PR #170)

0.14.1 (2019-08-09)

  • Minor code cleanup (PRs #162, #164).

  • Add and_mask option for BOSS (PR #165).

0.14.0 (2018-12-16)

  • Adds optional cosmic ray rejection during coadds (PR #156).

  • No longer requires BRICKNAME (PR #157).

  • Fix interactive plotspec window disappearing (PR #161).

0.13.2 (2018-11-07)

Version used for 18.11 software release.

  • Codacy style recommendations (PR #155).

  • Optional redshift prior (PR #152).

0.13.1 (2018-09-26)

  • Fixed problem with new format of make_templates (PR #153).

  • Update code based on codacy recommendations (PR #154).

0.13.0 (2018-08-31)

  • Lower galaxy z_min from +0.005 to -0.005 (PR #136).

  • Support for simutaneous fits of multiple e/BOSS spPlates (PR #137, #141, #147).

  • Bug fix when using subset of targetids (PR #139).

  • Small interface useability updates (PR #142, #143).

  • Fix R normalization cut bug impacting tags 0.12.0 and 0.12.1 (PR #144).

  • Fix bug dictionnary results (PR #145).

  • Mask sky lines 5577 and 9793.5 (PR #146).

  • Standarize ZBEST output format for easier concatenating tables (PR #149).

0.12.1 (2018-07-26)

  • Update DELTACHI2 column definition to match how it is used in ZWARN flag, i.e. excluding other candidates with nearby redshifts (PR #134).

0.12.0 (2018-07-18)

  • Adds optional archetypes (PR #119).

  • Include blank fibers in output with ZWARN NODATA flag (PR #123).

  • Include template name in output (PR #124).

  • Include template and archetype version numbers in zbest output (PR #126, #128, and #131).

  • Update travis testing to astropy=2 python=3 (PR #127).

  • Increase QSO redshift range to z=6 (PR #130).

  • rrplot option for a subset of targetids (PR #132).

0.11.0 (2018-05-10)

  • Catch LinAlgErrors from bad input data (PR #109).

  • Add –nminima option (PR #113).

  • Improve spectra reading speed (PR #114).

  • hdf5 file locking workaround (PR #116).

  • Fix MPI version of LyA transmission correction (PR #117).

  • WD DA and DB templates (PR #118).

0.10.1 (2018-03-30)

  • Default QSO redshift range 0.05-4.0 instead of 0.5-4.0 (PR #107).

0.10.0 (2018-03-29)

  • Correct QSO template for LyA during zscan (PR #104).

0.9.0 (2018-02-23)

  • ivar=0 for edge pix with integral(resolution)<0.99 (PR #94)

  • Restore –ncpu option (PR #95)

  • Adds wrap-redrock MPI wrapper script (PR #97)

  • Robust to input NaN and Inf (PR #99)

  • Adds WD templates (PR #101)

0.8.0 (2018-01-30)

  • Major restructure of MPI and multiprocessing dataflow (PR #67, #73, #76).

  • Fully support desiInstall and DESI infrastructure generally (PR #65).

  • Fix import errors that were preventing RTD builds (PR #91).

  • Add seed to template generation; increase number of stars used (PR #93).

  • Add rrplot script to be called from ipython (PR #90).

0.7.0 (2017-12-20)

  • no ZWARN SMALL_DELTA_CHI2 between same spectype (PR #47)

  • rrdesi –templates can now be folder not just file (PR #44)

  • Allow templates to optionally include redshift range (PR #41)

  • API CHANGE: redrock.io.read_templates() returns dict not list (PR #41)

  • set ivar = 0 where mask != 0 (PR #42)

  • Add NUMEXP and NUMTILE to zbest output (PR #59)

  • Propagate input fibermap into output zbest (PR #59)

0.6.0 (2017-11-10)

  • adds rrboss to process boss spectra (PR #37)

  • refactors multiprocessing parallelism to use less memory (PR #37)

0.5.0 (2017-09-29)

  • adds optional MPI parallelism (PR #34)

0.4.2 (2017-08-14)

  • refactored multiprocessing parallelism to use explicit shared memory (PR #31)

0.4.1 (2017-06-16)

  • add support for new DESI spectra format

0.4 (2017-02-03)

  • add optional truth input to plotspec

  • Fix bug when first target is missing a channel of data

  • external.desi.read_bricks allow glob for list of brick files

  • external.desi.read_bricks read subset of targetids from bricks

  • add support for stars and template subtypes

  • limit galaxy redshift scan to z<1.7

0.3 (2017-01-23)

  • added this file

  • python3 updates

  • refactor internal data object wrappers

  • fit and store multiple minima in chi2 vs. z

  • refactor parallelism

  • add option to fit coadd instead of individual spectra

  • add plotspec

  • experimental: penalize GALAXY template fits with negative [OII] flux

0.2 (2016-03-05)

  • tag for DESI zdc1