Differences between revisions 17 and 18
Deletions are marked like this. Additions are marked like this.
Line 15: Line 15:

=== CCDPACK ===

 * Add NORM parameter to MAKEFLAT.
 * Correct provenance propagation in CALCOR.

Starlink Software Collection - Kapuahi Release Notes



  • Kapuahi is required in order to reduce SCUBA-2 data.
  • New PAL library replaces SLA in all C applications.
  • CNF now used to provide mutex when entering C interfaces to Fortran routines. This allows multi-threaded C applications to call Fortran routines.
  • ADAM applications now respect the MSG_SZOUT environment variable to control the width of output messages.

New Applications

Changes to Applications


  • Add NORM parameter to MAKEFLAT.
  • Correct provenance propagation in CALCOR.



  • FINDCLUMPS GaussClumps method now excludes peaks below the specified threshold from the output catalogue and NDF.

  • Improvements to the FINDCLUMPS GaussClumps method has improved its ability to decompose merged clumps.

  • FINDBACK now uses mutiple processors or cores (if available) to speed up the the procesing of independent slices.
  • FINDBACK can now find and use an independent default noise value for each slice of supplied NDF.




See http://www.oracdr.org/oracdr/ChangeLog


  • New command UNMAKEMAP creates artificial SCUBA_2 data from a trial sky image and a set of real SCUBA-2 raw data files.
  • New command SC2MAPFFT.
  • New command SC2FILTERMAP.
  • New command MCEHEAD2CAT reads the MCE configuration from SCUBA-2 data files.
    • Pointing corrections for the input raw data can now be specified via a text file, using new parameter POINTING.
    • CONFIG parameters that specify a number of samples can now also be given in terms of seconds.
    • New CONFIG parameter "SAMPCUBES" creates an output cube that contains all the data values that are combined to make each output map pixel value.
    • New CONFIG parameter "COM.PERARRAY" allows a separate common mode signal to be estimated and used for each sub-array.
    • The COM model can now be masked to omit source samples from the common mode estimation.
    • The FLT model can now be masked to omit source samples when estimating the low frequency background of each bolometer time stream.
    • SNR masks for the AST, COM and FLT models can now be taken down to much lower levels without introducing isolated noise spikes into the mask.
    • A bug has been fixed that caused the memory requirements to grow monotonically when running MAKEMAP repeatedly as a monolith (e.g. from ORAC-DR or ICL).
    • New distortion model for the SCUBA-2 focal plane.
    • The REF parameter can now be used to specify and external mask.
    • The FLT model is now more robust.
    • Updated Water Vapor Monitor calculation. The WVM samples are now smoothed before being used.
    • New config parameter "GROUPSUBARRAY" to enable subarrays to be processed independently.
    • New config parameters "NOISECLIPHIGH" and "NOISECLIPLOW" control clipping of outlier noisy bolometers.
    • New config parameter "COM.NOFLAG" can turn off flagging of bolometers from common-mode calculation.
    • The ITERMAP config parameter can now be set to -1 to write out the final iteration of each chunk.
    • Setting config parameter DOWNSAMPSCALE to -1 will auto-scale to the pixel size. This is now the default.
    • New config parameter "AST.GAUSSBG" can be used to Gaussian smooth or background remove the map during iterations.
    • Added a new template matching model (TMP).
    • Updated extinction parameters.
    • A bug has been fixed that led to incorrect weighting and exposure times whem multiple chunks were being reduced simultaneously.
    • The variance calculation in the output map is much more robust.
    • New config parameter "MAPTOL" provides a map-based scheme for testing convergence.
    • The step-finder has been improved.
    • The option to use disk files during iteration (memiter=0) has been removed.
    • New config parameter "NOI.BOX_SIZE" can be used to weight subsections of time-series independently. This can correct for a bolometer suddenl$
    • A bad flatfield ramp now disables the associated science data rather than be ignored.
    • A new ADAM parameter NBOLOEFF contains the effective bolometer count from MAKEMAP.
    • Calculate precipitable water vapor values.
    • Calculate telescope speed.
    • Bad values are now written out as NaN to provide better compatibility with TOPCAT.
    • CALCNOISE now accepts a map-maker config file for pre-cleaning. The default config includes common-mode removal.
    • Calculate the effective noise and NEP. This is the noise you would get if all bolometers were co-incident.
    • Now works on an NDF section along the time axis.
  • SMAS
    • Now handles Moon data.
    • APERADD is now available using the -a option.
    • Output catalogues can be used to correct pointing in MAKEMAP.
    • Output WCS now includes a focal plane coordinate frame (FPLANE).
    • Empty output tiles are now ignored, and any remaining tiles created as normal.
    • A bug has been fixed that caused the memory requirements to grow monotonically when running MAKECUBE repeatedly as a monolith (e.g. from ORAC-DR or ICL).


  • Addition of SKYDIP2 command to enable SCUBA-2 skydips to be reduced using SCUBA's atmospheric model.


New Libraries


The PAL library is a re-implementation of the Fortran SLA library in C. It uses the SOFA library wherever possible and has a GPL licence. We now use the PAL library in SMURF, AST and most of the perl interfaces. Fortran SLA is used by Fortran applications.


THR is a library to support multi-threaded applications in C. It was extracted from the SMURF application to provide a general infrastructure for other Starlink applications. THR provides a facility for creating thread queues, submitting jobs to the queue and waiting for jobs to complete.


We now ship a copy of the thirdparty SOFA astrometry library. Kapuahi comes with version 2012-03-01.

Changes to Libraries


  • Use CNF to add mutex for C access
  • Minor fix to ARD AST plotting support.


  • Now has extra checks for inconsistent compressed data arrays.


  • The AST distribution now includes a copy of the IAU SOFA library as a replacement for the obfuscated subset of the C SLALIB library used previously.
  • The number of libraries installed by AST has been reduced.
  • The Spitzer "-SIP" distortion code is now recognised within FITS headers that describe non-celestial axes, as well as celestial axes.
  • A Python wrapper for AST is now available.
  • Added support for the 2012 leap second.
  • Extended support for a variety of distorted projections within the FitsChan clas, including SIP, TPV, TNX, ZPX, SCAMP, etc.

  • The PolyMap class can now use an iterative Newton-Raphson method to evaluate the inverse the inverse transformation if no inverse transformation is defined when the PolyMap is created.

  • All classes of Channel can now read to and write from specified text files, without the need to provide source and sink functions when the Channel is created. The files to use are specified by the new attributes SourceFile and SinkFile.

  • The FitsChan class has a new read-only attribute called "Nkey", which holds the number of keywords for which values are held in a FitsChan.

  • Frames now interpret the unit string "A" as meaning "Ampere" rather than "Angstrom", as specified by FITS-WCS paper I.
  • Bug fixes:
    • Attributes for axes of a CmpFrame with permuted axes could be indexed incorrectly

    • Inappropriate equinox values could be used when aligning SkyFrames if the AlignSystem attribute was set.

    • The astFindFrame method allowed a template Frame of a more specialised class to match a target frame of a less specialised class. For example, this bug would allow a template SkyFrame to match a target Frame.


  • New function atlReadTable to create an AST Table from a disk file.
  • Add function atlTableLutMap to create a LutMap from a Table column

  • Add F77 wrapper for astChrSplitRE


  • Remove support for old-style CNF API (13 years is long enough to migrate over). cnf_XXX should now be written as cnfXxx.
  • Use a mutex to synchronise all Fortran library calls from C. Use the new F77_LOCK macro.


  • Minor fixes for a memory leak and malloc handling.


  • Use CNF to add mutex for C access.
  • Correct conversion of Fortran identifiers to C pointers.
  • grpValid returns zero without error if the supploed Grp pointer is invalid.
  • Add new routine GRP_SLAVE.
  • Add grp_own grp_sown and grp_head to C interface.


  • Use CNF to add mutex for C access.
  • Add missing datGet0UW prototype to header file.
  • The datErmsg API has been changed so that an external buffer is supplied.
  • Minor internal fixes and compiler warning cleanups.


  • Use CNF to add mutex for C access.


  • Use CNF to add mutex for C access.



  • Use CNF to add mutex for C access.


  • Allow foreign format files to have dots in the base name.
  • Fix line breaking of long parameters in history.
  • Use CNF to add mutex for C access.


  • Add convenience function for storing multiple ancestors in an NDF.
  • Allow foreign format files to have dots in the base name.
  • Use CNF to add mutex for C access.
  • Many fixes to provenance handling.


  • Add one_strtod for converting strings to doubles.


  • Use CNF to add mutex for C access.


  • Allow the user to control messages through environment parameters. msgTune is now called in the ADAM fixed part.
  • Use CNF to add mutex for C access.


  • Use CNF to add mutex for C access.


  • Use CNF to add mutex for C access.


  • Added the 2012 leap second.
  • Removed the C slaEuler code and now use the Fortran as before.
  • Use CNF to add mutex for C access
  • Add C wrappers for slaPreces, slaPvobs and slaMapqk.

Starlink: Kapuahi (last edited 2020-09-23 19:17:29 by MalcolmCurrie)