Introduction

This directory contains notebooks related to the validation work being performed for the different DC2 runs.

These tutorials are intended to be run at NERSC using the JupyterHub environment. If you are unsure on how to proceed, please go here.

You are encouraged to use the code in these notebooks for your own analysis.

Notebooks

Notebook	Short Description	Links	Owner
DC2 QA	Validation tests on source catalogs and calexps	ipynb	Javier Sanchez
PSF ellipticity tests	Measuring PSF ellipticity in DC2 calexps	ipynb	Javier Sanchez
DC2 Run 2.1i Object	Validation on Run 2.1i Object Catalog	ipynb, rendered	Michael Wood-Vasey

The code in these notebooks can be, in principle, ported to other DC2 runs.

Please, if you find any problems feel free to open a new issue in this repository and let the notebook’s owner(s) know.

Scripts

To run the validate_dc2_run2.2i_object_table.py script first start an interactive session on a Node: Running through an interaction session is the reasonable way to run this on NERSC because we need 0.5-1 hour to run this, but the ‘debug’ queue is only 0.5 hours, and waiting for a regular queue slot can easily take at least a day. We need an entire node for the memory (~128 GB)

salloc -N 1 -C haswell -q interactive --time=02:00:00

Once you’re running on the allocated node:

module load python3

Or

start-kernel-cli.py desc-python

And then run the script, ideally pipeline the output to a log file for future reference:

python validate_dc2_run2.2i_object_table.py > validate_dc2_run2.2i_object_table.log 2>&1 < /dev/null &