===== Some useful links for the Standard Imaging Pipeline ===== === User Documentation === * The latest release of the [[http://www.astron.nl/radio-observatory/lofar/lofar-imaging-cookbook/|Imaging Cookbook]] is available on the web. * The development version of the cookbook is available (read only!) from [[http://usg.lofar.org/svn/documents/trunk/Tutorials/Imaging/ | USG Subversion]]. === MSSS processing === The processing of the MSSS observations will be done in an automated way by means of a few [[engineering:software:tools:msss-pipelines| pipelines]] that will be started automatically using the scheduler and SAS/MAC. [[software:pipeline_changelist|Pipeline Framework Changelist]] === RTCP processing === * {{ BandpassCorrection_v2.0.pdf | Subband passband correction at OLAP}} - John Romein === Useful Tools === * [[engineering:software:tools:useful| Some handy tools and commands]] * [[engineering:software:tools:msselect| msselect]]: select baselines in a MeasurementSet * [[cexecms| cexecms]]: run a script on cluster nodes for all data files matching a file name pattern * [[engineering:software:tools:pipeline| Some scripts for running the pipeline]] * [[engineering:software:tools| A collection of useful tools and scripts that can be found in /opt/tools ]] * [[http://usg.lofar.org/documentation/pipeline/ | Pipeline framework documentation]] === DPPP === * {{ lofar_dppp_flags.pdf | Pre-flag document}} - V.N. Pandey * {{ NDPPP_report.pdf | Testing of DPPP}} - David Rafferty, 11-Mar-2010 * [[ndppp| DPPP documentation]] * [[engineering:software:tools:pythondppp| How to write a DPPP step in Python]] * [[http://usg.lofar.org/wiki/doku.php?id=workshops:2009-02_processing_school:exercise_05 | LOFAR Data Processing School DPPP Exercise]] === Beam Specification === * {{:software:lofarpoldef_v5.pdf| LOFAR Beam Definition Version 5.0}}- J. Hamaker et al. === BBS === * [[bbs| BBS documentation]] * {{performance_JvZ.pdf | Initial BBS performance}} 07Jan08 - Joris van Zwieten * {{parmdb.pdf | parmdb: Parameter Database}} - Ger van Diepen * [[parmdbm| parmdbm]]: program to maintain a parameter table * [[parm-export| cross-calibration]]: ways to export (transfer) solutions * [[makesourcedb| makesourcedb, mergesourcedb, showsourcedb]]: programs to create/handle a Source Parameter Database * {{makems.pdf | makems: Creating (distributed) MeasurementSet}} - Ger van Diepen * [[makebeamtables| makebeamtables]]: add beam info to a MeasurementSet. Needed for BBS after makems. === Imaging === * [[engineering:software:tools:mwimager| mwimager documentation]] * [[engineering:software:tools:cimagerdoc| cimager documentation]] * {{ mwimager.pdf | description of mwimager, clusterdesc and VDS files }} - Ger van Diepen. * {{ Cornwell_wprojection.pdf | W - Projection paper}} - Cornwell et al. * {{ FreqResLOFARimaging_v1.0.pdf | Specification of the Frequency Resolution}} - Ger de Bruyn * [[engineering:software:tools:cimager| Commissioning of the Imager - Last update Aug. 2008]] - Casey Law * [[engineering:software:tools:cimager:batejat| Commissioning of the Imager - Last update Oct. 2009]] - Evert Rol, Fabien Batejat * [[http://staff.science.uva.nl/~evert/lofar/imager | LOFAR Imager test documentation]] - Evert Rol === Ionosphere === * {{Lions.pdf | Lions: Ionospheric Simulations}} * {{Ion_Sim.pdf | Ionospheric Simulations and Calibratability}} - Ilse van Bemmel, Maaijke Mevius * {{BBS_iono.pdf | Ionospheric Calibration in BBS}} * See MWImager parset description below === Source Finding === * {{ TKP_source_extraction.pdf | TKP Source Extraction System }} - John Swinbank * {{ TKP_source_extraction_description.pdf | TKP source extraction code description }} - Hanno Spreeuw * {{ TKP_notes_on_Duchamp.pdf | TKP notes on Duchamp }} - John Swinbank === Global Sky Model === * [[gsm.py| gsm.py: extract input for makesourcedb from GSM]] * {{tkp_expected_data_rates_volumes.pdf | Expected Data Rates and Volumes for the TKP}} - Bart Scheers * {{tkp_transient_variability_detection.pdf | Transient and Variability Detection Algorithms}} - Bart Scheers * {{cross_correlating_catalogues.pdf | Cross-Correlating Multiple Radio Catalogues}} - Bart Scheers === Integration of the Standard Imaging Pipeline === * {{sip_v2.pdf | Standard Imaging Pipeline: first results}} 09Dec08 - Marcel Loose * {{TKP_pipeline_framework.pdf | TKP pipeline framework}} - John Swinbank === ParSet documentation === * {{parameterset_3.pdf | LOFAR ParameterSet}} - Ger van Diepen * NDPPP: [[ndppp#description_of_all_parameters| NDPPP parameter set documentation]] * BBS: [[bbsconfigurationsyntax| BBS parameter set documentation]] * mwimager: [[engineering:software:tools:mwimagerparset| mwimager parameter set documentation]] === Other documents === * {{TKP_notes_on_IPython.pdf | Notes on IPython}} - John Swinbank * {{TestSystem.pdf |LOFAR Software Testing}} - Ger van Diepen ==== Pipeline Profiling ==== ---- Some [[software:standard_imaging_pipeline:profiling| records of pipeline runs ]] are available for use in profiling.