Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revisionBoth sides next revision | ||
public:lta_howto [2017-05-24 07:37] – roberto pizzo | public:lta_howto [2018-07-11 08:32] – Reinoud Bokhorst | ||
---|---|---|---|
Line 3: | Line 3: | ||
This is a short manual on how to search for and retrieve data from the LOFAR Long Term Archive. | This is a short manual on how to search for and retrieve data from the LOFAR Long Term Archive. | ||
- | To access the LTA, go to: [[http://lofar.target.rug.nl|lofar.target.rug.nl]] | + | To access the LTA, go to: [[https://lta.lofar.eu|lta.lofar.eu]] |
For background information and in case of problems, please refer to the [[public: | For background information and in case of problems, please refer to the [[public: | ||
+ | |||
+ | ====== Release Notes ====== | ||
+ | |||
+ | |||
+ | ^ Release ^ Description ^ | ||
+ | | July 2018 | 1) All data is now searchable, not only released data or data of projects you're a member of. Note that for downloading data (staging) the proprietary restrictions still apply. \\ 2) All projects can now be selected by all users, not only by project members. This provides the means to filter data based on project.\\ 3) The user interface has been changed to improve user friendliness. Key points are a more intuitive menu structure, improved project selection/ | ||
+ | |||
+ | ====== Public vs Proprietary data ====== | ||
====== User Access ====== | ====== User Access ====== | ||
Line 13: | Line 21: | ||
Please visit https:// | Please visit https:// | ||
- | === Public | + | === Searching / retrieving |
- | The LTA catalogue can be searched | + | The LTA catalogue can be searched |
- | Staging and subsequent downloading of public data always requires an account | + | Staging and subsequent downloading of __**public**__ data always requires an account with LTA user access |
- | === Project | + | To stage and retrieve project-related |
- | To directly access project-related data in the LTA you need to have an account in [[https:// | + | === Step-by-step guide to search and retrieve data === |
- | If you were not originally a member of the project | + | __Basic search__: |
+ | * log in to https://lta.lofar.eu/ | ||
+ | * click SEARCH DATA in the top menu | ||
+ | * specify the data product types of interest and a target name or coordinated | ||
+ | * click on " | ||
+ | * from the screen that follows, you should be able to stage the data products | ||
+ | __Advanced search__: | ||
+ | * log in to https:// | ||
+ | * click SEARCH DATA in the top menu | ||
+ | * click on the side Advanced Search drop-down list | ||
+ | * specify the data product types of interest from the drop down list | ||
+ | * select products features and specify a target name or coordinated | ||
+ | * click on " | ||
+ | * from the screen that follows, you should be able to stage the data products | ||
+ | |||
+ | __Project search (to restrict all data searches to that project only)__: | ||
+ | * log in to https:// | ||
+ | * click BROWSE PROJECTS in the top menu | ||
+ | * at this level membership can be checked, with the first column showing if you are a member of the project or for finding public projects. Available options are: | ||
+ | * click on the project name to view the project details | ||
+ | * use the ' | ||
+ | * use the 'show data' button to select the project and to show all data in it | ||
+ | * from the screen that follows, you should be able to either search / select / stage the data products | ||
====== How to find data in the archive ====== | ====== How to find data in the archive ====== | ||
- | Once your account is set up, or as anonymous user (AWWORLD) | + | Once your account is set up, or as anonymous user you can navigate the catalogue. In the former case you can login by clicking on the top right LOGIN button shown below. |
=== Page navigation === | === Page navigation === | ||
Line 34: | Line 64: | ||
- | {{:public:lta_navigation.png|}} | + | {{:public:lta_menu.png?900|}} |
- | + | ||
- | A " | + | |
- | + | ||
- | Searching the catalogue is easiest by selecting one of the otions in the " | + | |
- | Another option is to choose "Show Latest", | + | A search |
+ | A " | ||
+ | * Click on the project name to view the project details and eventually select it. | ||
+ | * Use the ' | ||
+ | * Use the 'show data' button to select the project and to show all data in it. | ||
=== Finding Data === | === Finding Data === | ||
- | {{:public:lta_observations.png|}} | + | {{:public:lta_observations_2018.png?900|}} |
Depending on the search parameters, e.g., which data products were requested (observation, | Depending on the search parameters, e.g., which data products were requested (observation, | ||
- | - select observations/ | + | - select observations/ |
- select observations and "show pipelines" | - select observations and "show pipelines" | ||
- select observations/ | - select observations/ | ||
Line 74: | Line 104: | ||
Once you have a list of dataproducts, | Once you have a list of dataproducts, | ||
- | {{:public:lta_howto2.png|}} | + | {{:public:lta_staging_1.png?900|}} |
The LOFAR Archive stores data on magnetic tape. This means that it cannot be downloaded right away, but has to be copied from tape to disk first. This process is called ' | The LOFAR Archive stores data on magnetic tape. This means that it cannot be downloaded right away, but has to be copied from tape to disk first. This process is called ' | ||
Line 80: | Line 110: | ||
When you have made your selection of files, click on //stage//. This shows you the following message. It means that a request has been sent to the LTA staging service to start retrieving the requested files from the tape and make them available on disk. You will get a confirmation e-mail, to acknowledge that your staging request was received and the process was queued. When the files are staged, you will get a notification email informing you that your data are ready for retrieval. | When you have made your selection of files, click on //stage//. This shows you the following message. It means that a request has been sent to the LTA staging service to start retrieving the requested files from the tape and make them available on disk. You will get a confirmation e-mail, to acknowledge that your staging request was received and the process was queued. When the files are staged, you will get a notification email informing you that your data are ready for retrieval. | ||
- | {{:public:lta_howto3.png|}} | + | {{:public:lta_howto_3.png?900|}} |
The e-mail that you get when the staging on disk is complete gives you a list of files and has several attachments. Amongst them are two files '' | The e-mail that you get when the staging on disk is complete gives you a list of files and has several attachments. Amongst them are two files '' |