(r19) ResearchJournalForJamilBatshoun < Veritas

Veritas Web>GroupMeetings>SummerResearchJournals>ResearchJournalForJamilBatshoun (revision 19) (raw view)~~EditAttach~~
---+ Research Journal: Jamil Batshoun

CTA simulations with gammapy

*Questions*
   1 July 2: In section 5 of the paper they talk about optimizing the analysis using pSCT data alone. I'm not sure where they got the significance for the full dataset described in Table 3 (page 9). The analysis was first optimized using 2.2 hours of concurrent VERITAS and pSCT, but there is at least 17.6 of ON/OFF obsersvations. Is the 8.6 significance derived from the 2.2 hours of data or from the 17.6 hours based on analysis optimized from the 2.2 hours?
   1 June 30: Does "ZEN_PNT" refer to the zenith angle?
   1 June 29: What does gti/GTI mean in the case of the HDU_TYPE/NAME?
*July 2, 2021*
   1 What was done:
      1 Finished reading "<i>Detection of the Crab Nebula with the 9.7m prototype Schwarzschild-Couder telescope</i>".
   1 Things left to do:
   1 Notes:
      1 Reading: They used 17.6 hours of concurrent ON/OFF observations from the pSCT alone to optimize the analysis further. They were able to get a final significance of 7.3. This compares to 8.6 from the full dataset. I'm not sure what counts as the full dataset though. 
*July 1, 2021*
   1 What was done:
      1 Started reading "<i>Detection of the Crab Nebula with the 9.7m prototype Schwarzschild-Couder telescope</i>".
   1 Things left to do:
      1 Finish reading paper and take notes.
   1 Notes:
*June 30, 2021*
   1 What was done:
      1 Took notes on the obs_index file
   1 Things left to do:
      1 check-in with Massimo
   1 Notes:
      1 obs_index notes(again found after pressing the all button under the table column):
         1 Column names: OBS_ID, RA_PNT, DEC_PNT, GLON_PNT, ZEN_PNT
         1 OBS_ID: again the observation number
         1 RA_PNT: assuming this is the RA the telescope is pointing at
         1 DEC_PNT: assuming the same as above but for the declination
         1 GLON_PNT: assuming this is the galactic longitude pointing direction
         1 GLAT_PNT: assuming this is galactic latitude
         1 ZEN_PNT: assuming this is the zenith angle pointing direction but i'm not sure
   1 Questions:
      1 Does "ZEN_PNT" refer to the zenith angle?
*June 29, 2021*
   1 What was done:
      1 Learned how to start fitsviewer-----&gt; _./fv #must be inside fv5.5.2 directory_
      1 Took notes on what I saw in hdu_index
      1 Made a text file version of the fits file.
   1 Things left to do:
      1 Take notes on obs_index.fits.gz
   1 Notes:
      1 Was *not able to use* the *./fv* *outside* of the *fv5.5.2 directory*. Possibly can only start fitsviewer from that directory. This must be because it's a script and not an actual linux command.
      1 hdu_index notes (from pressing the all button under the table column):
         1 Column names: OBS_ID, HDU_TYPE, HDU_CLASS, FILE_DIR, FILE_NAME, HDU_NAME
         1 OBS_ID: the observation number
         1 HDU_TYPE possible values: events, gti, aeff, psf, bkg
         1 HDU_CLASS possible values: events, gti, aeff_2d, edisp_2d, psf_3gauss, bkg_3d
         1 FILE_NAME: so far i only see some combination of irf_file.fits and gps_baseline_ _(*observation number here*)_.fits
         1 HDU_NAME possible values: EVENTS, GTI, EFFECTIVE AREA, ENERGY DISPERSION, POINT SPREAD FUNCTION, BACKGROUND
   1 Questions:
      1 What does gti/GTI mean in the case of the HDU_TYPE/NAME?
*June 28, 2021*
   1 What was done:
      1 Met with Massimo to copy cta files over to my directory and had ds9 set up to view fits files.
         1 Massimo sent me an email with a pdf of the CTA DC1 to read.
      1 Nevis VERITAS/CTA meeting
      1 installed fitsviewer.
   1 Things left to do:
      1 check index files using fitsviewer. Take notes on these.
   1 Notes:
      1 I'm not currently sure about how to start fitsviewer. I'm going to check the fitsviewer website for help.
*Week 4*
   1 What was done:
      1 Completed tutorials:
         1 Overview – overview.ipynb<br />CTA with gammapy – cta.ipynb<br />3D map simulation – simulate_3d.ipynb<br />1D spectrum simulation – spectrum_simulation.ipynb<br />Point source sensitivity – cta_sensitivity.ipynb
      1 Went through some exercises in the tutorials. Included plots I added as attatchments to this page.
      1 Attended VERITAS summer meeting. Went to blazar science and ACG talks.
   1 Things left to do:
      1 Complete exercises from the tutorials i've completed so far to practice what they covered.
      1 Will go through irf section of cta.ipynb again to take notes on the plots the code produces.
      1 Need to complete taking notes on the papers I have read/need to read so far.
*June 24, 2021*
   1 What was done today:
      1 Attended 1st half of today's session of the VERITAS summer meeting.
      1 Attended REU talk
      1 Took notes on cta.ipynb. Worked on exercises in overview.ipynb but struggled getting through the first exercise.
         1 Made a sky map of hess observations!
   1 Things left to do:
      1 Finish notes on cta.ipynb
   1 Notes
      1 overview.ipynb exercise notes: my best guess is that i am supposed to use SphericalCircle from astropy.visualization.wcsaxes.
      1 ^^^Figured it out
*June 16, 2021*
   1 What was done today:
      1 read about fits, found the standard paper for fits
      1 read about the icrs, dec, and ra
      1 looked for a formal definition of the dl3-dr1 data from hess. did not find much info about what a data level is
      1 ran into same issue with the path associated with the GAMMAPY_DATA environment variable
         1 I fixed this by adding a line to my .profile on the nevis computers. I don't see this becoming a problem again.
      1 completed tutorial 2
   1 What is left to do:
      1 Read up on background modeling.
      1 Understand what the classes of gammapy do
      1 get a better understanding of how the analysis (both high level and lower level gammapy api)
*June 17-18, 2021*
   1 What was done today:
      1 Went over again the analysis steps found in tutorial "analysis 1"
   1 Things left to do:
      1 started working through tutorial "overview"
   1 Notes:
      1 How higher-level analysis works in gammapy:
         1 tutorial intro intro definition:
            1 (data reduction): observations reduced to a specified geometry (1D/3D). Combined with IRFS, this makes a dataset
            1 (Analysis): set a physical model and fit it to the datasets
         1 definition based on code:
            1 create config object for the settings used in your analysis
            1 set config object's type, stack, geom, background, fit, and flux_point settings settings
            1 (optional) write config object to a YAML file to use later.
            1 select observations to use
            1 data reduction
            1 (optional) save dataset to disk
            1 create model_config object with model settings
            1 set model_config object to analysis object
            1 use run_fit on analysis object
            1 create model best fit yaml file.
            1 estimate flux points
      1 questions:
         1 what is the model-best-fit.yaml file for? what about the model-best-fit_covariance.dat file?
         1 is data really reduced?
*June 9, 2021*
   1 What was done today:
      1 Added gammapy resources to .myprofile file
      1 started working on gammapy tutorials
         1 code to start tutorials:
            1 <p> _ssh jbatshoun@tehanu.nevis.columbia.edu -L 9888:localhost:9888_ </p>
            1 _module load gammapy/0.18_
            1 _gammapy_start_
            1 _jupyter notebook --no-browser --port=9888_
            1 copy & paste resulting link to chrome and use jupyter notebook normally
         1 COMPLETED: 1st gammapy tutorial analysis_1.ipynb
   1 Things left to do:
      1 create a .myprofile and copy contents of .profile into it.
      1 Remove gammapy line in .profile so that it is the same as when I first started (This might be unnecessary).
   1 Notes:
      1 Useful commands
         1 To check where the "<i>juypter notebook</i>" command is being used from (i.e. gammapy vs python): _which jupyter-notebook_
      1 Made an error when executing "<i>export $GAMMAPY_DATA</i>". executed in jbatshoun directory and not datasets directory. Noticed in tutorial what should have been the real path and made corrections.
*June 9, 2021*
   1 What was done today:
   1 Things Left to do:
   1 Notes:
      1 aa5351-06: Is the IRF a good measure of telescope performance? what about the psf?
*June 8, 2021*
   1 Read through gammapy and cta explanation of IRFs
   1 Read gammapy overview

*June 7, 2021 (Meeting Massimo, Jamil)*
   1 Introduction to project
   1 To-do list
      1 https://docs.gammapy.org/0.18.2/
      1 Read overview carefully
      1 Installation: no need to worry about it, we have shared tools on the nevis cluster
         1 log into the nevis cluster
         1 module load gammapy/0.18
         1 gammapy_start
      1 download tutorial datasets (gammapy download tutorials --release 0.18.2 , export GAMMAPY_DATA=&lt;&gt;)
      1 go through tutorials
   1 Weekly meeting with Massimo: Thursdays, 11 AM

-- %USERSIG{MassimoCapasso - 2021-06-27}%

<br />%COMMENT%
Attachments
Topic attachments
I	Attachment	History	Action	Size	Date	Who
png	cta_gps_highestenergyphotoninfo.png	r1	manage	97.9 K	2021-06-27 - 00:30	JamilBatshoun
png	hess_surveymap.png	r1	manage	75.6 K	2021-06-27 - 00:25	JamilBatshoun
png	markerandcirclegalacticcenter.png	r1	manage	185.1 K	2021-06-27 - 00:24	JamilBatshoun
Topic revision: r19 - 2021-07-02 - JamilBatshoun
Veritas
Webs
ATLAS
DOE
Main
TWiki
Veritas