Difference: 2022PabloDrakeResearchJournal (11 vs. 12)

Revision 122022-08-26 - PabloDrake

Line: 1 to 1
 
META TOPICPARENT name="2022Journals"

Pablo Drake Research Journal (Summer '22)

06/06-06/10

06/06

  • Plotted different graphs containing blazar population data both from TeVCat and 4LAC Fermi-LAT Catalogue. In particular, I completed two skymaps of blazars, two pie charts with blazar classifications and a scatterplot showing Fermi blazars' photon index vs peak frequency, with their classification as well. All the data was retrieved from the catalogues and the plotting was carried out in Jupyter notebooks, using matplotlib. This work is to be included in some of Professor Mukherjee's slides.
Changed:
<
<
  • Read Observing the Energetic Universe at Very High Energies with the VERITAS Gamma Ray Observatory by Prof. Mukherjee (https://arxiv.org/abs/1809.10285). Wrote a set of reference notes.
>
>
  • Read Observing the Energetic Universe at Very High Energies with the VERITAS Gamma Ray Observatory by Prof. Mukherjee (https://arxiv.org/abs/1809.10285). Wrote a set of reference notes.
 
  • Read Cherenkov Telescope Array: CTA CERN Courier article. Wrote a set of reference notes.
06/07
  • Attended Daniela VEGAS tutorial
  • Started the Crab Analysis tutorial with VEGAS
06/08
  • Continued with the Crab Analysis (stage 6)
Changed:
<
<
>
>
  • Read Exploring the high-energy gamma-ray spectra of TeV blazars by Doctor Qi Feng (https://arxiv.org/abs/2108.05333). Wrote a set of reference notes.
 
  • Centered all my work around the analysis of the May 2022 flare of the FSRQ 4FGL J1350.8+3033. The structure of this analysis will be the following: carry out a fermipy ROI analysis, plot the lightcurve of the source, plot the lightcurve of the flare, carry out an spectral analysis both during flare buildup, maximum, and decrease (and potentially also during quiescent state), carry out VEGAS spectral analysis of the source.
06/09
  • Completed the VEGAS tutorial
Line: 41 to 41
 
  • As per Prof. Mukherjee's suggestion, I started working in creating a matplotlib data plotting manual, using the code created for the TeVCat /4LAC graphs. Also continued working with the fermipy guide.
06/14
  • Completed ROI analysis. Redid the analysis in order for the graphs to be created (sometimes the plots aren't created automatically when the run_analysis_std.py finishes).
Changed:
<
<
>
>
  • Read The future of gamma-ray astronomy by Jürgen Knödlseder (https://arxiv.org/abs/1602.02728). Wrote a set of notes on it.
 06/15
  • Started working on creating a full dataset lightcurve. The following error appeared:
Traceback (most recent call last):
Line: 76 to 76
 

06/21-06/24

06/22

Changed:
<
<
>
>
  • Solved the previous fit_success error by updating fermipy to v1.1. Found out theat the issue had already been posed in the official fermipy github (which often happens, https://github.com/fermiPy/fermipy/issues/362#issuecomment-802537434). And the solution for the problem had been implemented earlier in 2022: https://github.com/fermiPy/fermipy/pull/454.
 06/23
  • However, another issue started popping up. The lightcurve analysis actually started, with the gtcube process finishing. However, when trying to fit the different time bins, the following sequence would happen (as can be checked in the log file):
<span>Analysis failed in time range 675480000 675566400</span>
Line: 96 to 96
  06/27
  • Carried out several of the analysis suggested by Qi and Massimo. For example, I tried carrying out 3-month timebins and 5-month timebins, and also a series of 1-day bins for the week around the May 2022 flare. None of these solutions had any effect, with the problem persisting.
Changed:
<
<
06/28 and 06/29
>
>
06/28 and 06/29
 
  • Carried out several analysis with an increased ROI, up to 40 degrees. Tried several combinations of ROI radius and time bins, to no avail.
Changed:
<
<
>
>
  • Read Variability and Spectral Characteristics of Three Flaring Gamma-ray Quasars Observed by VERITAS and Fermi-LAT by C. B. Adams (https://iopscience.iop.org/article/10.3847/1538-4357/ac32bd). Wrote a set of notes on it.
 06/30
Changed:
<
<
  • Contacted Isabella Guilherme, an alumn of the VERITAS group who had carried out a series of lightcurve analysis last year, in order to enquire about my problem. They showed me several lightcurve analysis that had been fully completed with a previous version of
>
>
  • Contacted Isabella Guilherme, an alumn of the VERITAS group who had carried out a series of lightcurve analysis last year, in order to enquire about my problem. They showed me several lightcurve analysis that had been fully completed with a previous version of fermipy. I therefore tried to repeat the same process for their source.
07/01
  • This attempt didn't result in any changes. It doesn't seem specially advisable to return to a previous version of fermipy without redoing all analyses, as it might tamper with some of the analysis files.
  • Read Photopion production in black-hole jets and flat-spectrum radio quasars as PeV neutrino sources by Charles D. Dermer (https://arxiv.org/abs/1406.2633). Wrote a set of notes on it.
 

07/05-07/08

07/05

Line: 108 to 111
 
  • I had a Zoom chat with Janeth Valverde to consult on the lightcurve problem. Janeth pointed out that the problem might have to do with some of fermitools not running properly for a source this faint. Instead of using Ari's pipeline, she recommended doing a general check on that by running fermitools directly on the command line. She also recommended focusing solely in the last 6 months, and doing an unbinned analysis.
  • Janeth also discussed trying out an adaptive binning strategy (in parallel to the other analyses). She shared this example as a demonstration of the usefulness of adaptive binning.
07/06
Changed:
<
<
  • Contacted Ari Brill regarding the problem. He asked the following questions, as a sanity check:

    "1) Did the baseline analysis using the entire dataset converge successfully? Were you able to look at the validation plots and see that the results seemed reasonable?

    2) To follow up on what Qi was saying, if you look at the <a data-saferedirecturl="https://www.google.com/url?q=https://fermi.gsfc.nasa.gov/ssc/data/access/lat/LightCurveRepository/source.html?source_name%3D4FGL_J1350.8%2B3033&source=gmail&ust=1660253301149000&usg=AOvVaw2tgbwULgc8vg8pR_R3f9eF" href="https://fermi.gsfc.nasa.gov/ssc/data/access/lat/LightCurveRepository/source.html?source_name=4FGL_J1350.8+3033" target="_blank">monthly lightcurve</a>, you can see that there are years-long stretches in between the flares when the source isn't detected at all. So there are parts of the lightcurve that might not be detected even with a 12-week time bin. That shouldn't cause the fit to fail though. It should converge and report an upper limit.

    3) Are you able to see the error message that's printed out? Just to make sure, do you have enough space in your output directory to store all of the output files?"

>
>
  • Contacted Ari Brill regarding the problem. He asked the following questions, as a sanity check (which can be useful for others with similar problems):

    "1) Did the baseline analysis using the entire dataset converge successfully? Were you able to look at the validation plots and see that the results seemed reasonable?

    2) To follow up on what Qi was saying, if you look at the monthly lightcurve: https://fermi.gsfc.nasa.gov/ssc/data/access/lat/lcr/source.html?source_name=4FGL_J1350.8+3033 you can see that there are years-long stretches in between the flares when the source isn't detected at all. So there are parts of the lightcurve that might not be detected even with a 12-week time bin. That shouldn't cause the fit to fail though. It should converge and report an upper limit.

    3) Are you able to see the error message that's printed out? Just to make sure, do you have enough space in your output directory to store all of the output files?"

  • In my response, I indicated that the baseline analysis did converge successfully, and the resulting plots were reasonable. As stated by Dr. Brill, the fit shouldn't fail to converge, that is the worrying part. I also cleared up some space in my directory, but the problem persisted.
07/07
  • In conversation with Dr. Brill, he directed me to the following github issue: https://github.com/fermiPy/fermipy/issues/468, which explains that the fitting problem is caused by an incompatibility between Fermipy and the newest version of Astropy. This seems to be a recurring problem having to do with the timing of fermipy and astropy updates (in this case, the problem had to do with fermipy v.1.1). As a solution, we decided to update fermipy again to its v1.4 (which had only been released two weeks before).
  • We started following Prof. Valverde's instructions on how to directly carry out the ROI analysis and the lightcurve analysis only with fermitools. She had sent a txt file named complete_unbinned_analysis.txt, which can be found at /nevis/milne/files/pd2629/fermitools/, with detailed instructions, that I had to adapt to my source.
07/08
 
Changed:
<
<
-- Massimo Capasso - 2022-06-16
>
>
-- Massimo Capasso - 2022-06-16
 

Comments

Deleted:
<
<

<--/commentPlugin-->
 \ No newline at end of file
Added:
>
>

<--/commentPlugin-->
 \ No newline at end of file
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback