Papers
Topics
Authors
Recent
Search
2000 character limit reached

RFI-DRUnet: Restoring dynamic spectra corrupted by radio frequency interference -- Application to pulsar observations

Published 21 Feb 2024 in astro-ph.IM, cs.LG, and eess.IV | (2402.13867v1)

Abstract: Radio frequency interference (RFI) have been an enduring concern in radio astronomy, particularly for the observations of pulsars which require high timing precision and data sensitivity. In most works of the literature, RFI mitigation has been formulated as a detection task that consists of localizing possible RFI in dynamic spectra. This strategy inevitably leads to a potential loss of information since parts of the signal identified as possibly RFI-corrupted are generally not considered in the subsequent data processing pipeline. Conversely, this work proposes to tackle RFI mitigation as a joint detection and restoration that allows parts of the dynamic spectrum affected by RFI to be not only identified but also recovered. The proposed supervised method relies on a deep convolutional network whose architecture inherits the performance reached by a recent yet popular image-denoising network. To train this network, a whole simulation framework is built to generate large data sets according to physics-inspired and statistical models of the pulsar signals and of the RFI. The relevance of the proposed approach is quantitatively assessed by conducting extensive experiments. In particular, the results show that the restored dynamic spectra are sufficiently reliable to estimate pulsar times-of-arrivals with an accuracy close to the one that would be obtained from RFI-free signals.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (52)
  1. The NANOGrav 15-year data set: Search for Transverse Polarization Modes in the Gravitational-Wave Background. arXiv e-prints 2310.12138.
  2. Radio frequency interference mitigation using deep convolutional neural networks. Astronomy and Computing 18, 35–39.
  3. Hide & seek: End-to-end packages to simulate and process radio survey data. Astronomy and Computing 18, 8–17.
  4. The second data release from the european pulsar timing array. Astronomy & Astrophysics 678, A50.
  5. Primary beam effects of radio astronomy antennas – II. modelling MeerKAT L-band beams. Monthly Notices of the Royal Astronomical Society 502, 2970–2983.
  6. A new approach to mitigation of radio frequency interference in interferometric data. The Astrophysical Journal 696, 885.
  7. Radio frequency interference mitigation at the westerbork synthesis radio telescope: Algorithms, test observations, and system implementation. The Astronomical Journal 128, 933.
  8. MĆ©thodes avancĆ©es en chronomĆ©trie des pulsars : rĆ©jection d’interfĆ©rences radio par apprentissage profond et Ć©tude chronomĆ©trique du systĆØme binaire relativiste J1528-3146. Ph.D. thesis. UniversitĆ© d’OrlĆ©ans, France.
  9. Radio frequency interference identification and mitigation using simultaneous dual-station observations. Radio Science 40, 1–16.
  10. Pulsars with NenuFAR: Backend and pipelines. Astronomy & Astrophysics 652, A34.
  11. Removing radio frequency interference from auroral kilometric radiation with stacked autoencoders, in: Proc. IEEE Int. Conf. Acoust., Speech and Signal Process. (ICASSP), IEEE. pp. 1–5.
  12. Hydrogen epoch of reionization array (HERA). Publications of the Astronomical Society of the Pacific 129, 045001.
  13. Trajectory based RFI subtraction and calibration for radio interferometry. arXiv e-prints 2301.04188.
  14. Statistically stable estimates of variance in radio-astronomy observations as tools for radio-frequency interference mitigation. The Astronomical Journal 135, 1810.
  15. RFI mitigation methods in radio astronomy. Astronomy & Astrophysics 378, 327–344.
  16. Radio frequency interference detection using deep learning, in: Proc. IEEE Vehicular Technology Conference (VTC-Spring), IEEE. pp. 1–5.
  17. PSRFINET: Radio frequency interference detection in pulsar data with deep residual networks, in: Proc. RFI Workshop.
  18. Hera-Team, 2024. hera_sim Documentation. Technical Report.
  19. Rednet: Residual encoder-decoder network for indoor rgb-d semantic segmentation. arXiv e-prints 1806.01054.
  20. Optimizing sparse RFI prediction using deep learning. Monthly Notices of the Royal Astronomical Society 488, 2605–2615.
  21. Radio frequency interference removal through the application of spatial filtering techniques on the Parkes multibeam receiver. The Astronomical Journal 140, 2086.
  22. Strong-Field Gravity Tests with the Double Pulsar. Physical Review X 11, 041050.
  23. Prospects for high-precision pulsar timing with the new Effelsberg PSRIX backend. Monthly Notices of the Royal Astronomical Society 458, 868–880.
  24. Markov random field modeling in image analysis. Springer Science & Business Media.
  25. Detection of radio frequency interference using an improved generative adversarial network. Astronomy and Computing 36, 100482.
  26. Handbook of Pulsar Astronomy. volumeĀ 4.
  27. Excising radio frequency interference using the discrete wavelet transform, in: Proc. IEEE Int. Symp. Time-Frequency Time-Scale Analysis (TFTS), IEEE. pp. 349–352.
  28. Deep learning assisted data inspection for radio astronomy. Monthly Notices of the Royal Astronomical Society 496, 1517–1529.
  29. Learning to detect radio frequency interference in radio astronomy without seeing it. Monthly Notices of the Royal Astronomical Society 516, 5367–5378.
  30. The high time resolution universe survey – XIV. Discovery of 23 pulsars through GPU-accelerated reprocessing. Monthly Notices of the Royal Astronomical Society 483, 3673–3685.
  31. Radio frequency interference detection using machine learning., in: IOP Conference Series: Materials science and engineering, IOP Publishing. p. 012012.
  32. Post-correlation radio frequency interference classification methods. Monthly Notices of the Royal Astronomical Society 405, 155–167.
  33. A morphological algorithm for improving radio-frequency interference detection. Astronomy & Astrophysics 539, A95.
  34. A LOFAR RFI detection pipeline and its first results, in proceedings of rfi mitigation workshop, in: RFI mitigation workshop - RFI2010.
  35. Continuous inspection schemes. Biometrika 41, 100–115.
  36. SERPent: Automated reduction and rfi-mitigation software for e-merlin. Astronomy and Computing 2, 54–66.
  37. The GMRT EoR experiment: limits on polarized sky brightness at 150 MHz. Monthly Notices of the Royal Astronomical Society 399, 181–194.
  38. Search for an isotropic gravitational-wave background with the parkes pulsar timing array. The Astrophysical Journal Letters 951, L6.
  39. A self-learning neural network approach for radio frequency interference detection and removal in radio astronomy. Publications of the Astronomical Society of the Pacific 134, 114503.
  40. Observing pulsars and fast transients with LOFAR. Astronomy & Astrophysics 530, A80.
  41. Pulsar timing and relativistic gravity. Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences 341, 117–134.
  42. Deep learning improves identification of radio frequency interference. Monthly Notices of the Royal Astronomical Society 499, 379–390.
  43. A generative machine learning approach to RFI mitigation for radio astronomy, in: Proc. IEEE Int. Workshop Machine Learning Signal Processing (MLSP), IEEE. pp. 1–6.
  44. Radio frequency interference mitigation using pseudoinverse learning autoencoders. Research in Astronomy and Astrophysics 20, 114.
  45. RFI detection by automated feature extraction and statistical analysis. Astronomische Nachrichten: Astronomical Notes 328, 68–79.
  46. Machine learning approach to radio frequency interference (RFI) classification in radio astronomy. Ph.D. thesis. Stellenbosch: Stellenbosch University.
  47. Radio frequency interference detection based on the AC-UNet model. Research in Astronomy and Astrophysics 21, 119.
  48. Deep residual detection of radio frequency interference for FAST. Monthly Notices of the Royal Astronomical Society 492, 1421–1431.
  49. Plug-and-play image restoration with deep denoiser prior. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 6360–6376.
  50. Beyond a Gaussian denoiser: Residual learning of deep CNN for image denoising. IEEE Transactions on Image Processing 26, 3142–3155.
  51. Residual dense network for image restoration. IEEE Transactions on Pattern Analysis and Machine Intelligence 43, 2480–2495.
  52. WindSat radio-frequency interference signature and its identification over Greenland and Antarctic. IEEE Transactions on Geoscience and Remote Sensing 51, 4830–4839.

Summary

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.