Papers
Topics
Authors
Recent
Search
2000 character limit reached

Experience deploying an analysis facility for the Rubin Observatory's Legacy Survey of Space and Time (LSST) data

Published 28 Mar 2024 in astro-ph.IM | (2403.19321v1)

Abstract: The Vera C. Rubin Observatory is preparing for the execution of the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently in its final phase of construction in the Andes mountains in Chile and due to start operations in 2025 for 10 years, its 8.4-meter telescope will nightly scan the southern sky and collect images of the entire visible sky every 4 nights using a 3.2 Gigapixel camera, the largest imaging device ever built for astronomy. Automated detection and classification of celestial objects will be performed by sophisticated algorithms on high-resolution images to progressively produce an astronomical catalog eventually composed of 20 billion galaxies and 17 billion stars and their associated physical properties. In this paper, we briefly present the infrastructure deployed at the French Rubin data facility (operated by IN2P3 computing center, CC-IN2P3) to deploy the Rubin Science Platform, a set of web-based services to provide effective and convenient access to LSST data for scientific analysis. We describe the main services of the platform, the components that provide those services and our deployment model. We also present the Kubernetes-based infrastructure we are experimenting with for hosting the LSST astronomical catalog, a petabyte-scale relational database developed for the specific needs of the project.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (16)
  1. Qserv: petascale distributed database, https://github.com/lsst/qserv
  2. KeyCloak, https://www.keycloak.org
  3. Kubernetes, https://kubernetes.io
  4. OpenStack, https://www.openstack.org
  5. sciSQL 0.3: Science tools for mysql, https://smonkewitz.github.io/scisql/
  6. Operator Framework for kubernetes, https://operatorframework.io
  7. qserv-operator: a qserv operator for Kubernetes, https://github.com/lsst/qserv-operator
  8. Argo Workflow a workflow engine for orchestrating parallel jobs on kubernetes, https://argoproj.github.io/argo-workflows
  9. Firefly a browser-based interactive particle visualization app, http://firefly-viz.com
  10. Jupyter, https://jupyter.org
  11. Helm the package manager for kubernetes, https://helm.sh
  12. Phalanx a gitops repository for rubin observatoryâs kubernetes environments, https://phalanx.lsst.io
  13. Phalanx, https://github.com/lsst-sqre/phalanx
  14. Gafaelfawr rsp identity management, https://github.com/lsst-sqre/gafaelfawr
  15. LDAP, https://ldap.com
  16. OpenId, https://openid.net
Citations (1)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.