Papers
Topics
Authors
Recent
Search
2000 character limit reached

IA2: Leveraging Instance-Aware Index Advisor with Reinforcement Learning for Diverse Workloads

Published 8 Apr 2024 in cs.DB and cs.AI | (2404.05777v2)

Abstract: This study introduces the Instance-Aware Index Advisor (IA2), a novel deep reinforcement learning (DRL)-based approach for optimizing index selection in databases facing large action spaces of potential candidates. IA2 introduces the Twin Delayed Deep Deterministic Policy Gradient - Temporal Difference State-Wise Action Refinery (TD3-TD-SWAR) model, enabling efficient index selection by understanding workload-index dependencies and employing adaptive action masking. This method includes a comprehensive workload model, enhancing its ability to adapt to unseen workloads and ensuring robust performance across diverse database environments. Evaluation on benchmarks such as TPC-H reveals IA2's suggested indexes' performance in enhancing runtime, securing a 40% reduction in runtime for complex TPC-H workloads compared to scenarios without indexes, and delivering a 20% improvement over existing state-of-the-art DRL-based index advisors.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (15)
  1. Surajit Chaudhuri and Vivek R Narasayya. 1997. An efficient, cost-driven index selection tool for Microsoft SQL server. In VLDB, Vol. 97. San Francisco, 146–155.
  2. Cophy: A scalable, portable, and interactive index advisor for large workloads. arXiv preprint arXiv:1104.3214 (2011).
  3. Addressing function approximation error in actor-critic methods. arXiv:1802.09477 (2018).
  4. Vijay R Konda and John N Tsitsiklis. 2000. Actor-critic algorithms. In NeurIPS.
  5. Magic mirror in my hand, which is the best in the land? an experimental evaluation of index selection algorithms. Proceedings of the VLDB Endowment 13, 12 (2020), 2382–2395.
  6. SWIRL: Selection of Workload-aware Indexes using Reinforcement Learning.. In EDBT. 2–155.
  7. An index advisor using deep reinforcement learning. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2105–2108.
  8. Vincent Y Lum and Huei Ling. 1971. An optimization problem on the selection of secondary keys. In Proceedings of the 1971 26th annual conference. 349–356.
  9. Stratos Papadomanolakis and Anastassia Ailamaki. 2007. An integer linear programming approach to database design. In 2007 IEEE 23rd International Conference on Data Engineering Workshop. IEEE, 442–449.
  10. DRLindex: deep reinforcement learning index advisor for a cluster database. In Proceedings of the 24th Symposium on International Database Engineering & Applications. 1–8.
  11. Efficient scalable multi-attribute index selection using recursive strategies. In 2019 IEEE 35th International Conference on Data Engineering (ICDE). IEEE, 1238–1249.
  12. Hao Sun and Taiyi Wang. 2022. Toward Causal-Aware RL: State-Wise Action-Refined Temporal Difference. arXiv preprint arXiv:2201.00354 (2022).
  13. Richard S Sutton and Andrew G Barto. 2018. Reinforcement learning: An introduction. MIT press.
  14. DB2 advisor: An optimizer smart enough to recommend its own indexes. In Proceedings of 16th International Conference on Data Engineering (Cat. No. 00CB37073). IEEE, 101–110.
  15. INVASE: Instance-wise variable selection using neural networks. In ICLR.
Citations (2)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (2)

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.