Papers
Topics
Authors
Recent
Search
2000 character limit reached

ECCBO: An Inherently Safe Bayesian Optimization with Embedded Constraint Control for Real-Time Optimization

Published 28 Feb 2024 in math.OC, cs.SY, and eess.SY | (2402.18415v1)

Abstract: This paper introduces a model-free real-time optimization (RTO) framework based on unconstrained Bayesian optimization with embedded constraint control. The main contribution lies in demonstrating how this approach simplifies the black-box optimization problem while ensuring "always-feasible" setpoints, addressing a critical challenge in real-time optimization with unknown cost and constraints. Noting that controlling the constraint does not require detailed process models, the key idea of this paper is to control the constraints to "some" setpoint using simple feedback controllers. Bayesian optimization then computes the optimum setpoint for the constraint controllers. By searching over the setpoints for the constraint controllers, as opposed to searching directly over the RTO degrees of freedom, this paper achieves an inherently safe and practical model-free RTO scheme. In particular, this paper shows that the proposed approach can achieve zero cumulative constraint violation without relying on assumptions about the Gaussian process model used in Bayesian optimization. The effectiveness of the proposed approach is demonstrated on a benchmark Williams-Otto reactor example.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (23)
  1. Adaptive on-line steady-state optimization of slow dynamic processes. Automatica, 14(3):223–230.
  2. Bayesian optimization with safety constraints: safe and automatic parameter tuning in robotics. Machine Learning, pages 1–35.
  3. Performance evaluation of real industrial rto systems. Processes, 4(4):44.
  4. An efficient method for on-line identification of steady state. Journal of Process Control, 5(6):363–374.
  5. On-line optimization using a two-phase approach: an application study. Industrial & engineering chemistry research, 26(9):1924–1930.
  6. On kernelized multi-armed bandits. In International Conference on Machine Learning, pages 844–853. PMLR.
  7. RTO: An overview and assessment of current practice. Journal of Process Control, 21(6):874–884.
  8. Extremum seeking control and its application to process and reaction systems: A survey. Mathematics and Computers in Simulation, 82(3):369–380.
  9. Use of measurements for enforcing the necessary conditions of optimality in the presence of constraints and uncertainty. Journal of Process Control, 15(6):701–712.
  10. Frazier, P. I. (2018). A tutorial on bayesian optimization. arXiv preprint arXiv:1807.02811.
  11. Optimal operation of integrated processing systems. part i: Open-loop on-line optimizing control. AIChE Journal, 27(6):960–968.
  12. Advanced algorithms for gradient estimation in one-and two-parameter extremum seeking controllers. Journal of Process Control, 22(4):700–709.
  13. Adaptive extremum control using approximate process models. AIChE journal, 35(7):1157–1169.
  14. GPy (since 2012). GPy: A gaussian process framework in python. http://github.com/SheffieldML/GPy.
  15. Safe bayesian optimization using interior-point methods -applied to personalized insulin dose guidance. IEEE Control Systems Letters, pages 1–1.
  16. Model-free real-time optimization of process systems using safe bayesian optimization. AIChE Journal, 69(4):e17993.
  17. Systematic design of active constraint switching using selectors. Computers & Chemical Engineering, 143:107106.
  18. Real-time optimization as a feedback control problem-a review. Computers & Chemical Engineering, page 107723.
  19. No-regret bayesian optimization with unknown equality and inequality constraints using exact penalty functions. IFAC-PapersOnLine, 55(7):895–902.
  20. Gaussian processes for machine learning. MIT Press.
  21. Skogestad, S. (2023). Advanced control using decomposition and simple elements. Annual Reviews in Control, 56:100903.
  22. Comparison of gradient estimation methods for real-time optimization. In 21st European Symposium on Computer Aided Process Engineering-ESCAPE 21, number EPFL-CONF-155235, pages 607–611. Elsevier.
  23. Vabo: Violation-aware bayesian optimization for closed-loop control performance optimization with unmodeled constraints. In 2022 American Control Conference (ACC), pages 5288–5293. IEEE.

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Authors (1)

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 34 likes about this paper.