Papers
Topics
Authors
Recent
Search
2000 character limit reached

Multi-machine preventative maintenance scheduling with imperfect interventions: a restless bandit approach

Published 25 Jan 2024 in cs.DM, cs.NA, and math.NA | (2401.14055v1)

Abstract: In this paper we address the problem of allocating the efforts of a collection of repairmen to a number of deteriorating machines in order to reduce operation costs and to mitigate the cost (and likelihood) of unexpected failures. Notwithstanding these preventive maintenance interventions are aimed at returning the machine to a so-called as-good-as-new state, unforeseeable factors may imply that maintenance interventions are not perfect and the machine is only returned to an earlier (uncertain) state of wear. The problem is modelled as a restless bandit problem and an index policy for the sequential allocation of maintenance tasks is proposed. A series of numerical experiments shows the strong performance of the proposed policy. Moreover, the methodology is of interest in the general context of dynamic resource allocation and restless bandit problems, as well as being useful in the particular imperfect maintenance model described.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (67)
  1. A near-optimal maintenance policy for automated DR devices. IEEE Transactions on Smart Grid, 7(3):1411–1419.
  2. A review on condition-based maintenance optimization models for stochastically deteriorating system. Reliability Engineering & System Safety, 157:54–63.
  3. Whittle’s index policy for a multi-class queueing system with convex holding costs. Mathematical Methods of Operations Research, 57:21–39.
  4. Handbook of maintenance management and engineering, volume 7. Springer.
  5. Time and inventory dependent optimal maintenance policies for single machine workstations: An MDP approach. European Journal of Operational Research, 228(3):545–555.
  6. Canto, S. P. (2008). Application of Bender’s decomposition to power plant preventive maintenance scheduling. European journal of operational research, 184(2):759–777.
  7. A literature review on selective maintenance for multi-unit systems. Quality and Reliability Engineering International, 34(5):824–845.
  8. Robust single machine scheduling with a flexible maintenance activity. Computers & Operations Research.
  9. Condition-based maintenance with imperfect preventive repairs for a deteriorating production system. Quality and Reliability Engineering International, 28(6):624–633.
  10. A proactive condition-based maintenance strategy with both perfect and imperfect maintenance actions. Reliability Engineering & System Safety, 133:22–32.
  11. A branch-and-check approach for a wind turbine maintenance scheduling problem. Computers & Operations Research, 88:117–136.
  12. Maintenance scheduling and production control of multiple-machine manufacturing systems. Computers & industrial engineering, 48(4):693–707.
  13. Dynamics of an optimal maintenance policy for imperfect repair models. European Journal of Operational Research, 248(3):1104–1112.
  14. Gittins, J. (1979). Bandit processes and dynamic allocation indices. Journal of the Royal Statistical Society, Series B, 41:148–177.
  15. Multi-armed bandit allocation indices. John Wiley & Sons.
  16. A dynamic allocation index for the discounted multiarmed bandit problem. Biometrika, 66:561–565.
  17. Stochastic scheduling: A short history of index policies and new approaches to index generation for dynamic resource allocation. Journal of Scheduling, 17(5):407–425.
  18. Index policies for the maintenance of a collection of machines by a set of repairmen. European Journal of Operational Research, 165:267–284.
  19. Index policies for a class of discounted restless bandits. Adv. Appl. Prob., 34:754–774.
  20. Some indexable families of restless bandit problems. Advances in Applied Probability, 38:643–672.
  21. A condition-based maintenance policy for stochastically deteriorating systems. Reliability Engineering & System Safety, 76(2):167–180.
  22. Modeling and solving the periodic maintenance problem. European Journal of Operational Research, 172(3):783–797.
  23. Unrelated parallel-machine scheduling problems with aging effects and deteriorating maintenance activities. Information Sciences, 253:163–169.
  24. Modeling age-based maintenance strategies with minimal repairs for systems subject to competing failure modes due to degradation and shocks. European journal of operational research, 218(1):140–151.
  25. Optimisation of maintenance routing and scheduling for offshore wind farms. European Journal of Operational Research, 256(1):76–89.
  26. Control of production and corrective maintenance rates in a multiple-machine, multiple-product manufacturing system. Mathematical and Computer Modelling, 38(3):351–365.
  27. Selective maintenance optimization when quality of imperfect maintenance actions are stochastic. Reliability Engineering & System Safety, 150:182–189.
  28. Complex system maintenance handbook. Springer Science & Business Media.
  29. Optimally maintaining a markovian deteriorating system with limited imperfect repairs. European Journal of Operational Research, 205(2):368–380.
  30. New stochastic models for preventive maintenance and maintenance optimization. European Journal of Operational Research, 255(1):80–90.
  31. Maintenance of continuously monitored degrading systems. European Journal of Operational Research, 175(2):821–835.
  32. Preventive maintenance scheduling for repairable system with deterioration. Journal of Intelligent Manufacturing, 21(6):875–884.
  33. A condition-based maintenance policy for degrading systems with age-and state-dependent operating cost. European Journal of Operational Research, 263(3):879–887.
  34. On sequence planning for selective maintenance of multi-state systems under stochastic maintenance durations. European Journal of Operational Research, 268(1):113–127.
  35. Optimal selective maintenance strategy for multi-state systems under imperfect maintenance. IEEE Transactions on Reliability, 59(2):356–367.
  36. Maintenance optimization for a system with a gamma deterioration process and intervention delay: application to track maintenance. Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability, 223(3):189–198.
  37. Maintenance engineering handbook. McGraw-Hill,.
  38. Moghaddam, K. S. (2013). Multi-objective preventive maintenance and replacement scheduling in a manufacturing system using goal programming. International Journal of Production Economics, 146(2):704–716.
  39. Preventive maintenance and replacement scheduling for repairable and maintainable systems using dynamic programming. Computers & Industrial Engineering, 60(4):654–665.
  40. Scheduling a deteriorating maintenance activity and due-window assignment. Computers & Operations Research, 57:33–40.
  41. A note: Simple heuristics for scheduling a maintenance activity on unrelated machines. Computers & Operations Research, 36(10):2759–2762.
  42. Optimum policies for a system with imperfect maintenance. IEEE Transactions on Reliability, 36(5):631–633.
  43. Nash, P. (1973). Optimal Allocation of Resources Between Research Projects. PhD thesis, Cambridge University.
  44. Analytical properties of an imperfect repair model and application in preventive maintenance scheduling. European Journal of Operational Research, 256(2):439–453.
  45. Preventive maintenance optimisation of multi-equipment manufacturing systems by combining discrete event simulation and multi-objective evolutionary algorithms. Production Planning & Control, 19(4):342–355.
  46. On the optimality of the gittins index rule for multi-armed bandits with multiple plays. Mathematical Methods of Operations Research, 50:449–461.
  47. The complexity of optimal queueing network control. Math. Oper. Res., 24:293–305.
  48. Percy, D. F. (2008). Preventive maintenance models for complex systems. In Kobbacy, K. and Murthy, P., editors, Complex System Maintenance Handbook, pages 179–207. Springer.
  49. Imperfect maintenance. European journal of operational research, 94(3):425–438.
  50. A hybrid condition-based maintenance policy for continuously monitored components with two degradation thresholds. European Journal of Operational Research, 268(2):515–532.
  51. Puterman, M. L. (1994). Markov Decision Processes: Discrete and Stochastic Dynamic Programming. Wiley, New York.
  52. Ross, S. (1983). Introduction to Stochastic Dynamic Programming. Academic Press, Florida, USA.
  53. Considering scheduling and preventive maintenance in the flowshop sequencing problem. Computers & Operations Research, 34(11):3314–3330.
  54. Ruiz-Hernández, D. (2007). Indexable Restless Bandits. Index Policies for Some Stochastic Scheduling and Dynamic Allocation Problems. Verlag Dr. Müller, Saarbrücken, Germany.
  55. An extensive operations and maintenance planning problem with an efficient solution method. Computers & Operations Research, 95:151–162.
  56. Opportunistic preventive maintenance scheduling based on theory of constraints. In IIE Annual Conference. Proceedings, page 230. Institute of Industrial Engineers-Publisher.
  57. A survey of preventive maintenance models for stochastically deteriorating single-unit systems. Naval Research Logistics (NRL), 36(4):419–446.
  58. Determining the optimal production–maintenance policy with inspection errors: using a markov chain. Computers & Operations Research, 30(1):1–17.
  59. Wang, H. (2002). A survey of maintenance policies of deteriorating systems. European journal of operational research, 139(3):469–489.
  60. Reliability and optimal maintenance. Springer Science & Business Media.
  61. Parallel machine scheduling with a deteriorating maintenance activity and total absolute differences penalties. Applied Mathematics and Computation, 217(20):8093–8099.
  62. On an index policy for restless bandits. J. Appl. Prob., 27:637–648.
  63. Whittle, P. (1980). Multi-armed bandits and the Gittins index. Journal of the Royal Statistical Society, Series B, 42:143–149.
  64. Whittle, P. (1981). Arm-acquiring bandits. Annals of Probability, 9:284–292.
  65. Whittle, P. (1988). Restless bandits: Activity allocation in a changing world. Journal of Applied Probability, 25A:287–298.
  66. Whittle, P. (1996). Optimal Control, Basics and Beyond. John Wiley, Chichester.
  67. A condition-based maintenance policy for multi-component systems with a high maintenance setup cost. Or Spectrum, 37(4):1007–1035.
Citations (29)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up