Optimal maintenance of two stochastically deteriorating machines with an intermediate buffer

We consider a manufacturing system in which an input generating installation transfers a raw material to a subsequent production unit. Both machines deteriorate stochastically with usage and may fail. For each machine the deteriorating process is described by some known transition probabilities between different degrees of deterioration. A buffer has been built between the two machines in order to cope with unexpected failures of the installation. A discrete-time Markov decision model is formulated for the optimal preventive maintenance of both machines. The maintenance times are geometrically distributed and the cost structure includes operating costs, storage costs, maintenance costs and costs due to the lost production. It is proved that for fixed buffer content and for fixed deterioration degree of one machine, the average-cost optimal policy initiates a preventive maintenance of the other machine if and only if its degree of deterioration exceeds some critical level. We study, by means of numerical results, the effect of the variation of some parameters on the optimal policy and on the minimum average cost. For the case in which the maintenance times follow continuous distributions, an approximate discrete-time Markov decision model is proposed.