Adaptive Control of a Simple Queuing System

The dynamic control of two queues competing for the service of a single server is treated. The problem is to optimally design a server time allocation strategy, under various performance criteria and conditioned on varous information patterns. The instantaneous cost is selected as the total expected aggregate delay. The problem is formulated in discrete time. The arrival and departure processes at each queue are modelled as independent Bernoulli processes.