Extension 1: Initial reward
- Initial reward Ci: indicates user's perceived probability of completion/service upon arrival at the web server
- Application: QoS levels
- Potential revenue: same equation as in the original system, multiplied by the initial reward
- Natural extension of the original system model
- Optimal policy: serve the request that has the highest potential revenue
(function of the time in the system so far and the initial reward)