Confidence Intervals for Bandit Policies: A BSI Demo

less than 1 minute read

Published:

After running a bandit algorithm, how well would a different policy have done? Bandit Simulation for Inference (BSI) fits a simulator of the environment from logged bandit data and uses it to build a confidence interval for the mean reward of any policy, including adaptive ones like Thompson sampling. This demo walks through the workflow: upload logged data, choose the policy to evaluate and the horizon, and see the checks that flag when the interval may not be reliable. The interval it reports is an illustration, not the output of the BSI code.

Open the demo.