From this page you can access the othello applet that is referred to in the following publication:
N.J. van Eck and M. van Wezel. Application of reinforcement learning to the game of Othello, Computers & Operations Research, 35(6):1999-2017, 2008.
N.J. van Eck and M. van Wezel. Reinforcement learning and its application to Othello. Econometric Institute Report, EI 2005-47, Erasmus University Rotterdam, December 2005.