Reinforcement learning for autonomous agents exploring environments: An experimental framework and preliminary results