When Should the Machine Explore?