A Closer Look At Self-Rewarding Behaviour