With competition hotter than ever in retail, and customer loyalty faltering, insight into shopper behaviour has never been more important.