Icelandic investment group Baugur has scrapped its offer for menswear retailer Moss Bros after a drawn-out four-month process.