Fashion retailer White Stuff reported an 81% plunge in pre-tax profit to £2.8m for the year to April 28 calling its financial year the “most difficult” the company has faced in its history.