He is also group finance director of RHM, which supplies a range of branded cooking products, including Atora suet and Bisto gravy mixes. It has not been made clear whether he will be replaced.
Moss Bros chairman Keith Hamill said: 'I would like to thank Andrew for his excellent advice and contribution to the recovery of the company over the past four years and for his support as chairman of the audit committee.'
Once a high street icon of the 1980s, the retailer foundered in the following decade.
The new millennium has been prosperous for the retailer, however. Profits at the group grew five-fold for the year to January 29 2005. The menswear retailer's pre-tax profit was up from£1 million to£5.5 million.
Turnover for the year increased, but at a slower rate, from£124 million to£130.2 million. Like-for-like sales were up 9 per cent.