That's incriminating evidence of his client's misconduct. Best to get rid of it immediately rather than risk it falling into the wrong hands one way or another.
That's a good point, I didn't consider it from the blackmailing angle, which is silly, because it's one of the reasons Maurice shows him the letter in the first place.