Yes. An agent is looking for an excuse to reject your submission. A simple typo, or an out of place cliché, might give them all the excuse they need, however good the rest of your book is. Furthermore, you only have one chance to impress an agent with a manuscript. Unless they ask you to resubmit, your chance with that agent with that book is gone.