Non-compete agreements are unenforceable if they're unreasonably restrictive. From what you say here, I'd take it as more intimidation than locking you out of gainful employment.

^^ sometimes the court only throws out the unreasonable part, such as duration, too broad etc
^^ depends on state law
^^^^^ not a lawyer