It's not about references, it's about when the prospective employer calls your former one and asks if you're eligible for rehire.

I basically quit a retail job on the spot, because they took your 2 week notice effective immediately, and was wondering why I couldn't find another until the hiring manager from the same store in another state told me I was marked ineligible for rehire. Once I stopped listing them I found a job easily.