Yes you have to listen, but.............
Here's a typical conversation I hear in San Antonio. No corrections. This what I hear.
Hi Mami, how ya doin'
CansadoHay vamos
That's right baby. Hang in there.
Don't get me wrong. I'm happy to hear anything resembling Spanish. I'm happy to understand that by "Hay vamos" she's basically conveying "we're still breathing." But the pickings are slim, and if you want to interact in Spanish you have to really step outside the box. I should point out, also, that in any given location in any given language conversations don't get much deeper unless you look. Then you have to talk them ito putting down there phone.

2 Answers
You sure it's not "ahí vamos"? Sounds similar, but I think this would make more sense in context.
Hay vamos = we're still living, we're just keepin' on or a hundred other ways to express just hangin' in there. It seems perfectly appropriate for this type of conversation.