I’m struggling to think of a situation where I’d say that to a black woman but I can see how in hindsight it wouldn’t be the best turn of phrase. Obviously we should be aware of what we’re saying to an audience, but at face value it’s not a racist phrase and the lady was wrong to shame you for it.