We don't have your shirt.
is correct. (meaning We - whoever is speaking - does not posses your shirt)
We are not with your shirt.
does not make sense, in normal English usage. It could mean that we are not co-located (at the same place) as your shirt, but that would be a very unusual way of stating that condition
AW