we found the problem ourselves :)
the problem was, that we "closed" the netStream with "null" which just deleted the reference - not killed the stream - so when calls where made we just got more and more netStreams
the solution was to maintain 4 netstreams constantly
and now we got perfect sound (even with mic and speakers in same box)