Zcash's privacy model treats your counterparty as the adversary; they know at least as much as any observer. Shielded transactions leak *nothing* to your counterparty, and therefore your privacy is unaffected by which address type they provide.