Well, Amazon's Echo is supposed to keep the voice stream local until it hears the trigger phrase.
I suppose a trigger could be set downstream to it, and the voice uploaded.
But this is the sort of hack some laptops are vulnerable to, where the cameras get turned on remotely.
Unless you are ready to go off the grid, you can be tracked. But its your smartphone that may be the biggest threat vector, not the Echo. Yet, anyway.