Can a single SmartSpeaker be mapped to multiple stores?

No. A SmartSpeaker can be mapped only to a single Store ID (SID).