You're not stuck with the Amazon App Store.

Google Play Store is a system app, which means it cannot be directly uninstalled like other apps you download from the store. To address issues, you can either disable the app or uninstall its updates ...