By default, social media links are populated with a placeholder URL so you can add your own links, but removing it will remove the social media link and icon.

To remove them completely, navigate to the Website tab and click Customize.

Under the Footer block, simply erase the links, and you'll see the page refresh without the social media links. Then Save your changes.