If the data source has the Is Default Profile option selected, you can clear it at any time. However, if the IS_DEFAULT_PROFILE field is in use, the system will not remove it.
You can delete a data source if it is not being used by any trigger system. Detect automatically deletes the field definitions associated with it so that they are not orphaned within the system.