In case someone else want's to get rid of some plugins which are part of the default Eclipse bundles:
Removing Mylyn, M2Eclipse and EGit was not possible via "Eclipse Installation Details -> Uninstall". The uninstall button is disabled for all plugins. Perhaps "standard" plugins pre-bundled in the download bundle from eclipse.org cannot be removed via the UI.
If someone knows how it should be correctly done please share.