Yes. To remove a Business Tax Dashboard, follow the 'Remove service' link on the 'Account overview' page.
An example of why you may want to remove a dashboard is:
A dashboard can only display Corporation Tax or Self Assessment records and any associated PAYE and/or VAT records set up under the same Government Gateway online account (User ID).
If you have set up a dashboard to view your Self Assessment records then you enrol for the Corporation Tax online service under the same User ID and want to add this to your dashboard, you must first remove the Self Assessment one. You can then set up a new dashboard for Corporation Tax.