Warehouses can be deleted using the respective context menu button in the warehouse overview.
Default warehouses generally cannot be deleted. In this case, you first need to make another warehouse your default warehouse.
Likewise, warehouses can only be deleted if there are no more products with stock stored there. In this case, an error message will also appear if you try to delete the warehouse. You then need to move all remaining stock out of this warehouse before you can delete it.
