If you had the option to rearrange items within each filter them you could minimize items you don’t need/use and put them at the bottom of the filter.
Don’t forget that you can create your own workspace panels which then appear when no filter is selected. You can also assign favourites which show in the favourites panel. This is how I work and I don’t have the need for anything else.