The exclusions dialog can be found via.
There are two types of exclusions, File and Folder. The selection dialog handles what object type(s) can be added.
Ensure the correct type is selected and then click the add button and select the object.
Select the object to be removed in the ListBox and then click the remove button.