When you click Add Permission or Add Rule, a new box will appear that looks like this:
If you decide to delete a permission or rule, you can simply click the red recycle bin