How to Remove an Image From a WordPress Photo Gallery. If your small business has a WordPress-powered website with photo galleries, ... Some HTML code is needed to add links to your captions.