Ed, Holy Crap.... you sure can pick the tough ones. A few questions. Is this a clear sealer covering the brick surface or is it a silicone sealer between, ie: doors and brick.
If it is a surface sealer do a search on the web for Building Restoration, Paint Removal, Exterior coating removal, etc. I have seen a product which is like a paint remover. Paint it on , let it set, peal it off. If it is silicone caulk, dont have a clue. Maybe a putty knife? Hope this gets you going in the right direction.