Public toilets are indeed scarce in Bosnia and Herzegovina, but you can find them in bus/train stations.  In some bars and cafes, toilets are of the Turkish variety, to put it bluntly, a hole in the floor.  My advice is also to carry around some tissues with you, as there may not be any toliet paper in some establishments.