This public urinal situated beside Station Bridge is Grade 2 listed. It was designed by AE Collins, the then City Engineer, and dates from 1919. Built from pre-cast reinforced concrete it is of decagonal shape and has a glazed roof. The painted panels have an embossed repeating floral pattern. The urinal is believed to be the oldest surviving concrete urinal in Britain. In the 1880s, several of this type were made for the City of Norwich Corporation but all others have since been demolished.
I think the path you are talking about is Marriott's Way - running from Norwich to Reepham on the course of an old railway. It's part of National Cycle Route 1 (Harwich to Hull).