At least four fountains have adorned Capitol Square over the years, and three of these remain. The one now removed is shown below in late 19th Century photos, and was located near the Capitol Building. In the background is the Washington Equestrian Monument and the Ninth Street entrance to Capitol Square.
Two other fountains are along the Bank Street side of the square, one on the eastern side of Capitol Square near the Washington Building (shown above), and the other close to the Bell Tower on the western side of the Square (shown below). Another fountain is located in front of the Governor's Mansion.