125. (1) The Corporation may, and if so required by the Government, shall, lay out and maintain within the City such public gardens as may be necessary for the recreation and convenience of the public, and such public gardens shall be maintained and administered in such manner as the by-laws may provide. (2) For every public garden, there shall be framed and enforced, in the prescribed manner, a Garden Development Plan which shall provide for the development and improvement of the garden.