January – February is probably the best time.
There is a database on this web page for most of the ice climbing and mixed climbing routes that have been established in Iceland, the database even has locations pinned on a map. See https://www.isalp.is/en/category/crag
Recommend that you take a look at the database.