Out on the grounds of Collegial de Neuchâtel is a round lookout from which you can get a fairly nice panorama view of the lake, the church and the surrounding houses. Take care though, the wall is not that high and it's a long drop to the streets below. The highest point in the background, overlooking the lake is the Musee de Prison. For 2 CHF you can climb to the top and have view the city from a 360 degree viewpoint.