My suggestion will be to stay near the temple if you wish to attend the Evening Ganga Aarti or Take an Early morning boat ride across the Ganges.
You will find many budget friendly hotels near the temple at a walkable distance.
You will also get many budget friendly restaurants nearby the temple serving North & South Indian Dishes.