Edinburgh is quite a small city, you could stay anywhere and be fine walking the whole city. You can see the many historical sites or enjoy the scenic views.