Castle Row leads towards the centre of the city, although you need to go to the corner in the distance and turn left to reach Castle Street.
Alternatively, you can turn right and follow the line of the walls round the outside of the ancient city.