I didnt check to see if i had the key (and can't at the moment, @ work lol), but I did go back and talk to the guy in heaven towers, which if i had done the castle right, should have triggered a cutscene to finish the mission, which didnt happen either.
