Within the walled garden there are two small buildings to see. The first is the Bothy, which I guess is where the regular gardeners would have lived. It seemed small to me, especially after seeing the castle. There was a wood fire burning in the fireplace the day we were there which lent a nice ambiance.
You can also tour the head gardener's house. Which was pretty impressive, at least compared to the bothy. I could live there, two parlors, a couple of bedrooms, a laundry room, kitchen and dining room! The parlor had another wood fire going!