I'll present questions for you to ask yourself.

Color can represent building materials and their state of as well as age. The older the building is, there might be less upkeep. Hence what I see looks like a hole in the roof. Maybe the north corner has some moss? Is the roof shingled or thatched or burnt? Maybe the door was kicked in or the place abandoned? Maybe it's still on fire? Wood has many colors, especially when burnt recently.

Look up some architecture for the region and period that you're attempting. Houses, walls, bridges, roads, etc. Look at ruins, abandoned and burnt buildings. How much of the ruin survived or collapsed? What was the purpose of the building/bridge/pathway when it was in operation? Is it still visited in your final build's state? If so, how often?

You say medieval, who does/did the house belong to? What do/did they do for a living? How long ago did the (insert event) happen? Is it freshly smoldering or overgrown?

You're still in the early stages but, tell a story with colors and bricks.