When I travel and want to rest, I go straight to Toledo and daytrip to Madrid. My kids prefer Toledo because they can wander on their own!! We hop a train as soon as we arrive and start our trips from Toledo.
If the kids are old enough, I would get two rooms so you have a bit more space. Four exhausted people in one room does not sound like much fun!!
_________________________
sel