We took our 8 year old to the Was museum this year too. It was just ok. If you have never been to a wax museum, then it might be fun. The horror chamber was too scary for her.
I don't think it is an essential place to go when you only have a limited time in Madrid, but since we go every summer it was a way to pass the day.