absolutely yes.Of course. The only condition is that when in the territory of THE country, you must carry THEIR passport and under THEIR laws.

so for example, when I go to the USA, I go in with my US passport there. When I come back to France, I enter with my French passport. The same for Spain and Cuba ::)

Cheers