I'd recommend reading William K. Hartmann's Moons & Planets before you decide. As already mentioned, there's a lot of "earth science" in planetary geology.
It really took off (pun intended) when Apollo teams visited the Moon. What we learned about the Moon, and by extension the origin of Earth and Moon, after Apollo really got planetary geology going.
There's a great deal of new data from space probes like Cassini and we've visited several asteroids and comets now, too. Plus the Mars Rovers are still going strong and sending back reams of data that's providing new insights into the geological history of Mars.
Until the run-up to Apollo, solar system science was really a dead-end career in the opinion of most astronomers. Not so any longer ... most especially since Comet Shoemaker-Levy 9 impacted Jupiter.