Don’t miss parts of Prague castle?

It’s huge and comprised of many different venues. I know to see Vitus Cathedral but what else? Is the castle itself a must see? Gardens? It’s very packed so far this week so we are trying to go early in the AM in a weekday.