Prince James, Duke of Rothesay was the first son of James V, King of Scotland and Mary of Guise. He died in infancy and his brother also died within a few days of his death. The crown was supposed to be passed onto him and then his brother but because of their deaths, the crown went to their sister, Princess Mary.