10 days in Ontario for 2 couples in their 50's

Hello all!

We are Australians, coming to Toronto from Vancouver on September 22. We have 10 days, before heading onwards. We are thinking about 3 nights in Vancouver, hiring a car, driving to Niagara for a day trip with all the good touring we can do there, driving from Toronto to Montreal, staying 3 nights, on to Quebec staying two nights and a big long drive back to Toronto again to fly out.

Is this over ambitious? If you were to pick what gets left out or shortened what would it be? Thanks in advance.