There isn’t really much of a town at Red Feather, although I was surprised to see there are around 5 restaurants when I just looked it up. It’s a great place for camping or fishing but the mountain views aren’t as scenic there as other places.

You might also look around the Buena Vista area.

Yes the BV/ Nathrop area might just have what you're looking for.

For as small as the town is, there's quite a a selection of excellent restaurants. Not high end, just fun outdoor selections.

Nathrop has a few cabins and such tucked in the woods. Some are along Chalk Creek. About 20 minutes to BV, 30 minutes to the cute town of Salida.

Mt. Princeton Hot Springs has a very good restaurant. Need reservations for dinner, but not for lunch.

St. Elmo Ghost Town is down the road from there. Very picturesque.

When is your trip? Dates and timing have a lot to do with crowds. Depending on when, the crowds may be unavoidable even in the smaller places nowadays.. sadly...