Hi Regis
Even with just a bishop and knight, one can comfortably hold off an enemy queen by creating a fortress:
The knight is defended by the bishop, and the bishop is defended by the king. The white king cannot be displaced by the lone black queen, and the black king is kept at bay with a barrier created by the two minor pieces that collectively cover a3, b3, c3, c2, and c1.
With a rook replacing either of those pieces, we can use the same concept to create a fortress. Because the rook is so much more powerful, there are a lot more configurations that work, but the two simplest ones that come to mind are:
If the defender (the side without the queen) has an extra pawn, like in your third/fourth position, the position is still a draw. It is simply not possible to coordinate your pieces to push your pawn and protect yourself from perpetual check at the same time.
With an extra pawn, the attacker can play for a win, especially if his opponent's forces are far from the pawn. In such situations, the defender should aim to set up his fortress right in front of the pawn which might be enough to hold the draw:
Hi, I am Regis (a.k.a. dennis9989, which Dennis is my dad) and today I want to discuss the Queen vs. Rook and Bishop and Queen vs. Rook and Knight endgames, like this: