I thought about that as I was typing. The LSU rematch game illustrates your point. I boycotted that game btw. You may be right, but Bama did win all 3 of those high profile games.
I think a few qualifying rules would help straighten out things,......i.e. you have to be at least a have won your division of a conference. A conference champion with a ranking within 5 (or whatever 3 ) of a non conference winner gets preference. etc etc.