I think the other piece of this is that we had bright spots get eclipsed based on really dark ones. Addition by subtraction in the secondary seems likely to me, and couple that with a unified scheme we should see improvement there. At DL we seem to have finally gotten to a point where we should be able to hold the line of attack and even get some hurries / sacks which helps the whole D as well.
On O, we have seen talk through the last season of a split mind mentality with some coaches wanting more of a ground pound game and others driving towards more nuance passing - I think that dichotomy strongly disadvantaged our young QB.
In all, there are a few things that need to shake out to have us reach our potential; but it's not as outrageous as it may seem for us to have a floor of 6 wins.