they’ve been shrinking as we evolved changed our diet

No genetic changes (evolution) happened. If as children we ate only very tough meat and lots of chewy vegetables - no bread or rice or potato softness - our same genetics would result in much larger adult jaws.