If you’re accommodating another group of people you should produce enough to always feed them, too, not just sometimes in surplus years. The whole point is that you’ve gotta plan for a surplus, otherwise you risk starvation in bad years (and it doesn’t make it any better, morally, if the people who bear the risk of starving are “another group or people”).