Fourth-grade scores for worst performers could take decades to rebound and affect economy in the future, experts say