The risk is your computer reaching out to something on the internet (either by you browsing, or some automatic background activity) and whatever it finds infects it.

This could be something like an ad on an otherwise trustworthy website.