French vanilla ice cream is vanilla ice cream in the French style. The ice cream is French not the vanilla.

French vanilla ice cream has egg yolks. Regular vanilla ice cream does not.