Is proton entirely FOSS?

Of course it is. Proton-GE and umu wouldn’t exist if it weren’t.

but now that I think about it, I am not sure.

You could have headed to Github and just looked for yourself…