The issue is that you’re starting from earth, and the earth already has a lot of momentum that keeps it from falling into the sun. To get an object from here to the sun you would need to counter the majority of that momentum it already has.