Make sure your working tree is clean (if not, commit or stash your changes), then run

$ git rm ./that_one_big_file
$ git history fixup deadbeef

Replace deadbeef with the commit that introduced that_one_big_file.

For more complex history editing tasks, see git rebase in depth.