The funny thing about deepseek is that nvidia refused to export ptx code (or was prohibited by law, I’m not sure which) to china. So, china reverse engineered the hardware, and wrote a more efficient version of ptx for the deepseek model.

PTX is basically nvidia’s assembly language, btw.