I've tried for about one week and finally got it (another poor guy find the solution)
So I post this thread even before the installation of Chinese input method...
1. download the driver from http://www.nvidia.com/
2. Remove old drivers(if exists)
sudo apt-get --purge remove nvidia-glx (or nvidia-glx-new)
3. Install compile tools:
sudo apt-get install build-essential linux-headers-`uname -r`
4. Disable default driver
sudo gedit /etc/default/linux-restricted-modules-common
Add nvidia_new into " ". THIS IS VERY IMPORTANT.
(Most of the threads says to add nv, but only nvidia_new works. And I also tried "nv nvidia_new", this won't work either).
5. Leave x:
sudo init 1
6. Install the dirver:
chmod +x <DRIVER_NAME>
follow the instructions. It will notice you that level 1 might not be good, ignore this because you're using ubuntu.
I didn't try to startx directly, but directly reboot works.
ps: you can paste these words to a text file, and then you can read it in init 1, that's why I write this in English.
Enjoy and goodluck.