I found when I want to change input method, I should restart X. But I don't want to close all applications. How to do that?
What you can do is start a new X-session on a different tty (screen) which should leave the apps running in the first session untouched. (This is how some display managers [e.g., KDM] allow multiple log-ins of different users using the the same physical display/keyboard.)