Add in the file /usr/share/X11/app-defaults/XTerm:

*charClass: 33:48,35:48,37-38:48,43-47:48,58:48,61:48,63-64:48,95:48,126:48