Preventing Gnome to override Xmodmap Settings

Calling gnome-settings-daemon causes xmodmap keyboard settings to be override. To solve:
1. Dirty way, put sleep after calling gnome, before calling xmodmap
gnome-settings-daemon&
sleep 1; xmodmap ~/.Xmodmap

2. Put into .bashrc, but this causes weird message xmodmap: please release the following keys within 2 seconds
if [ -f ~/.Xmodmap ] ; then
xmodmap ~/.Xmodmap
fi

3. I ended up using this method, but this should also be used with caution, since it seems to remove some custom shortcut settings...
gsettings set org.gnome.settings-daemon.plugins.keyboard active false


Warning: do not use combination of Mod4+p, it's mapped to some display setting by something... Just map the key to Mod3 or others.