Huge fan as well. What I really want is a terminal which has Vim's "normal mode" keybindings for scrolling back the buffer, selecting, find/replace... but then anytime you go to "insert mode", you get Readline. Best of both worlds.
I think that's Neovim's terminal mode. I personally don't use it because I use a tiling window manager, so it's easy to launch another terminal wherever I want and I'm happy with the key bindings. But some people swear by terminal mode.
