I lived with it for ages. I tried to fix it on my own, by selecting different emulation types. Finally I Googled for it. And pretty much instantly found the answer:
python `python -c “import pimp; print pimp.__file__”` -i readline
Moral? If at first you don’t succeed, Google. If Google fails, try, try again.
Update: And to make forward-delete work, try this.