That's it, it stopped working a while ago, I haven't really noticed what have I done (it has to work earlier).
iTerm2 sends \033[3~ for here (if I'm determining this right), and it works fine with other shells on my box. Probably curtsies issue, but I decided to file issue here.