scrollZoom performance issues since 2.0.0-rc.2 #6054

I don't have rights to reopen the #5912 so creating a follow-up issue

Here's a demo: https://codesandbox.io/s/plotly2-performance-hovermode-0hf9z?file=/src/index.js

It is set to run with Plotly 2.0.0-rc.1 and the zoom is smooth like butter
But change it to rc.2 or any fresher version and try zooming in with mouse wheel some good amount - after certain point it will become unusably sluggish