When downloading the runnable with setup.py, afterwords we cannot run pylsp properly for some reason. We need to figure this out and fix it.