How can I install the env without the docker? #4

Activity

1. YuanDaoze commented on Apr 13, 2025

   

   YuanDaoze

   on Apr 13, 2025

   Author

   More actions

   When I test the "python" type in 'reference' file of the repo , i got some problems.

   (humaneval) [u22202140@n1 NaturalCodeBench]$ python ncb/evaluate.py --languages python --natural_lang zh --ckpt_name deepseek-r1 --num_worker
   s 4 --ks 1
   results/deepseek-r1/deepseek-r1_ncb_python_zh.jsonl
   Extracting code from response
   Writing test files
   Start evaluation
   100%|████████████████████████████████████████████████████████████████████████████████████████████████████████| 70/70 [00:16<00:00, 4.17it/s]
   Error occur in python_149_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_149_0/error_report.jsonl'
   Error occur in python_184_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_184_0/error_report.jsonl'
   Error occur in python_195_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_195_0/error_report.jsonl'
   Error occur in python_186_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_186_0/error_report.jsonl'
   Error occur in python_172_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_172_0/error_report.jsonl'
   Error occur in python_178_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_178_0/error_report.jsonl'
   Error occur in python_137_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_137_0/error_report.jsonl'
   Error occur in python_156_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_156_0/error_report.jsonl'
   Error occur in python_168_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_168_0/error_report.jsonl'
   Error occur in python_181_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_181_0/error_report.jsonl'
   Error occur in python_188_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_188_0/error_report.jsonl'
   Error occur in python_180_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_180_0/error_report.jsonl'
   Error occur in python_194_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_194_0/error_report.jsonl'
   Error occur in python_161_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_161_0/error_report.jsonl'
   Error occur in python_190_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_190_0/error_report.jsonl'
   Error occur in python_191_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_191_0/error_report.jsonl'
   Error occur in python_160_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_160_0/error_report.jsonl'
   Error occur in python_193_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_193_0/error_report.jsonl'
   Error occur in python_148_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_148_0/error_report.jsonl'
   Error occur in python_163_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_163_0/error_report.jsonl'
   Error occur in python_197_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_197_0/error_report.jsonl'
   Error occur in python_134_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_134_0/error_report.jsonl'
   Error occur in python_173_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_173_0/error_report.jsonl'
   Error occur in python_200_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_200_0/error_report.jsonl'
   Error occur in python_171_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_171_0/error_report.jsonl'
   Error occur in python_169_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_169_0/error_report.jsonl'
   Error occur in python_174_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_174_0/error_report.jsonl'
   Error occur in python_151_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_151_0/error_report.jsonl'
   Error occur in python_145_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_145_0/error_report.jsonl'
   Error occur in python_147_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_147_0/error_report.jsonl'
   Error occur in python_140_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_140_0/error_report.jsonl'
   Error occur in python_139_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_139_0/error_report.jsonl'
   Error occur in python_150_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_150_0/error_report.jsonl'
   Error occur in python_133_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_133_0/error_report.jsonl'
   Error occur in python_142_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_142_0/error_report.jsonl'
   Error occur in python_189_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_189_0/error_report.jsonl'
   Error occur in python_199_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_199_0/error_report.jsonl'
   Error occur in python_179_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_179_0/error_report.jsonl'
   Error occur in python_131_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_131_0/error_report.jsonl'
   Error occur in python_164_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_164_0/error_report.jsonl'
   Error occur in python_177_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_177_0/error_report.jsonl'
   Error occur in python_192_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_192_0/error_report.jsonl'
   Error occur in python_183_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_183_0/error_report.jsonl'
   Error occur in python_198_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_198_0/error_report.jsonl'
   Error occur in python_159_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_159_0/error_report.jsonl'
   Error occur in python_143_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_143_0/error_report.jsonl'
   Error occur in python_165_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_165_0/error_report.jsonl'
   Error occur in python_146_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_146_0/error_report.jsonl'
   Error occur in python_144_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_144_0/error_report.jsonl'
   Error occur in python_176_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_176_0/error_report.jsonl'
   Error occur in python_153_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_153_0/error_report.jsonl'
   Error occur in python_138_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_138_0/error_report.jsonl'
   Error occur in python_152_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_152_0/error_report.jsonl'
   Error occur in python_185_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_185_0/error_report.jsonl'
   Error occur in python_136_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_136_0/error_report.jsonl'
   Error occur in python_166_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_166_0/error_report.jsonl'
   Error occur in python_196_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_196_0/error_report.jsonl'
   Error occur in python_182_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_182_0/error_report.jsonl'
   Error occur in python_170_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_170_0/error_report.jsonl'
   Error occur in python_175_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_175_0/error_report.jsonl'
   Error occur in python_132_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_132_0/error_report.jsonl'
   Error occur in python_157_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_157_0/error_report.jsonl'
   Error occur in python_154_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_154_0/error_report.jsonl'
   Error occur in python_155_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_155_0/error_report.jsonl'
   Error occur in python_141_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_141_0/error_report.jsonl'
   Error occur in python_167_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_167_0/error_report.jsonl'
   Error occur in python_187_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_187_0/error_report.jsonl'
   Error occur in python_162_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_162_0/error_report.jsonl'
   Error occur in python_135_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_135_0/error_report.jsonl'
   Error occur in python_158_0, error: [Errno 2] No such file or directory: '/home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_zh_test/deepseek-r1/python_158_0/error_report.jsonl'
   Total Running time 16.85556697845459
   {'result': {'pass@k': {'pass@1': 0.0}, 'time': 16.85556697845459}, 'error': {'SyntaxError': 0.0, 'RuntimeError': 0.0}, 'ckpt_name': 'deepseek-r1', 'benchmark': 'ncb_python_zh'}

   {'result': {'pass@k': {'pass@1': 0.0}, 'time': 16.85556697845459}, 'error': {'SyntaxError': 0.0, 'RuntimeError': 0.0}, 'ckpt_name': 'deepseek-r1', 'benchmark': 'ncb_python_zh'}

   log file(./NaturalCodeBench/data/temp/python_en_test/deepseek-r1/python_195_0/log.txt)
   ERROR: usage: exec_python.py [options] [file_or_dir] [file_or_dir] [...]
   exec_python.py: error: unrecognized arguments: --cov --cov-report
   inifile: None
   rootdir: /home/u22202140/xt/Ants_Agent/NaturalCodeBench/data/temp/python_en_test/deepseek-r1/python_195_0

   Traceback (most recent call last):
   File "ncb/exec_python.py", line 87, in
   run_python_test(args.base_dir, args.test_dir)
   File "ncb/exec_python.py", line 36, in run_python_test
   print(plugin.report.get('tests'))
   AttributeError: 'NoneType' object has no attribute 'get'