Releases: modelscope/modelscope
Releases · modelscope/modelscope
v1.34.0
中文版
- HubApi 认证优化 (#1573): 更新了 HubAPI 的 cookie 获取逻辑,支持在初始化时传入 token 参数,并优化了 token 的获取优先级(函数参数 > 实例属性 > 环境变量)。
- 修复并完善了模型与数据集操作中 token 参数的透传逻辑 (#1592, #1593): 统一认证令牌传递机制,确保 API 调用携带有效认证凭据。同时优化了 Cookie 处理逻辑,提升与 ModelScope Hub 交互的可靠性与安全性。
- 修复 OSS STS 认证过期问题 (#1589): 重构了 OSS 工具类,新增 CredentialProviderWrapper 来自动处理临时凭证的刷新,解决了长时间数据集下载时 STS token 过期导致的失败问题。
- 弃用仓库删除相关 API (#1588): 出于安全考虑,暂时弃用 delete_repo、delete_model 和 delete_dataset 方法。这些方法现在会发出 DeprecationWarning 警告,将在未来版本中基于完善的 token 认证机制重新启用。
- 修复 FSMN 模型 ONNX 导出问题 (#1576, #1577): 为 UniDeepFsmnDilated 模块的 squeeze 操作显式指定 dim 参数,修复了 ONNX 导出后在 TensorRT 中运行失败的问题。
- 修复 Docker 镜像构建的 APT 源问题 (#1575): 移除 Dockerfile 中的 nvidia.cn APT 源,解决了在某些网络环境下 apt-get update 失败的问题。
- 修复数据集下载的依赖问题 (#1581): 将 is_relative_path 函数从 datasets 库的导入改为使用内置实现,解决了与特定版本 datasets 库的兼容性问题。
- 修复 ignore_patterns 重置问题 (#1578): 修复了当 allow_patterns 包含 ** 时错误地清空 ignore_patterns 的问题。
English Version
- HubAPI authentication enhancement (#1573): Updated HubAPI cookie retrieval logic to support passing a token parameter during initialization, with optimized token priority (function parameter > instance attribute > environment variable).
- Fixed and improved token propagation in model and dataset operations (#1592, #1593): Unified authentication token handling to ensure API calls carry valid credentials. Also enhanced cookie handling logic to improve reliability and security when interacting with ModelScope Hub.
- Fixed OSS STS authentication expiry issue (#1589): Refactored OSS utility classes by introducing CredentialProviderWrapper to automatically handle temporary credentials refresh, resolving failures during long-running dataset downloads due to STS token expiration.
- Deprecated repository deletion APIs (#1588): For security reasons, temporarily deprecated delete_repo, delete_model, and delete_dataset methods. These methods now emit DeprecationWarning and will be re-enabled in future versions with proper token authentication mechanisms.
- Fixed FSMN model ONNX export issue (#1576, #1577): Explicitly specified the dim parameter for the squeeze operation in UniDeepFsmnDilated module, fixing failures when running ONNX-exported models in TensorRT.
- Fixed Docker image build APT source issue (#1575): Removed nvidia.cn APT sources from Dockerfile to fix apt-get update failures in certain network environments.
- Fixed dataset download dependency issue (#1581): Replaced is_relative_path import from the datasets library with a built-in implementation, resolving compatibility issues with specific versions of the datasets library.
- Fixed ignore_patterns reset issue (#1578): Fixed an issue where ignore_patterns was incorrectly cleared when allow_patterns contained **.
What's Changed
- Feat: update hubapi get cookie by @Yunnglin in #1573
- Fix: remove reset ignore_patterns by @wangxingjun778 in #1578
- Fix: datasets dependency for snapshot download by @wangxingjun778 in #1581
- fix: Remove nvidia.cn from APT sources to fix apt failures in certain… by @suluyana in #1575
- Fix TensorRT parse failure for MossFormer2 ONNX Squeeze axes by @Jzz1943 in #1577
- Fix: deprecate delete_repo, delete_model and delete_dataset due to token a… by @wangxingjun778 in #1588
- [Fix]oss utils sts auth expire issue by @wangxingjun778 in #1589
- [Fix] hub push model with token by @Yunnglin in #1592
- [Fix] HubAPI token usage by @Yunnglin in #1593
New Contributors
Full Changelog: v1.33.0...v1.34.0
v1.33.0
中文版
主要更新
- 更新默认分支版本(default revision)策略,以提升仓库版本管理的一致性与易用性 #1546 #1553
- Hub API 新增
set_repo_visibility接口,支持设置模型仓库可见性,并补充可见性参数校验和错误日志提示 #1564 #1568 #1569 #1570 - 新增 Ascend NPU 的 Dockerfile,便于在昇腾 NPU 环境中部署与使用 ModelScope #1550
snapshot_download新增DEFAULT_MAX_WORKERS参数配置,优化模型快照下载的并发行为 #1566
AIGC 相关能力增强
- 为 AIGC 的
create_model_tag接口新增参数,支持更灵活的模型标签创建与管理 #1555 - AIGC 模型新增
base_model_sub_type字段,便于更精细地描述与区分底座模型类型 #1563
Hub 与上传下载体验优化
稳定性与工程改进
- 修复影响
hasattr行为的实验类型定义问题,避免潜在属性检测异常 #1552 - 动态模块加载逻辑补丁修复,提升动态模块相关功能的稳定性 #1554
- 更新构建文件与 CI 工作流,改进整体构建发布流程 #1551
English Version
Key Updates
- Updated default revision strategy to improve consistency and usability of repository version management #1546 #1553
- Added
set_repo_visibilityin Hub API to control repository visibility, with input validation and detailed error logging #1564 #1568 #1569 #1570 - Added Ascend NPU Dockerfile to simplify deployment on Ascend NPU environments #1550
- Introduced
DEFAULT_MAX_WORKERSinsnapshot_downloadto better control concurrent download behavior #1566
AIGC Enhancements
- Added new arguments for AIGC
create_model_tagfor more flexible model tag creation and management #1555 - Added
base_model_sub_typefor AIGC models to describe and distinguish base model types more precisely #1563
Hub & Upload/Download Improvements
- Fixed default ignore patterns in
upload_folderto avoid unintentionally skipping important files #1549 - Fixed upload patterns issues to improve accuracy of file uploads #1567
Stability & Engineering
- Fixed experiment type definition that affected
hasattrbehavior and could cause attribute detection issues #1552 - Patched dynamic module handling to improve stability of dynamic module related features #1554
- Updated build files and CI workflows to refine the overall build and release pipeline #1551
What's Changed
- Feat/update default revision by @alcholiclg in #1546
- Fix default ignore patterns for upload_folder by @wangxingjun778 in #1549
- Fix exp type which affects hasattr by @tastelikefeet in #1552
- Patch dynamic module by @tastelikefeet in #1554
- Feat: add new args for aigc create_model_tag by @wangxingjun778 in #1555
- [docker] Add Ascend NPU dockerfile by @baymax591 in #1550
- Update build file and workflow by @Yunnglin in #1551
- [WIP]Feat/update default revision by @alcholiclg in #1553
- Feat: add set_repo_visibility in hub api by @wangxingjun778 in #1564
- Add base_model_sub_type for aigc model by @wangxingjun778 in #1563
- Feat: add
DEFAULT_MAX_WORKERSin snapshot_download func by @wangxingjun778 in #1566 - Fix/upload patterns by @wangxingjun778 in #1567
- fix set_repo_visibility by @suluyana in #1568
- Fix: add error log for invalid input visibility args by @wangxingjun778 in #1569
- fix: check tasks in HubApi.set_repo_visibility by @suluyana in #1570
New Contributors
- @baymax591 made their first contribution in #1550
Full Changelog: v1.32.0...v1.33.0
v1.32.0
中文版
- 支持使用 pyproject.toml 来安装 modelscope 库,保证与之前安装方式兼容 #1542
- hub api 的 list_datasets 接口切换为 OpenAPI 端点 #1532
- AIGC 模型支持 model_source 参数 #1530
- ModelScope Hub 添加定期自动上传功能:自动定期上传本地文件夹到 ModelScope Hub,增量提交日志、训练产物等文件 #1480
- AIGC 的 cover_images 支持 mp4 文件 #1533
- 为 .safetensors 等单个模型文件添加内部云加速 #1529
English Version
- Support using pyproject.toml to install the modelscope library, ensuring compatibility with previous installation methods #1542
- Switch the list_datasets interface of hub API to OpenAPI endpoint #1532
- AIGC models support the model_source parameter #1530
- Add scheduled automatic upload functionality to ModelScope Hub: automatically upload local folders to ModelScope Hub at regular intervals, with incremental commits of logs, training artifacts, and other files #1480
- AIGC's cover_images now support mp4 files #1533
- Add internal cloud acceleration for single model files such as .safetensors #1529
What's Changed
- Feat/support commit scheduler by @alcholiclg in #1480
- Add INTRA_CLOUD_ACCELERATION for single model file downloading by @wangxingjun778 in #1529
- Feat: add model source for aigc model by @wangxingjun778 in #1530
- Add
trust_remote_codefor _download_additional_modules by @wangxingjun778 in #1521 - Update list datasets to OpenAPI by @Yunnglin in #1532
- [Feature] Add pyproject.toml by @Yunnglin in #1542
- Remove raise FileIntegrityError by @wangxingjun778 in #1517
- [WIP]change DEFAULT_MODEL_REVISION to master by @alcholiclg in #1544
- update ollama: granite4,deepseek-v3.1,gpt-oss by @xiaojianpinga in #1531
- Add mp4 support for AIGC
cover_imagesby @wangxingjun778 in #1533 - fix daily regression by @Yunnglin in #1545
New Contributors
- @xiaojianpinga made their first contribution in #1531
Full Changelog: v1.31.0...v1.32.0
v1.31.0
English Version
- Integrate support for "official tags" of AIGC models. #1509
- Extend the network timeout duration for model_revision checking. #1507
- Update the ms-swift Docker build process. #1502
- Fix some bugs.
中文版
- 集成对 AIGC 模型“官方标签”的支持。 #1509
- 延长 model_revision 检查的网络超时时间。 #1507
- 更新 ms-swift Docker 构建流程。 #1502
- 修复了一些bugs。
What's Changed
- [docker] update swift docker by @Jintao-Huang in #1502
- Update timeout for checking model revision by @wangxingjun778 in #1507
- Fix get_domain and endpoint by @wangxingjun778 in #1511
- Fix SyntaxError warning on MODELSCOPE_ASCII by @MichaelCurrie in #1512
- [fix] ans_dfsmn_pipeline.py resample by @weedge in #1510
- fix tokenizer download by @tastelikefeet in #1516
- Feat/add official tag by @wangxingjun778 in #1509
New Contributors
- @MichaelCurrie made their first contribution in #1512
- @weedge made their first contribution in #1510
Full Changelog: v1.30.0...v1.31.0
v1.30.0
English Version
- Added support for creating model tags via API or CLI. (@Koko-ry, #1487)
- Extended repo_info functionality to include the siblings field, enabling better metadata inspection. (@alcholiclg, #1490)
- Support for uploading AIGC model cover images in Base64 format. (@Koko-ry, #1492)
- Fixed compatibility issues with models when using the latest version of Hugging Face Transformers. (@tastelikefeet, #1491)
- Resolved linting errors in utility modules to improve code quality and consistency. (@wangxingjun778, #1493)
- Corrected endpoint behavior for AI-generated content (AIGC) services. (@Koko-ry, #1494)
- Fixed invalid revision reference in repo_info responses, ensuring accurate version tracking. (@alcholiclg, #1496)
- Improved model tag descriptions by correcting formatting and enhancing clarity. (@Koko-ry, #1500)
中文版本
- 新增通过 API 或 CLI 创建模型标签的功能。(@Koko-ry, #1487)
- 扩展 repo_info 功能,支持返回 siblings 字段,提升元数据查看能力。(@alcholiclg, #1490)
- 支持使用Base64格式上传AIGC模型的封面图。 (@Koko-ry, #1492)
- 修复与最新版 Hugging Face Transformers 的模型兼容性问题。(@tastelikefeet, #1491)
- 修复工具模块中的代码规范(lint)错误,提升代码质量与一致性。(@wangxingjun778, #1493)
- 修正 AI 生成内容(AIGC)服务端点的行为逻辑。(@Koko-ry, #1494)
- 修复 repo_info 响应中无效的版本号引用,确保版本追踪准确无误。(@alcholiclg, #1496)
- 优化模型标签描述内容,修正格式并提升可读性。(@Koko-ry, #1500)
What's Changed
- fix models with the latest transformers by @tastelikefeet in #1491
- add create model tag by @Koko-ry in #1487
- add support for siblings field in repo_info by @alcholiclg in #1490
- Fix/upload base64 by @Koko-ry in #1492
- Fix utils lint by @wangxingjun778 in #1493
- fix aigc endpoint by @Koko-ry in #1494
- Fix invalid revision in repo_info by @alcholiclg in #1496
- Fix model tag des by @Koko-ry in #1500
Full Changelog: v1.29.2...v1.30.0
v1.29.2
English Version
- Support repo_info support for retrieving repository-level metadata (datasets, models) and list all commit info
- Fix some bugs
中文版本
- 支持获取repo级别的详细信息,以及获取所有的提交记录
- 修复了一些bug
What's Changed
- Fix/upload commit by @wangxingjun778 in #1459
- Fix: add error log for validate_blob and upload_blob by @wangxingjun778 in #1482
- Fix:save_cached_files for sync dumping by @wangxingjun778 in #1484
- Feat/support repo info by @alcholiclg in #1483
New Contributors
- @alcholiclg made their first contribution in #1483
Full Changelog: v1.29.1...v1.29.2
V1.29.1 release note
English Version
- Support arg parser when python version >= 3.12, thanks to the contribution of @yaqiangsun
- Fix some bugs, e.g. VLLM cannot download from ModelScope of deepseek/internvl/internlm models
中文版本
- 兼容python>=3.12时的arg parser,感谢@yaqiangsun的贡献
- 修复了一些问题,例如VLLM无法从ModelScope下载deepseek和浦江实验室的模型
What's Changed
- Fix intermixed missing in cli_argument_parser.py by @yaqiangsun in #1437
- Fix/aigc weight by @Koko-ry in #1464
- Fix
trust_remote_codeby @wangxingjun778 in #1462 - fix:file already exist by @Koko-ry in #1465
- Merge 1.29 to master by @tastelikefeet in #1469
- support patch intern and deepseek by @tastelikefeet in #1475
- skip aigc test by @tastelikefeet in #1476
New Contributors
- @yaqiangsun made their first contribution in #1437
Full Changelog: v1.29.0...v1.29.1
V1.29.0 Release Note
English Version
New Features
- Added support for AIGC model creation interface:
modelscope create <repo_id> --token <token> --visibility <public/private/internal> --aigc --model_path <model_path> --aigc_type <Checkpoint/LoRA/VAE> --base_model_type <base_model_type>- Added support for using ModelScope MCP server. Users can interface with MCP plaza through the following method:
from modelscope.hub.mcp_api import MCPApi
server = MCPApi().get_mcp_server('@modelcontextprotocol/fetch')
...- Added support for repository creation command:
modelscope create owner/repo_name --token ms-xxx --repo_type model --visibility private --chinese_name 测试模型1 --license MITBug Fixes
- Fixed some security issues
- Fixed issues where some models could not run on higher Python versions. These models will now throw exceptions directly, guiding users to use lower Python versions
- Added additional trust_remote_code validation for models that need to run external code or use torch.load during loading
中文版本
新功能
- 支持了AIGC模型的创建接口:
modelscope create <repo_id> --token <token> --visibility <public/private/internal> --aigc --model_path <model_path> --aigc_type <Checkpoint/LoRA/VAE> --base_model_type <base_model_type>- 增加了对ModelScope MCP server的使用支持,用户可以通过多个接口与MCP广场交互,例如:
from modelscope.hub.mcp_api import MCPApi
server = MCPApi().get_mcp_server('@modelcontextprotocol/fetch')
...
...- 支持了创建repo的命令:
modelscope create owner/repo_name --token ms-xxx --repo_type model --visibility private --chinese_name 测试模型1 --license MITBug修复
- 修复了一些安全问题
- 修复了部分模型在高版本python下无法运行的问题,这些模型会直接抛出异常,指引用户使用更低版本的python
- 对部分模型在加载时需要运行外部code或者使用torch.load的情况增加了额外的trust_remote_code判断
What's Changed
- fix pyyaml according to: https://github.com/Anchor0221/CVE-2025-50460 by @tastelikefeet in #1428
- 解决使用
uv tool的依赖的问题 by @Tian-Jionglu in #1427 - Merge release 1.28 by @hjh0119 in #1401
- ollama template: qwen3-coder, gemma3n, mistral-small3.2, magistral, devstral by @suluyana in #1434
- add ms-agent into dockerfile by @tastelikefeet in #1436
- fix large log in scan cache test by @Yunnglin in #1439
- Fix: add revision arg for upload_file by @wangxingjun778 in #1440
- fix bug by @tastelikefeet in #1441
- Feat: add atomic capabilities -
MCPApiby @Koko-ry in #1426 - Add create repo cli by @wangxingjun778 in #1445
- feat: sentence_embedding pipeline by @suluyana in #1435
- Feat: Add AIGC model creation support to create_model by @Koko-ry in #1431
- merge release1.28 by @wangxingjun778 in #1448
- fix: TestTinynasDamoyoloTrainerSingleGPU ut by @wangxingjun778 in #1449
- fix: fix mcp api ut by @wangxingjun778 in #1450
- fix: fix ci by @wangxingjun778 in #1452
- fix tensorflow cannot load gpu by @tastelikefeet in #1456
- Update default version of python by @tastelikefeet in #1457
- Add
createcli warning by @wangxingjun778 in #1458
New Contributors
- @Tian-Jionglu made their first contribution in #1427
Full Changelog: v1.28.2...v1.29.0
v1.28.2
V1.28.2 Release Note
English Version
- Hotfix datasets features for
datasets >=3.0.0, <=3.6.0#1447
中文版本
- 修复datasets features兼容性问题 #1447
Full Changelog: v1.28.1...v1.28.2
v1.28.1
V1.28.1 Release Note
English Version
- Fix
use_cookiesforget_model_filesindelete_files: #1424 - Add
MODELSCOPE_CREDENTIALS_PATHenv for user-defined authorization path: #1423 - Skip UT
TextToSpeechSambertHifigan16kPipelineTest: #1420 - Add weak file lock for
snapshot_download: #1417 - Fix RCE issue for plugins (add
trust_remote_code) forfrom_pretrainedfunction: #1415 - Fix
get_dataset_infosto avoid list all pages for dataset: #1414
中文版本
- 修复
delete_files函数中的get_model_files调用,当需要鉴权的场景,需要明确传入use_cookies参数 : #1424 - 增加环境变量
MODELSCOPE_CREDENTIALS_PATH,支持用户自定义配置本地授权的存储路径(cookies、session等信息): #1423 - 跳过测试用例
TextToSpeechSambertHifigan16kPipelineTest(用例失效): #1420 - 在
snapshot_download中增加weak file lock: #1417 - 在
from_pretrained中,增加trust_remote_code`参数,避免插件RCE问题: #1415 - 修复
get_dataset_infos函数中的分页问题:#1414
What's Changed
- Fix use_cookies in get_model_files by @wangxingjun778 #1424
- Add MODELSCOPE_CREDENTIALS_PATH for user-defined authorization path by @wangxingjun778 #1423
- Skip UT TextToSpeechSambertHifigan16kPipelineTest temporarily by @Koko-ry #1420
- weak file lock by @tastelikefeet #1417
- Fix RCE issue for plugins by @Koko-ry #1415
- Fix dataset infos by @wangxingjun778 #1414
Full Changelog: v1.28.0...v1.28.1