Skip to content

Releases: modelscope/modelscope

v1.34.0

19 Jan 03:04

Choose a tag to compare

中文版

  • HubApi 认证优化 (#1573): 更新了 HubAPI 的 cookie 获取逻辑,支持在初始化时传入 token 参数,并优化了 token 的获取优先级(函数参数 > 实例属性 > 环境变量)。
  • 修复并完善了模型与数据集操作中 token 参数的透传逻辑 (#1592, #1593): 统一认证令牌传递机制,确保 API 调用携带有效认证凭据。同时优化了 Cookie 处理逻辑,提升与 ModelScope Hub 交互的可靠性与安全性。
  • 修复 OSS STS 认证过期问题 (#1589): 重构了 OSS 工具类,新增 CredentialProviderWrapper 来自动处理临时凭证的刷新,解决了长时间数据集下载时 STS token 过期导致的失败问题。
  • 弃用仓库删除相关 API (#1588): 出于安全考虑,暂时弃用 delete_repo、delete_model 和 delete_dataset 方法。这些方法现在会发出 DeprecationWarning 警告,将在未来版本中基于完善的 token 认证机制重新启用。
  • 修复 FSMN 模型 ONNX 导出问题 (#1576, #1577): 为 UniDeepFsmnDilated 模块的 squeeze 操作显式指定 dim 参数,修复了 ONNX 导出后在 TensorRT 中运行失败的问题。
  • 修复 Docker 镜像构建的 APT 源问题 (#1575): 移除 Dockerfile 中的 nvidia.cn APT 源,解决了在某些网络环境下 apt-get update 失败的问题。
  • 修复数据集下载的依赖问题 (#1581): 将 is_relative_path 函数从 datasets 库的导入改为使用内置实现,解决了与特定版本 datasets 库的兼容性问题。
  • 修复 ignore_patterns 重置问题 (#1578): 修复了当 allow_patterns 包含 ** 时错误地清空 ignore_patterns 的问题。

English Version

  • HubAPI authentication enhancement (#1573): Updated HubAPI cookie retrieval logic to support passing a token parameter during initialization, with optimized token priority (function parameter > instance attribute > environment variable).
  • Fixed and improved token propagation in model and dataset operations (#1592, #1593): Unified authentication token handling to ensure API calls carry valid credentials. Also enhanced cookie handling logic to improve reliability and security when interacting with ModelScope Hub.
  • Fixed OSS STS authentication expiry issue (#1589): Refactored OSS utility classes by introducing CredentialProviderWrapper to automatically handle temporary credentials refresh, resolving failures during long-running dataset downloads due to STS token expiration.
  • Deprecated repository deletion APIs (#1588): For security reasons, temporarily deprecated delete_repo, delete_model, and delete_dataset methods. These methods now emit DeprecationWarning and will be re-enabled in future versions with proper token authentication mechanisms.
  • Fixed FSMN model ONNX export issue (#1576, #1577): Explicitly specified the dim parameter for the squeeze operation in UniDeepFsmnDilated module, fixing failures when running ONNX-exported models in TensorRT.
  • Fixed Docker image build APT source issue (#1575): Removed nvidia.cn APT sources from Dockerfile to fix apt-get update failures in certain network environments.
  • Fixed dataset download dependency issue (#1581): Replaced is_relative_path import from the datasets library with a built-in implementation, resolving compatibility issues with specific versions of the datasets library.
  • Fixed ignore_patterns reset issue (#1578): Fixed an issue where ignore_patterns was incorrectly cleared when allow_patterns contained **.

What's Changed

New Contributors

Full Changelog: v1.33.0...v1.34.0

v1.33.0

10 Dec 07:19

Choose a tag to compare

中文版

主要更新

  • 更新默认分支版本(default revision)策略,以提升仓库版本管理的一致性与易用性 #1546 #1553
  • Hub API 新增 set_repo_visibility 接口,支持设置模型仓库可见性,并补充可见性参数校验和错误日志提示 #1564 #1568 #1569 #1570
  • 新增 Ascend NPU 的 Dockerfile,便于在昇腾 NPU 环境中部署与使用 ModelScope #1550
  • snapshot_download 新增 DEFAULT_MAX_WORKERS 参数配置,优化模型快照下载的并发行为 #1566

AIGC 相关能力增强

  • 为 AIGC 的 create_model_tag 接口新增参数,支持更灵活的模型标签创建与管理 #1555
  • AIGC 模型新增 base_model_sub_type 字段,便于更精细地描述与区分底座模型类型 #1563

Hub 与上传下载体验优化

  • 修正 upload_folder 的默认忽略规则,避免重要文件被错误忽略 #1549
  • 修复上传模式匹配(upload patterns)相关问题,提升文件上传的准确性 #1567

稳定性与工程改进

  • 修复影响 hasattr 行为的实验类型定义问题,避免潜在属性检测异常 #1552
  • 动态模块加载逻辑补丁修复,提升动态模块相关功能的稳定性 #1554
  • 更新构建文件与 CI 工作流,改进整体构建发布流程 #1551

English Version

Key Updates

  • Updated default revision strategy to improve consistency and usability of repository version management #1546 #1553
  • Added set_repo_visibility in Hub API to control repository visibility, with input validation and detailed error logging #1564 #1568 #1569 #1570
  • Added Ascend NPU Dockerfile to simplify deployment on Ascend NPU environments #1550
  • Introduced DEFAULT_MAX_WORKERS in snapshot_download to better control concurrent download behavior #1566

AIGC Enhancements

  • Added new arguments for AIGC create_model_tag for more flexible model tag creation and management #1555
  • Added base_model_sub_type for AIGC models to describe and distinguish base model types more precisely #1563

Hub & Upload/Download Improvements

  • Fixed default ignore patterns in upload_folder to avoid unintentionally skipping important files #1549
  • Fixed upload patterns issues to improve accuracy of file uploads #1567

Stability & Engineering

  • Fixed experiment type definition that affected hasattr behavior and could cause attribute detection issues #1552
  • Patched dynamic module handling to improve stability of dynamic module related features #1554
  • Updated build files and CI workflows to refine the overall build and release pipeline #1551

What's Changed

New Contributors

Full Changelog: v1.32.0...v1.33.0

v1.32.0

18 Nov 02:43

Choose a tag to compare

中文版

  1. 支持使用 pyproject.toml 来安装 modelscope 库,保证与之前安装方式兼容 #1542
  2. hub api 的 list_datasets 接口切换为 OpenAPI 端点 #1532
  3. AIGC 模型支持 model_source 参数 #1530
  4. ModelScope Hub 添加定期自动上传功能:自动定期上传本地文件夹到 ModelScope Hub,增量提交日志、训练产物等文件 #1480
  5. AIGC 的 cover_images 支持 mp4 文件 #1533
  6. 为 .safetensors 等单个模型文件添加内部云加速 #1529

English Version

  1. Support using pyproject.toml to install the modelscope library, ensuring compatibility with previous installation methods #1542
  2. Switch the list_datasets interface of hub API to OpenAPI endpoint #1532
  3. AIGC models support the model_source parameter #1530
  4. Add scheduled automatic upload functionality to ModelScope Hub: automatically upload local folders to ModelScope Hub at regular intervals, with incremental commits of logs, training artifacts, and other files #1480
  5. AIGC's cover_images now support mp4 files #1533
  6. Add internal cloud acceleration for single model files such as .safetensors #1529

What's Changed

New Contributors

Full Changelog: v1.31.0...v1.32.0

v1.31.0

15 Oct 09:47

Choose a tag to compare

English Version

  1. Integrate support for "official tags" of AIGC models. #1509
  2. Extend the network timeout duration for model_revision checking. #1507
  3. Update the ms-swift Docker build process. #1502
  4. Fix some bugs.

中文版

  1. 集成对 AIGC 模型“官方标签”的支持。 #1509
  2. 延长 model_revision 检查的网络超时时间。 #1507
  3. 更新 ms-swift Docker 构建流程。 #1502
  4. 修复了一些bugs。

What's Changed

New Contributors

Full Changelog: v1.30.0...v1.31.0

v1.30.0

15 Sep 12:07

Choose a tag to compare

English Version

  1. Added support for creating model tags via API or CLI. (@Koko-ry, #1487)
  2. Extended repo_info functionality to include the siblings field, enabling better metadata inspection. (@alcholiclg, #1490)
  3. Support for uploading AIGC model cover images in Base64 format. (@Koko-ry, #1492)
  4. Fixed compatibility issues with models when using the latest version of Hugging Face Transformers. (@tastelikefeet, #1491)
  5. Resolved linting errors in utility modules to improve code quality and consistency. (@wangxingjun778, #1493)
  6. Corrected endpoint behavior for AI-generated content (AIGC) services. (@Koko-ry, #1494)
  7. Fixed invalid revision reference in repo_info responses, ensuring accurate version tracking. (@alcholiclg, #1496)
  8. Improved model tag descriptions by correcting formatting and enhancing clarity. (@Koko-ry, #1500)

中文版本

  1. 新增通过 API 或 CLI 创建模型标签的功能。(@Koko-ry, #1487)
  2. 扩展 repo_info 功能,支持返回 siblings 字段,提升元数据查看能力。(@alcholiclg, #1490)
  3. 支持使用Base64格式上传AIGC模型的封面图。 (@Koko-ry, #1492)
  4. 修复与最新版 Hugging Face Transformers 的模型兼容性问题。(@tastelikefeet, #1491)
  5. 修复工具模块中的代码规范(lint)错误,提升代码质量与一致性。(@wangxingjun778, #1493)
  6. 修正 AI 生成内容(AIGC)服务端点的行为逻辑。(@Koko-ry, #1494)
  7. 修复 repo_info 响应中无效的版本号引用,确保版本追踪准确无误。(@alcholiclg, #1496)
  8. 优化模型标签描述内容,修正格式并提升可读性。(@Koko-ry, #1500)

What's Changed

Full Changelog: v1.29.2...v1.30.0

v1.29.2

02 Sep 09:55

Choose a tag to compare

English Version

  1. Support repo_info support for retrieving repository-level metadata (datasets, models) and list all commit info
  2. Fix some bugs

中文版本

  1. 支持获取repo级别的详细信息,以及获取所有的提交记录
  2. 修复了一些bug

What's Changed

New Contributors

Full Changelog: v1.29.1...v1.29.2

V1.29.1 release note

01 Sep 05:39

Choose a tag to compare

English Version

  1. Support arg parser when python version >= 3.12, thanks to the contribution of @yaqiangsun
  2. Fix some bugs, e.g. VLLM cannot download from ModelScope of deepseek/internvl/internlm models

中文版本

  1. 兼容python>=3.12时的arg parser,感谢@yaqiangsun的贡献
  2. 修复了一些问题,例如VLLM无法从ModelScope下载deepseek和浦江实验室的模型

What's Changed

New Contributors

Full Changelog: v1.29.0...v1.29.1

V1.29.0 Release Note

14 Aug 09:33

Choose a tag to compare

English Version

New Features

  1. Added support for AIGC model creation interface:
modelscope create <repo_id> --token <token> --visibility <public/private/internal> --aigc --model_path <model_path> --aigc_type <Checkpoint/LoRA/VAE> --base_model_type <base_model_type>
  1. Added support for using ModelScope MCP server. Users can interface with MCP plaza through the following method:
from modelscope.hub.mcp_api import MCPApi
server = MCPApi().get_mcp_server('@modelcontextprotocol/fetch')
...
  1. Added support for repository creation command:
modelscope create owner/repo_name --token ms-xxx --repo_type model --visibility private --chinese_name 测试模型1 --license MIT

Bug Fixes

  1. Fixed some security issues
  2. Fixed issues where some models could not run on higher Python versions. These models will now throw exceptions directly, guiding users to use lower Python versions
  3. Added additional trust_remote_code validation for models that need to run external code or use torch.load during loading

中文版本

新功能

  1. 支持了AIGC模型的创建接口:
modelscope create <repo_id> --token <token> --visibility <public/private/internal> --aigc --model_path <model_path> --aigc_type <Checkpoint/LoRA/VAE> --base_model_type <base_model_type>
  1. 增加了对ModelScope MCP server的使用支持,用户可以通过多个接口与MCP广场交互,例如:
from modelscope.hub.mcp_api import MCPApi
server = MCPApi().get_mcp_server('@modelcontextprotocol/fetch')
...
...
  1. 支持了创建repo的命令:
modelscope create owner/repo_name --token ms-xxx --repo_type model --visibility private --chinese_name 测试模型1 --license MIT

Bug修复

  1. 修复了一些安全问题
  2. 修复了部分模型在高版本python下无法运行的问题,这些模型会直接抛出异常,指引用户使用更低版本的python
  3. 对部分模型在加载时需要运行外部code或者使用torch.load的情况增加了额外的trust_remote_code判断

What's Changed

New Contributors

Full Changelog: v1.28.2...v1.29.0

v1.28.2

06 Aug 07:42

Choose a tag to compare

V1.28.2 Release Note

English Version

  1. Hotfix datasets features for datasets >=3.0.0, <=3.6.0 #1447

中文版本

  1. 修复datasets features兼容性问题 #1447

Full Changelog: v1.28.1...v1.28.2

v1.28.1

25 Jul 07:43

Choose a tag to compare

V1.28.1 Release Note

English Version

  1. Fix use_cookies for get_model_files in delete_files: #1424
  2. Add MODELSCOPE_CREDENTIALS_PATH env for user-defined authorization path: #1423
  3. Skip UT TextToSpeechSambertHifigan16kPipelineTest: #1420
  4. Add weak file lock for snapshot_download: #1417
  5. Fix RCE issue for plugins (add trust_remote_code) for from_pretrained function: #1415
  6. Fix get_dataset_infos to avoid list all pages for dataset: #1414

中文版本

  1. 修复delete_files函数中的get_model_files调用,当需要鉴权的场景,需要明确传入use_cookies参数 : #1424
  2. 增加环境变量MODELSCOPE_CREDENTIALS_PATH,支持用户自定义配置本地授权的存储路径(cookies、session等信息): #1423
  3. 跳过测试用例TextToSpeechSambertHifigan16kPipelineTest(用例失效): #1420
  4. snapshot_download中增加weak file lock: #1417
  5. from_pretrained中,增加 trust_remote_code`参数,避免插件RCE问题: #1415
  6. 修复get_dataset_infos函数中的分页问题:#1414

What's Changed

Full Changelog: v1.28.0...v1.28.1