Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: ModelEngine-Group/unified-cache-management
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: develop
Choose a base ref
...
head repository: ModelEngine-Group/unified-cache-management
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: 0.3.0-release
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 4 commits
  • 17 files changed
  • 6 contributors

Commits on Jan 28, 2026

  1. [bugfix] Fix compilation error due to missing atomic include (#693)

    ## Purpose
    Fix compilation error due to missing atomic include
    ## Modifications 
    Add #include <atomic>
    ## Test
    harrisonyhq authored Jan 28, 2026
    Configuration menu
    Copy the full SHA
    ea81630 View commit details
    Browse the repository at this point in the history
  2. [Bugfix] Modify worker_id set to separate different worker (#691)

    ## Purpose
    Use get_world_group().rank to mark worker's connector metrics, use
    engine_id to mark scheduler's connector metrics.
    ## Modifications 
    When using DP, metrics could not figure out which worker the stats
    belong to.
    flesher0813 authored Jan 28, 2026
    Configuration menu
    Copy the full SHA
    bf56df0 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2026

  1. [bugfix] rm unavailable lib and fix doc and update patch (#700)

    ## Purpose
    rm unavailable lib and fix doc and update patch for blend
    ## Modifications 
    
    ## Test
    DATA_DIR=/home/data/kv_cache
    MODEL_PATH=/home/models/mistralai/Mistral-7B-Instruct-v0.2
    BLEND_DATASET_PATH=/home/datasets/LongBench/data/2wikimqa.jsonl
    cd unified-cache-management
    python examples/offline_inference_blend.py
    <img width="1261" height="255" alt="image"
    src="https://github.com/user-attachments/assets/7ab1de8a-3161-4308-a681-10c299e38c41"
    />
    
    ---------
    
    Co-authored-by: wuhuxiao <whu.whx@gmail.com>
    Co-authored-by: wenxinwang <wangwenxin21@huawei.com>
    3 people authored Jan 29, 2026
    Configuration menu
    Copy the full SHA
    7444a35 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2026

  1. [perf] Reduce directory lock conflicts during batch dumps in PosixSto…

    …re (#711)
    
    …ref (#707)
    
    Reduce directory lock conflicts during batch dumps in PosixStore,
    improve its dump performance.
    
    - Split the unified concurrency configuration item (`stream_number`)
    into two independent concurrency configurations
    (`posix_lookup_concurrency` and `posix_data_trans_concurrency`),
    allowing for individual adjustment of the `Lookup` concurrency.
    - The directory creation action during `Dump` is moved to the `Setup`
    stage, reducing metadata operations during `Dump`.
    - Write multiple files during the `Dump` process to different shard
    directories to reduce directory conflicts during concurrent file writes.
    mag1c-h authored Jan 30, 2026
    Configuration menu
    Copy the full SHA
    8dd98d1 View commit details
    Browse the repository at this point in the history
Loading