Skip to content

P7: decide who chooses a tensor's device placement #1133

Description

@michalharakal

Split out of #1131.

Placement and MemoryDomain exist and AllocationSpec carries them, but nothing chooses — a tensor's home is decided by whoever constructs it, not by a policy that can see the whole model.

Research question

Where should placement decisions come from: a per-model policy, the PlannerProfile, or something derived from the graph? Does this need a graph to reason about at all, or can it work over the eager construction order?

Depends on

Nothing blocking — the storage model (#932) landed the types this needs. Related to #1131's open question of whether P7 is wanted for the eager path at all, or only for the recorded path where IREE already does allocation planning.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions