Context
0.54.0 introduced Schedule (SKEEP-005): scaledDotProductAttention runs its (batch, head) units on the context's schedule, and the JVM default is CoroutineSchedule.hardware(). The changelog describes the JVM behaviour and the CI deadlock fix (#1262, #1266); nothing states what the Android compilation resolves to.
An encoder-style workload (Whisper: 20 heads × 1500 frames, prefill-shaped, not decode-shaped) is exactly where head-level parallelism pays, and Android big.LITTLE cores make the pool sizing non-obvious (#1196 documented that sleeping pools lose to one pegged big core for sub-millisecond bursts).
Scope
Acceptance
- The docs' "Schedule getting started" page has an Android paragraph with measured numbers.
- No deadlock or oversubscription when a scheduled op runs inside a JNI-threaded matmul region and vice versa.
Related
Context
0.54.0 introduced
Schedule(SKEEP-005):scaledDotProductAttentionruns its(batch, head)units on the context's schedule, and the JVM default isCoroutineSchedule.hardware(). The changelog describes the JVM behaviour and the CI deadlock fix (#1262, #1266); nothing states what the Android compilation resolves to.An encoder-style workload (Whisper: 20 heads × 1500 frames, prefill-shaped, not decode-shaped) is exactly where head-level parallelism pays, and Android big.LITTLE cores make the pool sizing non-obvious (#1196 documented that sleeping pools lose to one pegged big core for sub-millisecond bursts).
Scope
DirectCpuExecutionContext()uses as its defaultScheduleon Android (androidMainactual, or the JVM one via the shared source set?).[20, 1500, 64]) and record speedup vsSchedule.Sequential, on big cores only vs all cores.skainet_row_threads, spin-then-park) andCoroutineScheduleshould coexist per op or whether one should own the cores on Android; document the choice.TraceEvent.ScheduleDowngradedvisible on Android when a requested schedule is not honoured.androidTestinskainet-backend-jni-cpu(orskainet-backend-cpu) that exercises a scheduled SDPA on device and asserts bit-identity with sequential.Acceptance
Related