There should be some way to add caching of results to the Ops, such that an Op may simply return the result for some input if it was already called with the exact same inputs by retrieving it from some cache. This may not need to be part of the OpEnvironment or directly built into the Ops as there could be a layer in between execution and OpEnvironment which wraps an Op doing some caching.