You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
PyType_IsSubtype is doing excessive work in the common case #89860
Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.
Show more details
GitHub fields:
assignee=Noneclosed_at=<Date2021-11-04.10:41:48.112>created_at=<Date2021-11-03.01:12:41.206>labels= ['interpreter-core', '3.11', 'performance']
title='PyType_IsSubtype is doing excessive work in the common case'updated_at=<Date2021-11-04.10:41:48.111>user='https://github.com/itamaro'
Based on real world profiling data we collected, a vast amount of PyType_IsSubtype calls are coming from type_call, when it decides whether __init__ should run or not.
In the common case, the arguments to this call are identical, but the implementation still walks the MRO.
By returning early for identical types, the common case can be optimized with a non-trivial performance gain.
Perhaps it would be better to use PyObject_TypeCheck where applicable (such as in the type_call function you mention, and in abstract.c's binary_op1()).
sure, that would preempt the PyType_IsSubtype calls coming from these specific callsites, but the early return in PyType_IsSubtype would cover those as well as any other path, wouldn't it?
Dennis, can PyFrozenSet_Check and _PyObject_TypeCheck get rid of Py_IS_TYPE invocation then, so PyType_IsSubtype becomes the only source of truth here?
The PyObject_TypeCheck() macro is used in performance critical cases. If it is not the case the PyType_IsSubtype() function can be used. Adding yet check in PyType_IsSubtype() will slow down more performance sensitive cases in which PyObject_TypeCheck() is used and speed up less performance sensitive cases. So there is no reason to add it.
Not Dennis, but these changes looks good. As Serhiy mentioned, we can replace the hot callsites with PyObject_TypeCheck without slowing down PyType_IsSubtype.
itamaro commented on Nov 3, 2021
itamaromannequin
MannequinAuthor
More actions
thanks for the feedback & discussion, I submitted a new PR
Creating a new type takes microseconds, and using PyObject_TypeCheck() instead of PyType_IsSubtype() can save nanoseconds. So, while this replacement looks harmless, its effect can hardly be measured even in microbenchmarks.
itamaro commented on Nov 3, 2021
itamaromannequin
MannequinAuthor
More actions
thanks for the feedback Serhiy!
repeating my response from the PR here as well (not sure what's the proper etiquette.. :-) )
note that this code path is not for creating new types (which is slow as you say), but for creating new instances (which is quite fast).
I ran some synthetic benchmarks with this change and without it (on an opt build with PGO and LTO), and the gain is measurable:
build from main (commit acc89db which is the base commit for this PR):
>for _ in {1..10}; do ./main-opt/python -m timeit -n 10000 -s 'class Spam: pass' -- 'ten_k_spams = [Spam() for _ in range(10000)]'; done
10000 loops, best of 5: 896 usec per loop
10000 loops, best of 5: 887 usec per loop
10000 loops, best of 5: 857 usec per loop
10000 loops, best of 5: 838 usec per loop
10000 loops, best of 5: 847 usec per loop
10000 loops, best of 5: 863 usec per loop
10000 loops, best of 5: 845 usec per loop
10000 loops, best of 5: 902 usec per loop
10000 loops, best of 5: 890 usec per loop
10000 loops, best of 5: 875 usec per loop
>for _ in {1..10}; do ./test-opt/python -m timeit -n 10000 -s 'class Spam: pass' -- 'ten_k_spams = [Spam() for _ in range(10000)]'; done
10000 loops, best of 5: 833 usec per loop
10000 loops, best of 5: 885 usec per loop
10000 loops, best of 5: 845 usec per loop
10000 loops, best of 5: 838 usec per loop
10000 loops, best of 5: 833 usec per loop
10000 loops, best of 5: 827 usec per loop
10000 loops, best of 5: 858 usec per loop
10000 loops, best of 5: 811 usec per loop
10000 loops, best of 5: 843 usec per loop
10000 loops, best of 5: 845 usec per loop
also worth noting that the previous approach (GH-29380) was implemented on the Instagram Server production workload in Meta/Facebook/Instagram (choose your favorite) and resulted measurable perf gain of around 0.2%
Activity
itamaro commentedon Nov 3, 2021
Based on real world profiling data we collected, a vast amount of
PyType_IsSubtypecalls are coming fromtype_call, when it decides whether__init__should run or not.In the common case, the arguments to this call are identical, but the implementation still walks the MRO.
By returning early for identical types, the common case can be optimized with a non-trivial performance gain.
sweeneyde commentedon Nov 3, 2021
Interesting. It seems like several call sites already check the equality case:
---- setobject.h: ----
---- object.h: ----
Perhaps it would be better to use PyObject_TypeCheck where applicable (such as in the type_call function you mention, and in abstract.c's binary_op1()).
itamaro commentedon Nov 3, 2021
Dennis, you mean something like this? itamaro@92d46b2
sure, that would preempt the
PyType_IsSubtypecalls coming from these specific callsites, but the early return inPyType_IsSubtypewould cover those as well as any other path, wouldn't it?arhadthedev commentedon Nov 3, 2021
Dennis, can PyFrozenSet_Check and _PyObject_TypeCheck get rid of Py_IS_TYPE invocation then, so PyType_IsSubtype becomes the only source of truth here?
serhiy-storchaka commentedon Nov 3, 2021
The PyObject_TypeCheck() macro is used in performance critical cases. If it is not the case the PyType_IsSubtype() function can be used. Adding yet check in PyType_IsSubtype() will slow down more performance sensitive cases in which PyObject_TypeCheck() is used and speed up less performance sensitive cases. So there is no reason to add it.
Fidget-Spinner commentedon Nov 3, 2021
Not Dennis, but these changes looks good. As Serhiy mentioned, we can replace the hot callsites with PyObject_TypeCheck without slowing down PyType_IsSubtype.
itamaro commentedon Nov 3, 2021
thanks for the feedback & discussion, I submitted a new PR
serhiy-storchaka commentedon Nov 3, 2021
Creating a new type takes microseconds, and using PyObject_TypeCheck() instead of PyType_IsSubtype() can save nanoseconds. So, while this replacement looks harmless, its effect can hardly be measured even in microbenchmarks.
itamaro commentedon Nov 3, 2021
thanks for the feedback Serhiy!
repeating my response from the PR here as well (not sure what's the proper etiquette.. :-) )
note that this code path is not for creating new types (which is slow as you say), but for creating new instances (which is quite fast).
I ran some synthetic benchmarks with this change and without it (on an opt build with PGO and LTO), and the gain is measurable:
build from main (commit acc89db which is the base commit for this PR):
build with this change applied (commit 2362bf6):
also worth noting that the previous approach (GH-29380) was implemented on the Instagram Server production workload in Meta/Facebook/Instagram (choose your favorite) and resulted measurable perf gain of around 0.2%
serhiy-storchaka commentedon Nov 4, 2021
New changeset 2c045bd by Itamar Ostricher in branch 'main':
bpo-45697: Use PyObject_TypeCheck in type_call (GH-29392)
2c045bd
serhiy-storchaka commentedon Nov 4, 2021
Thank you for your contribution Itamar.
Backport gh-29392: Use PyObject_TypeCheck in type_call and binary_op1