Mypy supports two ways of deciding whether two classes are compatible
as types: nominal subtyping and structural subtyping. Nominal
subtyping is strictly based on the class hierarchy. If class D
inherits class C, it's also a subtype of C, and instances of
D can be used when C instances are expected. This form of
subtyping is used by default in mypy, since it's easy to understand
and produces clear and concise error messages, and since it matches
how the native :py:func:`isinstance <isinstance>` check works -- based on class
hierarchy. Structural subtyping can also be useful. Class D is
a structural subtype of class C if the former has all attributes
and methods of the latter, and with compatible types.
Structural subtyping can be seen as a static equivalent of duck typing, which is well known to Python programmers. Mypy provides support for structural subtyping via protocol classes described below. See PEP 544 for the detailed specification of protocols and structural subtyping in Python.
The :py:mod:`typing` module defines various protocol classes that correspond
to common Python protocols, such as :py:class:`Iterable[T] <typing.Iterable>`. If a class
defines a suitable :py:meth:`__iter__ <object.__iter__>` method, mypy understands that it
implements the iterable protocol and is compatible with :py:class:`Iterable[T] <typing.Iterable>`.
For example, IntList below is iterable, over int values:
from typing import Iterator, Iterable, Optional
class IntList:
def __init__(self, value: int, next: Optional['IntList']) -> None:
self.value = value
self.next = next
def __iter__(self) -> Iterator[int]:
current = self
while current:
yield current.value
current = current.next
def print_numbered(items: Iterable[int]) -> None:
for n, x in enumerate(items):
print(n + 1, x)
x = IntList(3, IntList(5, None))
print_numbered(x) # OK
print_numbered([4, 5]) # Also OKThe subsections below introduce all built-in protocols defined in :py:mod:`typing` and the signatures of the corresponding methods you need to define to implement each protocol (the signatures can be left out, as always, but mypy won't type check unannotated methods).
The iteration protocols are useful in many contexts. For example, they allow iteration of objects in for loops.
The :ref:`example above <predefined_protocols>` has a simple implementation of an :py:meth:`__iter__ <object.__iter__>` method.
def __iter__(self) -> Iterator[T]See also :py:class:`~typing.Iterable`.
def __next__(self) -> T
def __iter__(self) -> Iterator[T]See also :py:class:`~typing.Iterator`.
Many of these are implemented by built-in container types such as :py:class:`list` and :py:class:`dict`, and these are also useful for user-defined collection objects.
This is a type for objects that support :py:func:`len(x) <len>`.
def __len__(self) -> intSee also :py:class:`~typing.Sized`.
This is a type for objects that support the in operator.
def __contains__(self, x: object) -> boolSee also :py:class:`~typing.Container`.
def __len__(self) -> int
def __iter__(self) -> Iterator[T]
def __contains__(self, x: object) -> boolSee also :py:class:`~typing.Collection`.
These protocols are typically only useful with a single standard library function or class.
This is a type for objects that support :py:func:`reversed(x) <reversed>`.
def __reversed__(self) -> Iterator[T]See also :py:class:`~typing.Reversible`.
This is a type for objects that support :py:func:`abs(x) <abs>`. T is the type of
value returned by :py:func:`abs(x) <abs>`.
def __abs__(self) -> TSee also :py:class:`~typing.SupportsAbs`.
This is a type for objects that support :py:class:`bytes(x) <bytes>`.
def __bytes__(self) -> bytesSee also :py:class:`~typing.SupportsBytes`.
This is a type for objects that support :py:class:`complex(x) <complex>`. Note that no arithmetic operations are supported.
def __complex__(self) -> complexSee also :py:class:`~typing.SupportsComplex`.
This is a type for objects that support :py:class:`float(x) <float>`. Note that no arithmetic operations are supported.
def __float__(self) -> floatSee also :py:class:`~typing.SupportsFloat`.
This is a type for objects that support :py:class:`int(x) <int>`. Note that no arithmetic operations are supported.
def __int__(self) -> intSee also :py:class:`~typing.SupportsInt`.
This is a type for objects that support :py:func:`round(x) <round>`.
def __round__(self) -> TSee also :py:class:`~typing.SupportsRound`.
These protocols can be useful in async code. See :ref:`async-and-await` for more information.
def __await__(self) -> Generator[Any, None, T]See also :py:class:`~typing.Awaitable`.
def __aiter__(self) -> AsyncIterator[T]See also :py:class:`~typing.AsyncIterable`.
def __anext__(self) -> Awaitable[T]
def __aiter__(self) -> AsyncIterator[T]See also :py:class:`~typing.AsyncIterator`.
There are two protocols for context managers -- one for regular context
managers and one for async ones. These allow defining objects that can
be used in with and async with statements.
def __enter__(self) -> T
def __exit__(self,
exc_type: Optional[Type[BaseException]],
exc_value: Optional[BaseException],
traceback: Optional[TracebackType]) -> Optional[bool]See also :py:class:`~typing.ContextManager`.
def __aenter__(self) -> Awaitable[T]
def __aexit__(self,
exc_type: Optional[Type[BaseException]],
exc_value: Optional[BaseException],
traceback: Optional[TracebackType]) -> Awaitable[Optional[bool]]See also :py:class:`~typing.AsyncContextManager`.
You can define your own protocol class by inheriting the special Protocol
class:
from typing import Iterable
from typing_extensions import Protocol
class SupportsClose(Protocol):
def close(self) -> None:
... # Empty method body (explicit '...')
class Resource: # No SupportsClose base class!
# ... some methods ...
def close(self) -> None:
self.resource.release()
def close_all(items: Iterable[SupportsClose]) -> None:
for item in items:
item.close()
close_all([Resource(), open('some/file')]) # Okay!Resource is a subtype of the SupportsClose protocol since it defines
a compatible close method. Regular file objects returned by :py:func:`open` are
similarly compatible with the protocol, as they support close().
Note
The Protocol base class is provided in the typing_extensions
package for Python 2.7 and 3.4-3.7. Starting with Python 3.8, Protocol
is included in the typing module.
You can also define subprotocols. Existing protocols can be extended and merged using multiple inheritance. Example:
# ... continuing from the previous example
class SupportsRead(Protocol):
def read(self, amount: int) -> bytes: ...
class TaggedReadableResource(SupportsClose, SupportsRead, Protocol):
label: str
class AdvancedResource(Resource):
def __init__(self, label: str) -> None:
self.label = label
def read(self, amount: int) -> bytes:
# some implementation
...
resource: TaggedReadableResource
resource = AdvancedResource('handle with care') # OKNote that inheriting from an existing protocol does not automatically
turn the subclass into a protocol -- it just creates a regular
(non-protocol) class or ABC that implements the given protocol (or
protocols). The Protocol base class must always be explicitly
present if you are defining a protocol:
class NotAProtocol(SupportsClose): # This is NOT a protocol
new_attr: int
class Concrete:
new_attr: int = 0
def close(self) -> None:
...
# Error: nominal subtyping used by default
x: NotAProtocol = Concrete() # Error!You can also include default implementations of methods in protocols. If you explicitly subclass these protocols you can inherit these default implementations. Explicitly including a protocol as a base class is also a way of documenting that your class implements a particular protocol, and it forces mypy to verify that your class implementation is actually compatible with the protocol.
Note
You can use Python 3.6 variable annotations (PEP 526) to declare protocol attributes. On Python 2.7 and earlier Python 3 versions you can use type comments and properties.
Protocols can be recursive (self-referential) and mutually recursive. This is useful for declaring abstract recursive collections such as trees and linked lists:
from typing import TypeVar, Optional
from typing_extensions import Protocol
class TreeLike(Protocol):
value: int
@property
def left(self) -> Optional['TreeLike']: ...
@property
def right(self) -> Optional['TreeLike']: ...
class SimpleTree:
def __init__(self, value: int) -> None:
self.value = value
self.left: Optional['SimpleTree'] = None
self.right: Optional['SimpleTree'] = None
root: TreeLike = SimpleTree(0) # OKYou can use a protocol class with :py:func:`isinstance` if you decorate it
with the @runtime_checkable class decorator. The decorator adds
support for basic runtime structural checks:
from typing_extensions import Protocol, runtime_checkable
@runtime_checkable
class Portable(Protocol):
handles: int
class Mug:
def __init__(self) -> None:
self.handles = 1
mug = Mug()
if isinstance(mug, Portable):
use(mug.handles) # Works statically and at runtime:py:func:`isinstance` also works with the :ref:`predefined protocols <predefined_protocols>` in :py:mod:`typing` such as :py:class:`~typing.Iterable`.
Note
:py:func:`isinstance` with protocols is not completely safe at runtime. For example, signatures of methods are not checked. The runtime implementation only checks that all protocol members are defined.
Protocols can be used to define flexible callback types that are hard (or even impossible) to express using the :py:data:`Callable[...] <typing.Callable>` syntax, such as variadic, overloaded, and complex generic callbacks. They are defined with a special :py:meth:`__call__ <object.__call__>` member:
from typing import Optional, Iterable, List
from typing_extensions import Protocol
class Combiner(Protocol):
def __call__(self, *vals: bytes, maxlen: Optional[int] = None) -> List[bytes]: ...
def batch_proc(data: Iterable[bytes], cb_results: Combiner) -> bytes:
for item in data:
...
def good_cb(*vals: bytes, maxlen: Optional[int] = None) -> List[bytes]:
...
def bad_cb(*vals: bytes, maxitems: Optional[int]) -> List[bytes]:
...
batch_proc([], good_cb) # OK
batch_proc([], bad_cb) # Error! Argument 2 has incompatible type because of
# different name and kind in the callbackCallback protocols and :py:data:`~typing.Callable` types can be used interchangeably. Keyword argument names in :py:meth:`__call__ <object.__call__>` methods must be identical, unless a double underscore prefix is used. For example:
from typing import Callable, TypeVar
from typing_extensions import Protocol
T = TypeVar('T')
class Copy(Protocol):
def __call__(self, __origin: T) -> T: ...
copy_a: Callable[[T], T]
copy_b: Copy
copy_a = copy_b # OK
copy_b = copy_a # Also OK