The Python API of TensorRT-LLM is architectured to look similar to the

[PyTorch](https://pytorch.org) API. It provides users with a

[functional](./tensorrt_llm/functional.py) module containing functions like

module bundles useful building blocks to assemble LLMs; like an `Attention`

block, a `MLP` or the entire `Transformer` layer. Model-specific components,

like `GPTAttention` or `BertAttention`, can be found in the

TensorRT-LLM comes with several popular models pre-defined. They can easily be

modified and extended to fit custom needs. See below for a list of supported