Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem.

Describe the solution you'd like
Add documentation on serving batch predictions.

Describe alternatives you've considered
N/A

Additional context
CC @terrytangyuan