Just realized what's probably the best way to do this:

Every Graphic sets world_object.position after init based on a position kwarg (probably expose position as a user settable attribute, maybe start making worldobject itself private).
In LineStack, as we iterate through adding each Line, we set position.y as the previous position.y + data[:, 1].max() + separation_height