Software infrastructure that wraps around a LLM, handling everything but the model itself.