Skip to content

llama.LLM.__init__

Class that instantiates the LLM engine.

LLM(name, model_name, config)

Attributes

  • name: str - name of the LLM engine instance
  • model_name: str (Optional) - name of the base model, defaults to OpenAI's text-davinci-003.
  • config: dict (Optional) - auth-related parameters, e.g. token

Example

llm = LLM(name="my_llm_name")

# With optional parameters
llm = LLM(
        name="my_llm_name",
        model_name="chat-gpt",
        config={"token": "my_token"}
      )