req_llm

Adoption judgment: req_llm is worth considering for Elixir teams that need a code-level way to connect LLM providers, invoke tools, and request structured output. The available evidence supports trying it in a focused integration, but not treating it as mature, universal infrastructure solely because it is receiving attention. The GitHub repository describes it as a composable Elixir library built on Req and Finch.

In practice, it is intended to put model requests and related capabilities inside an Elixir application, including provider abstraction, tool use, and JSON Schema handling. A community post announces a Livebook demo covering tool use, JSON Schema, and Zoi integration. One user reports that it does a good job abstracting LLM providers in an Elixir product, while another hands-on report says the project is very new and still has rough edges. These examples support the usefulness of the direction and some demonstrated workflows, but do not establish that every provider, failure mode, or production concern is equally mature.

The main threshold is an existing Elixir codebase plus familiarity with Req, Finch, provider credentials, tool definitions, and schemas.