ELELEM-CANDLE(7)

Name

elelem-candle — Rust in-process. Inference not yet

Synopsis

git clone https://git.mokhan.ca/elelem/candle.git
elelem chat -p candle [--model name]

Description

A skeleton provider that calls Rust from Ruby through rb_sys and magnus. The FFI and token streaming work; the model is a stub that echoes your prompt.

Full documentation: elelem-candle.

Environment

ELELEM_CANDLE_MODEL: Required. A model path or Hugging Face repo ID. Recorded and echoed back; nothing is loaded yet.
ELELEM_CANDLE_DEVICE (default cpu): Device name. Recorded and echoed back; not used yet.

Requirements

Ruby 4.0 or later. A Rust toolchain (cargo and rustc). A C toolchain and clang/libclang (for rb_sys’s bindgen step).

Status

Lab: an experiment in how inference works. Read it to learn. Source only; not published to RubyGems. History: commits.

Bugs

Known issues: plugin:candle. Patches are welcome by email; see git-send-email.io.