AIPython★ 1,745⑂ 166 forksApache-2.0
StartLuxLabs/StartLux-Decision
STARTLUX‑DECISION: AI DECISIONS
Open decision models from 0.8B to 27B give calibrated probability for each option in one pass and a short thought only when unsure. They serve as the available inference engine for vLLM, llama.cpp and MLX.
// KEY FEATURES
- Calibrated probability for each option in a single pass.
- A short reasoning step only when the model is unsure.
- Supports inference via vLLM, llama.cpp and MLX.
- Covers models from 0.8B to 27B parameters.
#agents#calibration#classification#decision-making#gguf#inference#llama-cpp#llm#mlx#open-weights#reasoning#vllm
Open on GitHub →New repositories every 30 minutes
REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.
Join on Telegram