App Description

LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters. # Features * Various inferences * Various sampling methods * Metal * Model setting templates # Inferences * LLaMA * GPTNeoX * Replit * GPT2 + Cerebras * Starcoder(Santacoder) * RWKV * Falcon * MPT * Bloom * StableLM-3b-4e1t * Qwen * Gemma * Phi * Mamba * Others # Multimodal * LLaVA 1.5 models * Obsidian * Bunny * MobileVLM 1.7B/3B models Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings. Sampling methods * Temperature (temp, tok-k, top-p) * Locally Typical Sampling * Mirostat * Greedy * Grammar