guy with low end hardware learning about llm's and learning about finetuning
my hardware:
intel xeon E5v4
32gb ddr4 ram
amd rx 5700 8gb vram (Hf allows to set from 6600 lol)
512gb ssd
queueing models for mradermacher
contact:
dc: simonko_11015
github: Simonko-912
- Complete modern UI redesign - Adds support for Qwen3.5 0.8B, LFM2.5 230M,350M, SmolLM2 360M, Gemma 3 270M. - Adds Q7,Q6,Q5,Q3,Q1 quantization formats with a easy to use precision slider - And more!
The new UI includes: - New 1024×768 High Quality interface. - Photographic QOI background. - Transparent BananaMind, CPU, cube, mouse, and Send icons. - Proper bitmap cursor. - Rounded translucent panels and cards. - Modern model-loading progress window. - Redesigned inference screen with response and prompt panels. - Localized redraws for the cursor, clicks, loading progress, and precision slider.
Notice: Qwen3.5 0.8B currently generates garbled text, it will be fixed tomorrow.
Im making a iso of all the listed models on github, q6, q8, q4 and the extra 16 and 32 bit. Excited for my multitool usb. also made a suggdestion on github to add support for small diffusion models (could work on 2000's pcs)