gianlucamazza/SmolLM2-360M-Instruct-ort-genai-int4-cpu
Text Generation • Updated
Gianluca Mazza PRO
gianlucamazza
AI & ML interests
LLM systems in production, agent state and recovery, evaluation, inference cost
Recent Activity
posted an update about 11 hours ago
My public work on the Hub: the emotional-memory demo and benchmark dataset, the mklang playground, the affective-fly demo, and an int4 ONNX Runtime GenAI copy of SmolLM2-360M-Instruct. Each card states what it is for and where it stops working. The SmolLM2 copy is experimental, with no quality evaluation.
https://huggingface.co/collections/gianlucamazza/agent-memory-affect-mklang-and-local-inference commentedon their article about 13 hours ago
RAGFS: a filesystem interface for agents, and the query JSON I keep as a retrieval receipt posted an update 3 days ago
Upstream models my open-source projects run or my articles discuss. Each note says which it is. thenlper/gte-small is real use: RAGFS embeds file chunks with it locally. The two retrieval models from my RAG article, a cross-encoder re-ranker and a bi-encoder, are examples, labelled as such, not claims of production use.
https://huggingface.co/collections/gianlucamazza/models-used-in-my-projects-6aca0b3201f38f4c264ac9bfOrganizations
