Léon Simmons
Avicennasis
AI & ML interests
None yet
Recent Activity
updated a model 10 days ago
Avicennasis/GEV-26B-Decide-mlx-8bit-system2 published a model 10 days ago
Avicennasis/GEV-26B-Decide-mlx-8bit-system2Organizations
MLX port for Apple silicon (System 1): Avicennasis/GEV-26B-Decide-mlx-8bit / -4bit
👍 3
9
#1 opened 27 days ago
by
Avicennasis
Fix: add the missing @capture_outputs decorator (output_hidden_states is None) Fixes the issue reported in discussion #6. `K2HorizonModel.forward` carries `@auto_docstring` but not `@capture_outputs`, so `output_hidden_states=True` returns `None` (any tool that reads the residual stream per layer fails). Adding the decorator plus the import makes `outputs.hidden_states` a tuple of len `num_hidden_layers + 1`; greedy decoding is unchanged. Verified on 0.9B: 29 states (28 layers + 1), `[0]` == embeddings and `[-1]` == `last_hidden_state`; generation byte-identical with and without the decorator. The change is the same for every full-model repo in the family (the file is byte-identical across sizes).
1
#5 opened 30 days ago
by
Avicennasis
Fix: add the missing @capture_outputs decorator (output_hidden_states is None) Fixes the issue reported in discussion #6. `K2HorizonModel.forward` carries `@auto_docstring` but not `@capture_outputs`, so `output_hidden_states=True` returns `None` (any tool that reads the residual stream per layer fails). Adding the decorator plus the import makes `outputs.hidden_states` a tuple of len `num_hidden_layers + 1`; greedy decoding is unchanged. Verified on 0.9B: 29 states (28 layers + 1), `[0]` == embeddings and `[-1]` == `last_hidden_state`; generation byte-identical with and without the decorator. The change is the same for every full-model repo in the family (the file is byte-identical across sizes).
#6 opened 30 days ago
by
Avicennasis
Fix: add the missing @capture_outputs decorator (output_hidden_states is None) Fixes the issue reported in discussion #6. `K2HorizonModel.forward` carries `@auto_docstring` but not `@capture_outputs`, so `output_hidden_states=True` returns `None` (any tool that reads the residual stream per layer fails). Adding the decorator plus the import makes `outputs.hidden_states` a tuple of len `num_hidden_layers + 1`; greedy decoding is unchanged. Verified on 0.9B: 29 states (28 layers + 1), `[0]` == embeddings and `[-1]` == `last_hidden_state`; generation byte-identical with and without the decorator. The change is the same for every full-model repo in the family (the file is byte-identical across sizes).
#9 opened 30 days ago
by
Avicennasis
[superseded by #8 - opened as a discussion by mistake] Fix output_hidden_states / attentions returning None
1
#7 opened about 1 month ago
by
Avicennasis
Fix `output_hidden_states` / `attentions` returning None (missing `@capture_outputs`)
#8 opened about 1 month ago
by
Avicennasis