amathislab/BehaviorCosmos-Mistral-7B

BehaviorCosmos Mistral 7B Models

Mistral-7B-v0.1_html_v1/

Model for named entity recognition of behavior entities for zebrafish, trained and evaluated on the gold dataset, version 1

F1 score: 0.701 (on gold dataset)

Mistral-7B-v0.1_html_v2/

Model for named entity recognition of behavior entities for zebrafish, trained and evaluated on the gold dataset, version 2 (for reproducibility)

F1 score: 0.699 (on gold dataset)

Mistral-7B-v0.1_html_v3/

Model for named entity recognition of behavior entities for zebrafish, trained and evaluated on the gold dataset, version 3 (for reproducibility)

F1 score: 0.703 (on gold dataset)

Mistral-7B-v0.1_html_v4/

Model for named entity recognition of behavior entities for zebrafish, trained and evaluated on the gold dataset, version 4 (for reproducibility)

F1 score: 0.696 (on gold dataset)

Mistral-7B-v0.1_zfbehavior_s-0_none_c-none/

Best model for named entity recognition of behavior entities for zebrafish

F1 score: 0.601 (on Paula original dataset)

Mistral-7B-v0.1_mclocation_lr3e-5_minlr1e-6_100-epochs/

Best model for named entity recognition of location entities for mice

F1 score: 0.0 (on original dataset)

Mistral-7B-v0.1_mcstimulus_lr3e-5_minlr1e-6_100-epochs/

Best model for named entity recognition of stimulus entities for mice

F1 score: 0.0 (on original dataset)

Mistral-7B-v0.1_mcgenotype_lr3e-5_minlr1e-6_100-epochs/

Best model for named entity recognition of genotype entities for mice

F1 score: 0.762 (on original dataset)

Mistral-7B-v0.1_mcbehavior_lr3e-5_minlr1e-6_100-epochs/

Best model for named entity recognition of behavior entities for mice

F1 score: 0.273 (on original dataset)

Mistral-7B-v0.1_zflocation_lr3e-5_minlr1e-6_ep100_100-epochs/

Best model for named entity recognition of location entities for zebrafish

F1 score: 0.375 (on Paula original dataset)

Mistral-7B-v0.1_zfstimulus_lr3e-5_minlr1e-6_ep100_100-epochs/

Best model for named entity recognition of stimulus entities for zebrafish

F1 score: 0.33 (on Paula original dataset)

Mistral-7B-v0.1_zfgenotype_lr3e-5_minlr1e-6_100-epochs/

Best model for named entity recognition of genotype entities for zebrafish

F1 score: 0.491 (on Paula original dataset)

Mistral-7B-v0.1_zfbehavior_lr3e-5_minlr1e-6_100-epochs/

Model for named entity recognition of behavior entities for zebrafish, same training parameters as for the other 3 entity types, however not the best model for the behavior entity type

F1 score: 0.459 (on Paula original dataset)