Stupid performance, and admirable patience, congrats on #1 (for now)...
๐ฌ GPT-X3 when????
Dan P
Datdanboi25
AI & ML interests
Axiomic Labs Founder
Mechatronics engineer, LLMs, Vision Models, Embedding Models
Recent Activity
reacted to KlondikeDev's post with โค๏ธ about 7 hours ago
BORIS-2 IS OUT!
https://huggingface.co/opencerebral/Boris-2
It tops the AxiomicLabs Intelligence Index with a score of 34.15!
reacted to KlondikeDev's post with ๐ฅ about 7 hours ago
BORIS-2 IS OUT!
https://huggingface.co/opencerebral/Boris-2
It tops the AxiomicLabs Intelligence Index with a score of 34.15!
Organizations
replied to KlondikeDev's post about 5 hours ago
reacted to KlondikeDev's post with โค๏ธ๐ฅ about 7 hours ago
Post
183
BORIS-2 IS OUT!
opencerebral/Boris-2
It tops the AxiomicLabs Intelligence Index with a score of 34.15!
opencerebral/Boris-2
It tops the AxiomicLabs Intelligence Index with a score of 34.15!
reacted to Banaxi-Tech's post with ๐ฅ 2 days ago
replied to Banaxi-Tech's post 3 days ago
@Datdanboi25 Factbase DCLM!
Mentioned!!!
reacted to Banaxi-Tech's post with โค๏ธ๐ฅ 7 days ago
Post
4,904
We're excited to release BananaMind 2.5 Pro.
It's done some post-training on our BananaMind 2 Pro base, via distillation of SmolLM2 360M.
It scores 28.98 INT INDEX compared to 24.96 of BananaMind 2 Pro on the AxiomicLabs/Open_SLM_Leaderboard
Check it out at BananaMind/BananaMind-2.5-Pro
BananaMind
@ArushCodes
@Bc-AI
It's done some post-training on our BananaMind 2 Pro base, via distillation of SmolLM2 360M.
It scores 28.98 INT INDEX compared to 24.96 of BananaMind 2 Pro on the AxiomicLabs/Open_SLM_Leaderboard
Check it out at BananaMind/BananaMind-2.5-Pro
@ArushCodes
@Bc-AI
reacted to appvoid's post with โค๏ธ 11 days ago
Post
7,611
New leaderboard coming to the small language model community!
The leaderboard measures cognitive skills, which is more challenging and beyond language modeling and instruction-following. This is a first step towards more everyday useful and general small models.
dotlabs/cognirank
The leaderboard measures cognitive skills, which is more challenging and beyond language modeling and instruction-following. This is a first step towards more everyday useful and general small models.
dotlabs/cognirank
replied to Banaxi-Tech's post 21 days ago
Head up bro, Excited for BM3!
reacted to appvoid's post with ๐ฅ 22 days ago
Post
4,015
You know, I can't believe we are actually doing it, literally advancing the frontier at the edge! We've come a long way since the first models on open slm leaderboard, and, as many things that change, performance is one of the main things that has exploded.
7 years ago, the best we had was GPT-2. Today, we got 90m models beating smollm2! I can't barely see what a future with increasingly powerful small models will look like.
All I can say is that the best is yet to come. And will be agentic.
7 years ago, the best we had was GPT-2. Today, we got 90m models beating smollm2! I can't barely see what a future with increasingly powerful small models will look like.
All I can say is that the best is yet to come. And will be agentic.
reacted to DedeProGames's post with ๐ฅ about 1 month ago
Post
3,468
Meet Supra2.5-Ultra-Preview-001. 230M parameters, ~40.4B training tokens.
SupraLabs has released the first preview of its Supra2.5-Ultra family: a compact, Llama-style base model for text completion and small-model experimentation.
What's inside?
โข 230M parameters
โข 32 transformer layers
โข 2,048-token context window
โข Grouped Query Attention: 12 attention heads, 4 KV heads
โข 49,152-token vocabulary
โข SwiGLU activation, RoPE and tied embeddings
โข BF16 weights and Hugging Face Transformers support
โข Apache 2.0 license
Training
The model was trained on approximately 40.4B tokens from FineWeb-Edu, DCLM-Baseline and FineMath using a single A100 SXM.
Reported zero-shot results
โข HellaSwag: 37.18% normalized accuracy
โข PIQA: 65.78% accuracy
โข ARC-Easy: 57.11% accuracy
โข ARC-Challenge: 26.28% normalized accuracy
Want to experiment?
Code on REPO.
Model, weights and usage example:
SupraLabs/Supra2.5-Ultra-Preview-001
SupraLabs has released the first preview of its Supra2.5-Ultra family: a compact, Llama-style base model for text completion and small-model experimentation.
What's inside?
โข 230M parameters
โข 32 transformer layers
โข 2,048-token context window
โข Grouped Query Attention: 12 attention heads, 4 KV heads
โข 49,152-token vocabulary
โข SwiGLU activation, RoPE and tied embeddings
โข BF16 weights and Hugging Face Transformers support
โข Apache 2.0 license
Training
The model was trained on approximately 40.4B tokens from FineWeb-Edu, DCLM-Baseline and FineMath using a single A100 SXM.
Reported zero-shot results
โข HellaSwag: 37.18% normalized accuracy
โข PIQA: 65.78% accuracy
โข ARC-Easy: 57.11% accuracy
โข ARC-Challenge: 26.28% normalized accuracy
Want to experiment?
Code on REPO.
Model, weights and usage example:
SupraLabs/Supra2.5-Ultra-Preview-001
replied to Banaxi-Tech's post about 1 month ago
Head up bro, hyped for BM3!!!
reacted to Banaxi-Tech's post with ๐ about 1 month ago
Haha I wanna see them sooner
1:Individually Definitely!
3:a 150m!!!
replied to Banaxi-Tech's post about 1 month ago
Bro... I am sorry to break it down to you, but this is mathematically impossible, bcs your context itself eats up all the parameters. you end up with negative parameters (which is absolutely NOT a thing)๐ญ
Your model is your embedding space.Anyways... good luck with whatever you are doing, man. research is research at the end of the day.
What is bro talm bout
replied to Banaxi-Tech's post about 1 month ago
Hyped for BananaMind3!!!
reacted to Banaxi-Tech's post with ๐ฅ about 1 month ago
Post
4,702
Well GPT X3 takes the lead. As of right now.
We are now announcing BananaMind 3 ๐! (not ai for those emoji guys)
All models will use BGA (which is almost just NSA) and our BM3X architecture.
Its sizes will be:
BananaMind 3 Flash Lite, 3M parameters at a context of 8K context.
BananaMind 3 Lite, 10M parameters with 16K context.
BananaMind 3 Flash, 25M Parameters with 16K context.
BananaMind 3 Pro, 50M parameters with 24K context.
BananaMind 3 Ultra, 100M parameters with 32K context.
And lastly, BananaMind 3 Max with 150M parameters and 64K CONTEXT.
I can assure you BananaMind 3 Max WILL beat GPT X3 or match it, we won't release it otherwise. We hope for a 40+ INTELLIGENCE INDEX!
BananaMind 3 may also be partnered with dot labs.
We will cancel BananaMind 2.1 and BananaMind 2 Ultra.
As of the BETU SLM Leaderboard we may need to release it after October 11, im very busy right now (even though we said We will release BETU leaderboard before Oct 11 ๐)
We are now announcing BananaMind 3 ๐! (not ai for those emoji guys)
All models will use BGA (which is almost just NSA) and our BM3X architecture.
Its sizes will be:
BananaMind 3 Flash Lite, 3M parameters at a context of 8K context.
BananaMind 3 Lite, 10M parameters with 16K context.
BananaMind 3 Flash, 25M Parameters with 16K context.
BananaMind 3 Pro, 50M parameters with 24K context.
BananaMind 3 Ultra, 100M parameters with 32K context.
And lastly, BananaMind 3 Max with 150M parameters and 64K CONTEXT.
I can assure you BananaMind 3 Max WILL beat GPT X3 or match it, we won't release it otherwise. We hope for a 40+ INTELLIGENCE INDEX!
BananaMind 3 may also be partnered with dot labs.
We will cancel BananaMind 2.1 and BananaMind 2 Ultra.
As of the BETU SLM Leaderboard we may need to release it after October 11, im very busy right now (even though we said We will release BETU leaderboard before Oct 11 ๐)
reacted to raincandy-u's post with ๐ฅ about 1 month ago
Post
3,882
20K parameters can tell a story. ๐
๐ค We trained a ~20k-parameter Transformer that can actually write stories!
raincandy-u/MacroStories
โ ~50ร smaller than the 1M-parameter TinyStories model
โ ~3,000ร smaller than AlexNet
โ 81 KB in FP32
yayyy the whole model. เซฎ หถแต แต แตหถ แ
She has a 32-dimensional hidden state, a 378-token vocabulary, and just one decoder block โ recurrently applied 4 times with shared weights.
Despite having only 19,969 parameters, she can maintain a simple narrative across 100โ300 words: establish a goal, encounter a problem, take relevant actions, and reach an outcome.
She runs extremely fast on CPU โ no GPU required. The entire model is tiny enough to load almost instantly! โบ๏ธ
๐ค We trained a ~20k-parameter Transformer that can actually write stories!
raincandy-u/MacroStories
โ ~50ร smaller than the 1M-parameter TinyStories model
โ ~3,000ร smaller than AlexNet
โ 81 KB in FP32
yayyy the whole model. เซฎ หถแต แต แตหถ แ
She has a 32-dimensional hidden state, a 378-token vocabulary, and just one decoder block โ recurrently applied 4 times with shared weights.
Despite having only 19,969 parameters, she can maintain a simple narrative across 100โ300 words: establish a goal, encounter a problem, take relevant actions, and reach an outcome.
She runs extremely fast on CPU โ no GPU required. The entire model is tiny enough to load almost instantly! โบ๏ธ