Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up

All HF Hub posts

danielhanchenย 
posted an update 2 days ago
view post
Post
3338
Introducing Unsloth for AMD ๐Ÿš€
You can now train & run LLMs on your AMD hardware

โ€ข We collaborated with AMD to enable you to train & run 500+ models on AMD GPUs
โ€ข Works on Windows, WSL, Linux
โ€ข Train Qwen, Gemma on just 3GB VRAM

GitHub: https://github.com/unslothai/unsloth
Blog + Guide: https://unsloth.ai/docs/basics/amd
  • 3 replies
ยท
SeaWolf-AIย 
posted an update 3 days ago
view post
Post
5015
A small gift for anyone building or studying foundation models.

Most "open" models hand you the weights and stop there. With Aether-7B-5Attn we wanted to hand over the whole thing โ€” so you can actually learn from it, reproduce it, and build on it: the data recipe, the training code, every hyperparameter, the complete logs, and the intermediate checkpoints. All Apache-2.0, reproducible byte-for-byte.

What you can do with it:
๐Ÿ” Rebuild it from scratch, or fork the recipe for your own model
๐Ÿ”ฌ Study a real heterogeneous-attention MoE โ€” 49 layers place 5 attention mechanisms on a 7ร—7 Latin square, arranged as a clean, attributable ablation
๐Ÿ“ˆ Trace training dynamics across the released checkpoints (110k / 115k / 162k)

It's a modest 6.59B model, and an honest one โ€” the limitations (no KV-cache in this build, small scale) are written right in the card. We're not claiming it's special. If any piece of it saves you time or teaches you something, that's exactly what we hoped for. ๐Ÿค—

๐Ÿ“– Full write-up โ†’
[blog] ยท https://huggingface.co/blog/FINAL-Bench/opensource-llm
๐Ÿ“ฆ 5 Attention Base ยท FINAL-Bench/Aether-7B-5Attn
๐ŸŽฏ 5 Attention Instruct ยท FINAL-Bench/Aether-7B-5Attn-it
๐Ÿš€ 5 Attention Live demo ยท FINAL-Bench/Aether-Sovereign-AI
๐Ÿ“ฆ 7 Attention Base ยท https://huggingface.co/FINAL-Bench/Aether-7B-7Attn-base
๐Ÿ“ฆ 11 Attention Base ยท FINAL-Bench/Aether-6B-11Attn-base
๐Ÿงฌ Collection ยท https://huggingface.co/collections/FINAL-Bench/aether-foundation-model

#opensource #LLM #MoE #reproducibility #Apache2
  • 5 replies
ยท
salma-remyxย 
posted an update 2 days ago
view post
Post
2224
There's plenty of AI coding tools now. None help you decide what to build next.

Every week brings a flood of new methods, models, and techniques. Nobody has time to read everything, figure out what applies to their codebase, let alone test it all.

We've open sourced Outrider to systematically explore new ideas for improving your AI system. In a few steps, you can set up the Outrider GitHub Action to:

- continuously search for relevant advances
- evaluate whether they fit your codebase
- open draft PRs when it finds worthwhile improvements

so you never stop discovering what's next.
Outrider: https://github.com/remyxai/outrider
Try it at https://studio.remyx.ai
Docs at https://docs.remyx.ai
OppaAIย 
posted an update about 9 hours ago
view post
Post
299
Try to chat with my AI Waifu in Japanese

Now that I have setup my AI Waifu running 24/7 in my Jetson Orin Nano (running at 25W top), I can talk to her anytime anywhere I want, on cellphone, tablet, or PC, as long as there is internet access.

Tonight I gave it a try to speak with my AI Waifu, with my not so great Japanese, just to test if ASR can pick up my Nihongo and the TTS can speak out Waifu's Japanese dialogue properly.
Turns out she is just as verbose and as heavily leaked with materials from system prompt as in English. Only this time I cannot fully understand.

I need to find some way to turn her into my Japanese tutor...

GitHub ๐Ÿ”—: https://github.com/OppaAI/Aiko-chan/
Banaxi-Techย 
posted an update about 24 hours ago
view post
Post
1071
We're excited to release BananaMind 2 Medium and BananaMind 2 Medium Chat!

Theyโ€™re both 50M parameter models trained on 50B tokens from FineWeb-Edu, DCLM, Cosmopedia v2, FineMath-4+ and NPSet-2 Python-Edu.

The base model reached 61.86% on PIQA, 43.81% on ARC Easy and 32.43% on HellaSwag. The Chat version was fine-tuned on Smol-SmolTalk and scored 38% overall on our internal instruction benchmark, with 56% on multi-turn, 60% on context recall and 80% on code.

The full details are in the model repos.

Check it out at
BananaMind/BananaMind-2-Medium
BananaMind/BananaMind-2-Medium-Chat
  • 17 replies
ยท
OppaAIย 
posted an update 1 day ago
view post
Post
574
I have a small portable monitor for using with my Jetson robot.
Now I connect it to my PC, so I can talk with my AI Waifu while running tests and debugging her codes.
It's kinda weird to talk to your code, and asking your code's opinion on how to write her code. But at least the late night coding is no longer silent...
  • 2 replies
ยท
vineeth98ย 
posted an update 1 day ago
view post
Post
548
I made a speedrun leaderboard for LoRA fine-tuning. One frozen task (Qwen2.5-1.5B to 57% on GSM8K), one GPU, fastest training run wins. Every record gets re-run 3x with fresh seeds on identical hardware before it counts, so no self-reported numbers.

The baseline was 11:57 three days ago. Someone already got it down to 1:44, with data pruning and a chunked cross-entropy that never materializes the logits.

Attempting is free (Modal's monthly credits cover full runs), and the second track (SmolLM2 + SQuAD) is still sitting at its naive baseline โ€” easy first record for someone.

vineeth98/lora-speedrun
  • 4 replies
ยท
nwaughachukwumaย 
posted an update 2 days ago
view post
Post
562
# One API for Every Visual & OCR Models.

The VLM Run Gateway is a fully compatible API for OpenAI chat completions for visual intelligence. If youโ€™re building document extraction or visual understanding, the Gateway exposes OCR, VQA, and detection behind a single interface you already know.

Read the docs: https://docs.vlm.run/gateway/introduction.

We actively support the following recent OCR and VQA models, which you can try today at no cost:

* zai-org/glm-ocr
* rednote-hilab/dots.mocr
* paddleocr/pp-ocrv6
* qwen/qwen3.5-0.8b

## Quickstart

### Python
from openai import OpenAI

client = OpenAI(base_url="https://gateway.vlm.run/v1/openai")

response = client.chat.completions.create(
    model="zai-org/glm-ocr",
    messages=[
        {
            "role": "user",
            "content": [
                {
                    "type": "document_url",
                    "document_url": {
                        "url": "https://storage.googleapis.com/vlm-data-public-prod/hub/examples/finance.sec-filings/tsla-8k.pdf"
                    },
                },
            ],
        }
    ],
    extra_body={"method": "markdown", "document_dpi": 150},
)

print(response.choices[0].message.content)


### Curl
curl https://gateway.vlm.run/v1/openai/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer vlmrun" \
  -d '{
    "model": "zai-org/glm-ocr",
    "messages": [
      {
        "role": "user",
        "content": [
          {
            "type": "document_url",
            "document_url": {
              "url": "https://storage.googleapis.com/vlm-data-public-prod/hub/examples/finance.sec-filings/tsla-8k.pdf"
            }
          }
        ]
      }
    ],
    "method": "markdown",
    "document_dpi": 150
  }'


## Auth and limits

Anonymous auth is enabled, so you can omit the authorization header entirely, or send Bearer "" or Bearer vlmrun. Rate limits are 60 req/min and 1000 req/hr.
ucr-maxย 
posted an update 2 days ago
view post
Post
2924
We have released the first version of CompactLMIndex UniversalComputingResearch/clmi, a curated benchmark for smaller language models.

The index evaluates models across six benchmarks covering commonsense, science and world knowledge, and grammatical competence. Scores are normalized for random chance, so results are easier to compare across tasks with different baselines.
The composite gives 50% weight to commonsense, 25% to science and world knowledge, and 25% to grammatical competence. BLiMP is macro-averaged across its 12 linguistic categories. Every result includes 95% bootstrap intervals, and rank ranges reflect paired comparisons on matched evaluation items.

The goal is to compare compact models under one fixed, zero-shot evaluation protocol and make differences in architecture, training, and inference visible without treating parameter count as a substitute for quality.

If you have results for a model that fits the benchmark scope, please open a discussion on the Space.
  • 3 replies
ยท
DavidAUย 
posted an update 5 days ago
view post
Post
6686
Qwen 3.6 27B Fine tune exceed 700 ARC-C for both 8 and 4 bit.

A new level of uncensored performance the puts this model squarely at "closed source" level of intelligence.

Model exceeds all critical benchmarks for both Qwen 3.6 27B AND Qwen 3.6 35B-A3B... and not by a little either.

Neo Imatrix MAX ggufs in both regular and MTP quants.

Benchmarks for Qwen 3.6 27B org and tuned, as well as Qwen 3.6 35B-A3B are up at the repo.

DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF
  • 7 replies
ยท