pre-training repositories

Trending repositories tagged pre-training, ranked by trending score. Updated daily.

  1. 1
    datamllab/OpenEBFM

    Open-source code for training and scaling up energy-based foundation models.

    GitHub · Python · 399 stars · 29 forks · +269 stars in 24 hours · Trending score 4.23

  2. 2
    datajuicer/data-juicer

    Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

    GitHub · Python · 7,266 stars · 457 forks · +14 stars in 24 hours · Trending score 2.17

  3. 3
    ystemsrx/mini-nanoGPT

    One-click training of your own GPT. Training a GPT has never been easier for beginners. / 一键预训练+SFT一个属于自己的LLM,0基础训练GPT原来可以这么简单?

    GitHub · Python · 388 stars · 54 forks · +5 stars in 24 hours · Trending score 1.17

  4. 4
    EgoAlpha/prompt-in-context-learning

    Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.

    GitHub · Jupyter Notebook · 2,251 stars · 193 forks · −1 stars in 24 hours · Trending score 0.19

  5. 5
    sileod/reasoning-core

    Procedural data generators for verifiable reasoning, synthetic pretraining, post-training, evaluation, and RL.

    GitHub · Python · 53 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00

  6. 6
    Event-AHU/Medical_Image_Analysis

    Foundation models based medical image analysis

    GitHub · Python · 243 stars · 18 forks · 0 stars in 24 hours · Trending score 0.00