microsoft/unilm

UniLM is a large-scale self-supervised pretrained model covering tasks, languages, and modalities. It supports BEiT, BEiT-3, BitNet, DeepNet, and Document AI, written in Python and having garnered over 22k stars on GitHub.

// KEY FEATURES

• Performs self-supervised pretraining simultaneously on text, image, and audio.
• Supports BEiT and BEiT-3 architectures for vision and language tasks.
• Implements efficient BitNet and DeepNet for low-dimensional vector representations.
• Provides ready-to-use tools for Document AI and foundation models in Python.

New repositories every 30 minutes

REDDYX AI scans GitHub 24/7 and ships the best AI/ML/Web3 projects to Telegram.