Project directory

Projects

Open-source AI projects tracked by the leaderboard, ordered by GitHub stars.

Jupyter Notebook 684 stars

mikonvergence/DiffusionFastForward

DiffusionFastForward: a free course and experimental framework for diffusion-based generative models

### Overview: DiffusionFastForward is a free course and experimental framework designed to help developers understand and research diffusion-based generative models. It offers a general template for training diffusion models on new types of data, making it accessible for both beginners and advanced users. ### Key features: - **PyTorch Lightning** for easy training. - **Google Colab** for running all experiments online without the need for a GPU. - **Examples** for both low-resolution and high-resolution data. - **Latent diffusion** examples. - **Image translation** with diffusion. ### Tech stack: Python with PyTorch Lightning and PyTorch. ### Why it matters: This framework simplifies the process of training diffusion models, making it easier for developers to explore and potentially improve upon existing generative models.
Python 683 stars

ayumiymk/aster.pytorch

ASTER in Pytorch

Overview: This repository implements the ASTER (Attentional Scene Text Recognizer with Flexible Rectification) in PyTorch, featuring an accurate scene text recognizer with a flexible rectification mechanism. Key features: - Flexible rectification mechanism - Accurate scene text recognition - Pretrained model available for download Tech stack: PyTorch Why it matters: The repository provides a practical implementation of ASTER, enabling researchers and developers to easily integrate and evaluate the model for various text recognition tasks. Repository: ayumiymk/aster.pytorch Primary language: Python GitHub stars: 683
TypeScript 683 stars

corespeed-io/wechatbot

微信 iLink Bot SDK for OpenClaw/AI Agent

Overview: 微信 iLink Bot SDK for OpenClaw/AI Agent,提供模块化、生产级、多语言的微信 iLink Bot SDK。 Key features: - Node.js - Python - Go - Rust - 📦 自动扫码登录 - 📨 长轮询消息 - 💬 富媒体支持 - 🔗 context_token - 🏹 会话恢复 - 📝 智能分片 Tech stack: TypeScript Why it matters: 为OpenClaw/AI Agent提供便捷的微信接入解决方案,简化开发流程,提高用户体验。 Repository: corespeed-io/wechatbot GitHub stars: 682 GitHub description: 微信 iLink Bot SDK for OpenClaw/AI Agent
Python 683 stars

gretelai/gretel-synthetics

Synthetic data generators for structured and unstructured text, featuring differentially private learning.

Overview: Gretel Synthetics is a synthetic data library designed for structured and unstructured text, offering differentially private learning capabilities. Key features: - Differentially Private Learning - Structured Text Generation - Unstructured Text Generation Tech stack: Python Why it matters: Gretel Synthetics provides a powerful tool for generating synthetic data, ensuring privacy and security in data-driven applications.
Python 683 stars

leblancfg/autocrop

📸 Automatically detects and crops faces from batches of pictures.

### Overview: Autocrop is a Python library designed to automatically detect and crop faces from batches of images. It's perfect for processing profile pictures or ID cards, ensuring that the biggest face is centered in the image. ### Key Features: - Detects faces in batches of images. - Automatically crops the faces to the largest possible area. - Outputs images centered around the biggest face detected. - Compatible with Python and the command line. - Supports both CLI and Python API. - Version 2.0.0 introduces changes to the CLI interface and requires Python 3.10+, OpenCV 4.8+, and Pillow 12.3.0+. ### Tech Stack: Python ### Why It Matters: Autocrop simplifies the process of cropping faces in images, making it easier to create professional-looking profile pictures or ID cards. It's particularly useful for batch processing, ensuring consistent results across multiple images.
Jupyter Notebook 683 stars

medspacy/medspacy

Library for clinical NLP with spaCy.

### Overview MedSpaCy is a library designed for clinical Natural Language Processing (NLP) tasks using the popular spaCy framework. It provides a modular and flexible solution for processing clinical text, including sentence segmentation, entity extraction, and section detection. ### Key Features - **Sentence Segmentation**: Automatically splits clinical text into sentences. - **Entity Extraction**: Extracts concepts from clinical text using the ConText algorithm. - **Section Detection**: Detects and segments clinical sections. - **Database Integration**: Converts processed texts into structured data for interaction with databases. - **Visualization Tools**: Provides utilities for visualizing extracted concepts and relationships. - **UMLS Extraction**: Compatible with the Unified Medical Language System (UMLS) for extracting concepts. ### Tech Stack The library is built using Python and the spaCy framework. ### Why It Matters MedSpaCy simplifies the process of performing clinical NLP tasks by providing a comprehensive set of tools and functionalities tailored specifically for the clinical domain. This makes it an essential tool for researchers, clinicians, and developers working in the field of clinical text processing. ### Repository The repository for MedSpaCy is hosted on GitHub at [medspacy/medspacy](https://github.com/medspacy/medspacy). It has received 683 GitHub stars and is currently in beta. ### Latest Release The latest release of MedSpaCy is version 1.3.1, released on 11/21/2024. This version includes optimizations for database I/O, updates to
Python 682 stars

Santosh-Gupta/SpeedTorch

Library for faster pinned CPU <-> GPU transfer in Pytorch

### Overview: SpeedTorch is a library designed to enhance the performance of PyTorch by optimizing the transfer of pinned CPU tensors between the CPU and GPU. This library aims to achieve significant speed improvements, particularly in the transfer of data between these two devices, which can be crucial for applications involving large datasets and complex neural network training. ### Key Features: - **Pinned CPU Tensor Transfer Optimization**: SpeedTorch optimizes the transfer of pinned CPU tensors between the CPU and GPU, providing up to 3.1x faster transfer times compared to regular PyTorch pinned tensors. - **GPU Tensor Transfer Optimization**: It also optimizes the transfer of GPU tensors to and from the CPU, achieving up to 410x faster transfer times. - **Sparse Embedding Training Support**: SpeedTorch supports the hosting of sparse embeddings on CPU RAM, allowing for efficient training of large models without GPU constraints. ### Tech Stack: - **Python**: The primary programming language used for developing SpeedTorch. ### Why It Matters: - **Performance Improvement**: By optimizing data transfer, SpeedTorch can significantly enhance the performance of neural network training, especially in scenarios where data transfer is a bottleneck. - **Resource Management**: It helps in managing GPU and CPU resources more effectively, allowing for better utilization of hardware resources. - **Scalability**: The library can be particularly useful in distributed training setups where data transfer between nodes can be a bottleneck. ### Repository: - **Repository**: Santosh-Gupta/SpeedTorch - **GitHub Stars**: 682 - **GitHub
TypeScript 682 stars

framerslab/agentos

TypeScript AI agent framework: cognitive memory, dynamic personalities, emergent behaviors and self-building designs

Overview: AgentOS is a TypeScript framework designed for AI agents that remember, adapt, and create their own tools. It features persistent cognitive memory, optional personality traits, multi-agent orchestration, and a single dispatch interface for 13 LLM providers. Key features: - Persistent cognitive memory with Ebbinghaus decay and 8 neuroscience-backed mechanisms. - Optional HEXACO personality. - 100+ extensible guardrails. - 13 LLM providers support. - Runtime tool forging with JSON schemas and LLM judges. Tech stack: TypeScript Why it matters: AgentOS offers a robust framework for AI agents that can remember, adapt, and create tools, making it valuable for various applications requiring AI-driven decision-making and tool development.
Python 682 stars

jiaeyan/Jiayan

甲言,专注于古代汉语(古汉语/古文/文言文/文言)处理的NLP工具包,支持文言词库构建、分词、词性标注、断句和标点。Jiayan, the 1st NLP toolkit designed for Classical Chinese, supports lexicon construction, tokenizing, POS tagging, sentence segmentation and punctuation.

Overview: 甲言,专注于古代汉语处理的NLP工具包,支持文言词库构建、分词、词性标注、断句和标点。旨在辅助古汉语信息处理,帮助古汉语学者和爱好者分析和利用文言资料。 Key features: - 文言词库构建 - 自动分词 - 词性标注 - 文言句读 - 标点 Tech stack: Python Why it matters: 甲言是首个专为古汉语设计的NLP工具包,旨在辅助古汉语信息处理,帮助古汉语学者和爱好者更好地分析和利用文言资料,从文化遗产中创造文化新产。
Python 682 stars

philipperemy/stanford-openie-python

Stanford Open Information Extraction made simple!

### Overview: This Python wrapper simplifies the use of Stanford's Open Information Extraction (OpenIE) system, making it accessible for developers working with natural language processing tasks. It integrates seamlessly with the Stanford CoreNLP library, enabling the extraction of structured relation triples directly from plain text. ### Key Features: - **Integration with Stanford CoreNLP**: Simplifies the process of extracting information from text by leveraging the Stanford CoreNLP library. - **Open Domain Support**: Extracts triples without predefined schemas, allowing for flexible and accurate relation extraction. - **Affinity Probability Cap**: Allows for controlled probability of affinity in the extraction process. ### Tech Stack: - Python - Java (via Stanford CoreNLP) ### Why It Matters: This tool is essential for developers working on projects that require the extraction of structured information from unstructured text, such as extracting relationships between entities. By making the Stanford OpenIE system more accessible, it simplifies complex NLP tasks, making it easier for developers to implement and integrate into their projects. ### Repository: philipperemy/stanford-openie-python ### Primary Language: Python ### GitHub Stars: 682 ### GitHub Description: Stanford Open Information Extraction made simple! ### GitHub CI: [![Stanford NLP Wrapper CI](https://github.com/philipperemy/Stanford-OpenIE-Python/workflows/Stanford%20NLP%20Wrapper%20CI/badge.svg)](https://github.com/philipperemy/Stanford-OpenIE-Python/actions) ### Installation
Python 681 stars

Jakobovski/free-spoken-digit-dataset

A free audio dataset of spoken digits. An audio version of MNIST.

Overview: This dataset consists of 3,000 audio recordings of spoken digits, providing a comprehensive audio version of the MNIST dataset. It is an open dataset, growing with contributions from the community. Key features: - 3,000 recordings of spoken digits - 50 recordings per digit - 6 speakers contributing to the dataset - Trimmed to minimal silence at the beginning and end Tech stack: Python Why it matters: This dataset offers a unique audio representation of the MNIST digits, providing a valuable resource for speech recognition, audio classification, and speech processing research.
Python 681 stars

mozilla-ai/otari

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

### Overview: Otari is an open-source, OpenAI-compatible language model gateway that allows developers to run their own version of the model. It provides a single endpoint that routes requests to multiple providers, manages virtual keys, budgets, and usage tracking, and integrates with various providers through a flexible configuration. ### Key Features: - **Single Endpoint for Multiple Providers**: Routes requests to 40+ providers. - **Virtual Keys and Budgets**: Manages revocable API keys and enforces budgets. - **Usage Tracking**: Records usage after spending. - **Provider Credentials**: Kept behind the gateway, ensuring security. - **Local Routing Policies**: Supports failover, weighting, and learned selection. - **Optional Code Execution**: Allows for code execution and web search. - **Model Comparison**: Enables model comparison in the playground. - **Provider Credentials**: Kept behind the gateway, ensuring security. ### Tech Stack: - **Python**: The primary programming language used. - **Docker**: Used for containerization and orchestration. - **SQLite**: SQLite is used inside the container for SQLite inside the container and is deleted when the container stops. ### Why It Matters: - **Security**: Kept credentials behind the gateway, ensuring security. - **Flexibility**: Supports multiple providers and flexible configuration. - **Ease of Use**: A developer can run Otari standalone or connect a data plane to otari.ai. - **Integration**: Integrates with OpenAI and Anthropic, ensuring compatibility with OpenAI models. ### Repository: The repository is hosted on GitHub at [mozilla-ai/
Python 680 stars

InternRobotics/EmbodiedScan

[CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI

### Overview: EmbodiedScan is a comprehensive multi-modal 3D perception dataset and benchmark designed to address the challenges of holistic 3D scene understanding for embodied agents. This dataset includes over 5,000 scans, 1 million ego-centric RGB-D views, 1 million language prompts, and 160,000 3D-oriented boxes, covering 760 categories with some partial alignment to LVIS. The dataset is crucial for advancing the field of embodied AI, enabling agents to interpret and interact with their environment more effectively. ### Key Features: - **Multi-Modal Input**: Incorporates RGB-D images, language prompts, and 3D boxes. - **Ego-centric Perspective**: Focuses on the agent's perspective to better understand the scene. - **Comprehensive Dataset**: Includes 1 million scans, 1 million language prompts, and 160,000 3D boxes. - **760 Categories**: Covers a wide range of categories, with partial alignment to LVIS. ### Tech Stack: - Python ### Why It Matters: EmbodiedScan provides a robust dataset and benchmark for researchers and practitioners to evaluate and improve embodied AI systems. By offering a holistic approach to 3D scene understanding, it addresses the limitations of traditional global view methods and prepares the ground for more advanced embodied AI applications. ### Repository: - **Repository**: InternRobotics/EmbodiedScan - **GitHub Stars**: 680 - **GitHub Description**: CVPR 2024 & NeurIPS
Python 680 stars

iceychris/LibreASR

:speech_balloon: An On-Premises, Streaming Speech Recognition System

Overview: LibreASR is an on-premises, streaming speech recognition system built with PyTorch and fastai. Key features: - Real-time speech recognition - On-premises deployment - Stream processing capabilities Tech stack: Python Why it matters: LibreASR is a powerful tool for real-time speech recognition, making it ideal for applications requiring immediate processing of audio data without the need for cloud-based solutions.
Jupyter Notebook 679 stars

AccumulateMore/OpenCV

✅(已完结)超级全面的 OpenCV 笔记【咕泡唐宇迪】

### Overview: 本项目是一个全面的OpenCV笔记,由咕泡唐宇迪制作。笔记视频讲解详尽,包含从基础到高级的OpenCV知识,适合开发者学习使用。 ### Key features: - 系统全面的OpenCV笔记 - 视频讲解 - 适合开发者学习使用 ### Tech stack: Jupyter Notebook ### Why it matters: 本项目是OpenCV全面知识的总结,适合开发者学习使用,帮助提升编程技能和项目经验。 ### Repository: AccumulateMore/OpenCV ### GitHub stars: 679 ### GitHub description: 超级全面的OpenCV笔记【咕泡唐宇迪】 ### Readme excerpt: 笔记视频: 视频讲解【主讲方:咕泡唐宇迪】 1. https://www.bilibili.com/video/BV1YnELzfEFZ "❤️如果我的笔记对你有帮助,欢迎点个Star⭐,你的支持是我更新的动力~❤️" ------------------------------------------------------------- ------------------------------------------------------------- 笔记备注(敲重点!敲重点!敲重点!): 1. 在线观看笔记时,有时会出现图片(或公式)显示不完整,这是Github网站没有解析好,笔记下载到本地观看就正常了。(不会下载笔记的,百度查一下"Github如何下载文件"。) 2. Pycharm 的 Jupyter Notebook 打开笔记时,图片不会正常显示,笔记是用 Anaconda 的 Jupyter Notebook 打开的。(不会打开笔记的,百度查一下"Anaconda如何打开Jupyter
Rust 679 stars

bminixhofer/nlprule

A fast, low-resource Natural Language Processing and Text Correction library written in Rust.

### Overview: nlprule is a fast, low-resource Natural Language Processing and Text Correction library written in Rust. It implements a rule-based approach to NLP using resources from LanguageTool, providing powerful grammatical error correction and text processing capabilities. ### Key Features: - Rule-based Grammatical Error Correction through multiple thousand rules. - Text processing pipeline including sentence segmentation, part-of-speech tagging, lemmatization, chunking, and disambiguation. - Lightweight and efficient, suitable for low-resource environments. - Integrates seamlessly with Rust ecosystem, leveraging Rust's performance and ecosystem. ### Tech Stack: Rust ### Why It Matters: nlprule offers a fast, efficient solution for natural language processing tasks, particularly in environments where resource constraints are a factor. Its rule-based approach ensures high accuracy and reliability, making it an ideal choice for applications requiring precise text correction and error handling.
Rust 679 stars

kividbio/kividb

A fast, multi-threaded Redis® and Valkey alternative written in Rust: drop-in compatible, with full-text and vector search built in

Overview: KiviDB is a fast, multi-threaded alternative to Redis® and Valkey, written in Rust. It supports Redis protocol, full-text and vector search, and runs on a sharded in-memory key-value design. Key features: - Fast performance - Redis-compatible protocol - Built-in full-text and vector search - Optional Lua scripting support Tech stack: Rust Why it matters: KiviDB offers a fast, multi-threaded alternative to Redis® and Valkey, making it suitable for applications requiring high performance and full-text search capabilities. Repository: [github.com/kividbio/kividb](https://github.com/kividbio/kividb) · Website: [kividb.io](https://kividb.io) GitHub stars: 610
Java 679 stars

vncorenlp/VnCoreNLP

A Vietnamese natural language processing toolkit (NAACL 2018)

Overview: VnCoreNLP is a fast and accurate Vietnamese natural language processing toolkit designed for annotating Vietnamese text. It provides comprehensive linguistic annotations including word segmentation, POS tagging, named entity recognition, and dependency parsing. Key features: - Fast and accurate processing - Rich linguistic annotations - Command-line and API access - Comprehensive architecture and experimental results Tech stack: Java Why it matters: VnCoreNLP is essential for Vietnamese language processing tasks, offering a robust and efficient solution for tasks such as text analysis, sentiment analysis, and more. Repository: vncorenlp/VnCoreNLP GitHub stars: 679 GitHub description: A Vietnamese natural language processing toolkit (NAACL 2018)
Python 677 stars

YangLing0818/buffer-of-thought-llm

[NeurIPS 2024 Spotlight] Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models

Overview: Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models Key features: - Integrates thought-augmented reasoning into large language models - Supports both offline and online reward supervision - Enables reward-guided test-time scaling - Available on HuggingFace-GenX Tech stack: Python Why it matters: Enhances the accuracy, efficiency, and robustness of large language models by incorporating thought-augmented reasoning.
Jupyter Notebook 677 stars

danielsabinasz/TensorSlow

Re-implementation of TensorFlow in pure python, with an emphasis on code understandability

Overview: TensorSlow is a re-implementation of TensorFlow functionality in pure Python, focusing on code understandability and minimal efficiency. Key features: - Minimalist machine learning API - Emphasis on code readability - Built with Jupyter Notebook - Primarily used for educational purposes Tech stack: Python Why it matters: TensorSlow provides a simplified and understandable way to explore the inner workings of deep learning libraries like TensorFlow, making it ideal for learning and educational purposes. Repository: danielsabinasz/TensorSlow Primary language: Jupyter Notebook GitHub stars: 677 GitHub description: Re-implementation of TensorFlow functionality in pure Python, emphasizing code understandability.