Project directory

Projects

Open-source AI projects tracked by the leaderboard, ordered by GitHub stars.

Python 6,574 stars

argosopentech/argos-translate

Open-source offline translation library written in Python

### Overview: Argos Translate is an open-source offline translation library written in Python, providing a robust solution for translating between various languages. ### Key Features: - Supports multiple languages including Arabic, Azerbaijani, Basque, Catalan, Chinese, Czech, Danish, Dutch, English, Esperanto, Finnish, French, Galician, German, Greek, Hebrew, Hindi, Hungarian, Indonesian, Irish, Italian, Japanese, Kyrgyz, Korean, Malay, Persian, Polish, Portuguese, Portuguese (Brazil), Russian, Slovak, Spanish, Swahili, Swedish, Turkish, Ukrainian, Urdu, and more. - Manages pivoting through intermediate languages to translate between languages that don't have direct translations installed. - Compatible with Python libraries, command-line, and GUI applications. - Supports installing language model packages, which are zip archives with a ".argosmodel" extension containing the data needed for translation. ### Tech Stack: Python ### Why It Matters: Argos Translate is a powerful tool for developers looking to integrate translation capabilities into their projects without relying on cloud-based services. Its ability to handle language pivoting and its support for pre-trained models make it a versatile solution for both offline and online applications.
Python 6,567 stars

GoogleCloudPlatform/agent-starter-pack

Ship AI Agents to Google Cloud in minutes, not months. Production-ready templates with built-in CI/CD, evaluation, and observability.

Overview: The Agent Starter Pack is a Python package designed to quickly deploy AI agents on Google Cloud. It includes production-ready templates, CI/CD, observability, and security features. Key features: - Production-ready AI agent templates - Vertex AI evaluation and interactive playground - Cloud Run or Agent Engine deployment - CI/CD integration - Built-in monitoring and observability Tech stack: Python Why it matters: It streamlines the process of deploying AI agents on Google Cloud, making it easier and faster for developers to get started with AI on the platform. Repository: GoogleCloudPlatform/agent-starter-pack GitHub stars: 6567
Python 6,557 stars

airweave-ai/airweave

Open-source context retrieval layer for AI agents

### Overview: Airweave is an open-source context retrieval layer designed for AI agents and RAG systems. It seamlessly integrates with various applications, tools, and databases, ensuring continuous data synchronization and unified access through a context-aware interface. ### Key Features: - **Context Retrieval Layer**: Connects to your applications, tools, and databases, providing up-to-date and relevant context. - **Unified Search Interface**: Enables AI agents to retrieve context from multiple sources in a single request. - **Open-Source and Cloud-Ready**: Built on Python and compatible with Docker, making it easy to deploy and scale. ### Tech Stack: Python ### Why It Matters: Airweave simplifies the process of integrating AI with existing systems, making it easier to access and utilize context-rich data for informed decision-making.
Python 6,547 stars

run-llama/rags

Build ChatGPT over your data, all with natural language

### Overview: RAGs is a Streamlit app that allows developers to create and manage a RAG (Reinforcement Learning with Annotated Data) pipeline from a data source using natural language. This project is inspired by GPTs and is designed to streamline the process of building and configuring RAG systems. ### Key features: - **Streamlit App**: A user-friendly interface for creating and managing RAG pipelines. - **Builder Agent**: A customizable agent that can be trained on various LLMs (e.g., OpenAI, Anthropic) to generate RAG configurations. - **RAG Config**: A section where developers can configure RAG parameters such as system prompts, top-k, chunk size, and embedding model, with the option to update the agent. - **Generated RAG Agent**: A chatbot interface where developers can query the RAG agent with their questions, using the configured parameters to retrieve relevant information. ### Tech stack: Python ### Why it matters: This project simplifies the process of creating and configuring RAG systems, making it easier for developers to integrate and leverage their data for more advanced natural language processing tasks.
Rust 6,546 stars

xingkongliang/skills-manager

A lightweight desktop app to manage, sync, and organize AI agent skills across 50+ coding tools — Claude Code, Codex, Cursor, Copilot, Gemini CLI, and more.

### Overview: Skills Manager is a lightweight desktop application designed to manage and synchronize AI agent skills across a wide range of coding tools, including Claude Code, Codex, Cursor, Copilot, Gemini CLI, and more. It simplifies the process of installing, deploying, and managing skills across multiple environments, ensuring a unified and efficient workflow. ### Key Features: - **Unified Skill Library**: Skills can be installed from Git repositories, local folders, `.zip` archives, or the skills.sh marketplace, all stored in a central repository located at `~/.skills-manager`. - **Marketplace**: Browse and discover popular skills using keyword search. - **Agent Workspace**: Agents can manage skills directly, avoiding the need to write to agent-specific folders, preserving sources, presets, and update tracking. - **Presets**: Skills can be grouped into presets, which can be activated or deactivated in any workspace. - **Global Workspace**: Each agent has a dedicated workspace listing all skills installed globally, ensuring a consistent view across all agents. - **Project Workspaces**: Project-specific workspaces allow managing skills for individual projects, keeping the view up-to-date with the agent's current setup. ### Tech Stack: Rust ### Why It Matters: Skills Manager streamlines the management of AI agent skills across multiple coding tools, making it easier to maintain and update skills without disrupting the workflow. By centralizing skills and providing a unified view, it simplifies the process of installing, deploying, and managing skills across different environments, ensuring a more efficient and consistent workflow.
Python 6,531 stars

codertimo/BERT-pytorch

Google AI 2018 BERT pytorch implementation

### Overview: This repository contains the PyTorch implementation of Google AI's 2018 BERT paper, showcasing a powerful alternative to traditional language models with self-attention mechanisms. The project aims to provide a simple and understandable codebase for various NLP tasks, emphasizing the transferability of pre-trained language models. ### Key features: - **BERT Implementation**: A PyTorch implementation of Google AI's BERT model. - **Simple Annotation**: The code is designed to be as simple and easy to understand as possible. - **Pre-training Methods**: Includes both "masked language model" and "predict next sentence" training methods from the BERT paper. ### Tech stack: Python ### Why it matters: This implementation showcases the potential of transformer-based models in NLP, demonstrating their effectiveness across various tasks without the need for task-specific architectures. The pre-training methods presented in the BERT paper highlight the versatility of these models and their ability to be transferred to any NLP task.
TypeScript 6,529 stars

genkit-ai/genkit

Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google

### Overview: Genkit is an open-source framework designed to build full-stack AI-powered applications. It supports multiple programming languages including JavaScript/TypeScript, Go, Python (Beta), and Dart (Preview), providing a unified interface for integrating AI models from providers like Google, OpenAI, Anthropic, and Ollama. Genkit offers rapid deployment and easy integration, making it suitable for various projects. ### Key Features: - **JavaScript/TypeScript**: Production-ready with full feature support. - **Go**: Production-ready with full feature support. - **Python (Beta)**: Wide feature support approaching production-readiness. - **Dart (Preview)**: Early development with core functionality. ### Tech Stack: Genkit uses TypeScript for its core development. ### Why It Matters: Genkit simplifies the process of integrating AI models into applications, making it easier to build and deploy production-ready AI features quickly. Its unified interface and cross-language support make it versatile and adaptable to various project needs. ### Repository: The repository for Genkit is hosted on GitHub, with 6,528 stars, indicating a significant community interest and use in production environments. ### Primary Language: Genkit is primarily developed and used in TypeScript. ### GitHub Description: Genkit is an open-source framework for building full-stack AI-powered applications, built and used in production by Google's Firebase. It provides SDKs for multiple programming languages with varying levels of stability, including JavaScript/TypeScript, Go, Python (Beta), and Dart (Preview). ### Installation: To get started with Genkit, you can install
Java 6,503 stars

NLPchina/ansj_seg

ansj分词.ict的真正java实现.分词效果速度都超过开源版的ict. 中文分词,人名识别,词性标注,用户自定义词典

Overview: This is a Java implementation of the Chinese segmentation tool ANSJ, surpassing the open-source version ICT in terms of speed and accuracy. Key features: - Fast segmentation speed (200,000 words per second on Mac Air) - High accuracy (96%) - Comprehensive features including Chinese segmentation, name recognition, user-defined dictionary, keyword extraction, automatic summarization, and keyword marking. Tech stack: Java Why it matters: This tool offers superior performance and accuracy, making it suitable for applications requiring high-quality segmentation and natural language processing tasks. Repository: NLPchina/ansj_seg Primary language: Java GitHub stars: 6,503 GitHub description: ANSJ Chinese segmentation. A truly Java implementation of ICT's Chinese segmentation, surpassing the open-source version in speed and accuracy. Includes Chinese segmentation, name recognition, user-defined dictionary, keyword extraction, automatic summarization, and keyword marking. Suitable for applications requiring high-quality segmentation and natural language processing tasks.
Python 6,491 stars

SkalskiP/courses

This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

### Overview: This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI). It offers a wide range of topics from statistics and linear algebra to deep learning, natural language processing, and more, suitable for both beginners and experienced learners. ### Key Features: - **Generative AI**: A GitHub repository for beginners. - **Deep Learning**: A YouTube playlist with over 6,594 views. - **Natural Language Processing**: A YouTube playlist with over 6,594 views. - **Deep Learning**: A website course by Sebastian Raschka. - **Large Language Models**: A YouTube playlist with over 6,594 views. - **Python**: A YouTube playlist with over 6,594 views. - **Stable Diffusion and Deep Learning**: A website course by fast.ai. - **Deep Learning**: A YouTube playlist with over 6,594 views. - **Deep Learning**: A YouTube playlist with over 6,594 views. - **Large Language Models and Prompt Engineering**: A website course by DAIR.AI. - **Computer Vision**: A YouTube playlist with over 6,594 views. - **Natural Language Processing**: A YouTube playlist with over 6,594 views. - **Linear Algebra**: A YouTube playlist with over 6,594 views. ### Tech Stack: - GitHub repository, YouTube playlist, website, and YouTube playlist. ### Why It Matters: This repository serves as a comprehensive resource for anyone interested in AI, providing a variety
C++ 6,440 stars

flashlight/wav2letter

Facebook AI Research's Automatic Speech Recognition Toolkit

Overview: wav2letter++ is a project by Facebook AI Research that aims to provide tools and recipes for automatic speech recognition, building upon the Flashlight framework. Key features: - Recipes for reproducing research papers in automatic speech recognition. - Pre-trained models for speech recognition. - Recipes for building the old, pre-consolidation version of wav2letter. Tech stack: C++ Why it matters: wav2letter++ provides a set of tools and recipes for researchers and developers interested in automatic speech recognition, building on the Flashlight framework, which is widely used in the field of speech recognition.
Unknown 6,434 stars

jason718/awesome-self-supervised-learning

A curated list of awesome self-supervised methods

Overview: This repository is a curated list of awesome self-supervised learning resources, inspired by other popular AI-related lists like awesome-deep-vision, awesome-adversarial-machine-learning, and awesome-deep-learning-papers. It aims to provide a comprehensive overview of self-supervised learning techniques and their applications across various domains such as computer vision, machine learning, robotics, and more. Key features: - Papers and resources on self-supervised learning techniques - Papers and resources on self-supervised learning in computer vision, including image representation learning, video representation learning, and 3D feature learning - Papers and resources on self-supervised learning in robotics, natural language processing, and time-series analysis - Papers and resources on self-supervised learning in recommendation systems and speech recognition Tech stack: Python, Markdown, and GitHub Why it matters: Self-supervised learning has become an exciting direction in AI research, as it offers a way to train models without the need for labeled data, making it particularly useful in scenarios where labeled data is scarce or expensive. The list aims to provide a valuable resource for researchers and practitioners looking to explore and implement self-supervised learning techniques in their work. Repository: jason718/awesome-self-supervised-learning GitHub stars: 6435 GitHub description: A curated list of awesome self-supervised methods
C++ 6,428 stars

liuruoze/EasyPR

(CGCSTCD'2017) An easy, flexible, and accurate plate recognition project for Chinese licenses in unconstrained situations. CGCSTCD = China Graduate Contest on Smart-city Technology and Creative Design

Overview: EasyPR 是一个基于 OpenCV 的中文车牌识别系统,旨在提供一个简单、高效且准确的车牌识别库,适用于各种非限制场景。 Key features: - 支持中文车牌识别 - 高识别率 - 使用 OpenCV 库实现,可移植到多种平台 Tech stack: C++ Why it matters: EasyPR 提供了一个简单、高效且准确的车牌识别解决方案,适用于各种非限制场景,特别适合在智能城市和创意设计竞赛中应用。 Repository: liuruoze/EasyPR GitHub stars: 6429
Python 6,424 stars

microsoft/nlp-recipes

Natural Language Processing Best Practices & Examples

### Overview This repository contains examples and best practices for building natural language processing (NLP) systems, focusing on state-of-the-art methods and common scenarios popular among researchers and practitioners. The content is based on past and potential future engagements with customers and collaboration with partners, researchers, and the open source community. ### Key Features - **Jupyter Notebooks**: Comprehensive examples and best practices for building NLP systems. - **Utility Functions**: Pre-built or easily customizable solutions for various NLP tasks. - **Pre-trained Models**: Unified solutions for many real-world problems, achieving state-of-the-art results on benchmarks like GLUE and SQuAD. ### Tech Stack - Python ### Why It Matters The tools in this repository aim to significantly reduce the "time to market" by simplifying the process from defining the business problem to developing a solution. The examples and utilities provided can serve as guidelines and showcase best practices and usage of the tools in a wide variety of languages. Pre-trained models, such as transformers and deep architectures, are prioritized as they provide a unified solution for many NLP tasks, making them easier to handle and deploy. ### Target Audience This repository is designed for developers and data scientists interested in building NLP systems. It can serve as a comprehensive resource for those looking to leverage recent advances in NLP algorithms and neural architectures.
Java 6,422 stars

haifengl/smile

Statistical Machine Intelligence & Learning Engine

### Overview: SMILE (Statistical Machine Intelligence & Learning Engine) is a comprehensive, high-performance machine learning framework for the JVM. SMILE v5+ requires Java 25; v4.x requires Java 21; all previous versions require Java 8. SMILE also provides idiomatic APIs for Scala and Kotlin. With advanced data structures and algorithms, SMILE delivers state-of-the-art performance across every aspect of machine learning. ### Key Features: - **LLM (Language Learning Model) Inference**: LLaMA-3 inference, Tiktoken BPE tokenizer, OpenAI-compatible REST server, SSE chat streaming. - **Deep Learning**: LibTorch/GPU backend, EfficientNet-V2 image classification, custom layer API. - **Classification**: SVM, Decision Trees, Random Forest, AdaBoost, Gradient Boosting, Logistic Regression, Neural Networks, RBF Networks, MaxEnt, KNN, Naïve Bayes, LDA/QDA/RDA. - **Regression**: SVR, Gaussian Process, Regression Trees, GBDT, Random Forest, RBF, OLS, LASSO, ElasticNet, Ridge. - **Clustering**: BIRCH, CLARANS, DBSCAN, DENCLUE, Deterministic Annealing, K-Means, X-Means, G-Means, Neural Gas, Growing Neural Gas, Hierarchical, SIB, SOM, Spectral, Min-Entropy. - **Manifold Learning**: IsoMap, LLE, Laplacian Eigenmap, t-SNE, U
Python 6,420 stars

modelscope/FunClip

FunASR-powered video transcription, subtitle generation, and LLM-assisted clipping tool with a local Gradio UI.

### Overview: FunClip is a fully open-source, locally deployed automated video clipping tool that leverages Alibaba TONGYI speech lab's open-source FunASR Paraformer series models for speech recognition on videos. Users can clip video segments based on selected text or speakers, and the tool integrates Alibaba's Paraformer-Large, SeACo-Paraformer, and CAM++ models for enhanced recognition and customization. ### Key Features: - **Speech Recognition:** Uses Alibaba's open-source FunASR models for accurate speech recognition on videos. - **Text/Segment Selection:** Users can choose text segments or speakers from the recognition results to clip the corresponding video clips. - **Hotword Customization:** Allows users to specify certain entity words, names, etc., as hotwords during the ASR process to enhance recognition results. - **Speaker Recognition:** Integrates the CAM++ speaker recognition model to enable users to clip segments from a specific speaker. - **Gradio Interface:** Offers a simple and user-friendly interface for easy installation and deployment, supporting both local and server deployment. - **Automatic Subtitles:** Generates full video SRT subtitles and target segment SRT subtitles, providing a simple and convenient user experience. ### Tech Stack: Python ### Why it Matters: FunClip simplifies the process of video editing and transcription by leveraging advanced AI models, making it accessible and easy to use for developers and content creators.
Swift 6,406 stars

argmaxinc/argmax-oss-swift

On-device Speech AI for Apple Silicon

### Overview: Argmax Open-Source SDK is a collection of turn-key on-device inference frameworks for Apple Silicon, including WhisperKit, SpeakerKit, and TTSKit. It provides speech-to-text, speaker diarization, and text-to-speech functionalities, making it a valuable tool for developers looking to integrate advanced AI capabilities into their applications. ### Key Features: - **WhisperKit**: Speech-to-Text with OpenAI Whisper. - **SpeakerKit**: Speaker Diarization with Pyannote. - **TTSKit**: Text-to-Speech with Qwen-TTS. ### Tech Stack: Swift ### Why It Matters: Argmax Open-Source SDK offers a comprehensive solution for developers looking to integrate advanced AI features into their applications, providing turn-key solutions for speech-to-text, speaker diarization, and text-to-speech functionalities. This makes it an essential tool for developers working on applications that require real-time speech processing and text-to-speech capabilities. ### Repository: - **Repository**: argmaxinc/argmax-oss-swift - **Stars**: 6405 - **Description**: On-device Speech AI for Apple Silicon ### Installation: - **Swift Package Manager**: Add the package to your `Package.swift` file. - **Prerequisites**: Ensure you have Xcode installed and configured. - **Xcode Steps**: Follow the provided instructions in the README for setting up the project. - **Homebrew**: If using Homebrew, ensure you have the necessary dependencies installed. ### Quick Example: ```swift import WhisperKit let
Rust 6,403 stars

koharu-rs/koharu

ML-powered manga translator, written in Rust.

### Overview: Koharu is a Rust-powered manga translator that leverages machine learning to automate the translation process. It combines advanced image processing techniques with natural language understanding to provide a seamless and efficient translation experience. ### Key Features: - **Multi-format project management**: Handles raster images, archives, and PDFs with page sequencing. - **Selective pipeline**: Allows for detection, OCR, translation, and inpainting at project or page scope. - **Detection and segmentation**: Identifies text regions, speech bubbles, and cleanup areas. - **Multimodal OCR**: Supports dialogue, captions, and general page text. - **Local GGUF inference and hosted providers**: Enables LLM and machine translation workflows. - **Generative inpainting**: Removes OCR errors and reconstructs artwork. - **Proofreading**: Corrects OCR and translation output. - **WebGPU-based canvas**: Facilitates manual cleanup, text placement, and page composition. - **Multilingual text shaping and layout**: Automatically fits text, supports font fallback, and handles vertical CJK and right-to-left text. - **Layered PSD export**: Provides flattened delivery and layered editing. - **Agent-based workflow**: Enables project inspection, editing, and pipeline control. ### Tech Stack: Rust ### Why it Matters: Koharu offers a local-first workflow for manga translation, ensuring data privacy and security. It combines powerful ML models with efficient image processing techniques to create a highly effective and user-friendly translation experience.
Python 6,390 stars

lavague-ai/LaVague

Large Action Model framework to develop AI Web Agents

Overview: LaVague is a large action model framework designed for developers to create AI-driven web agents for automating processes on websites. Key features: - LaVague Web Agents can take an objective and generate and perform actions to achieve it. - It consists of a World Model and an Action Engine. - The World Model interprets an objective and the current state, while the Action Engine compiles and executes the instructions. Tech stack: Python Why it matters: LaVague simplifies the process of creating AI-driven web agents, making it easier for developers to automate tasks on websites without needing deep expertise in web scraping or automation tools. Repository: lavague-ai/LaVague Primary language: Python GitHub stars: 6390 GitHub description: Large Action Model framework to develop AI Web Agents
TypeScript 6,379 stars

promptslab/Awesome-Prompt-Engineering

This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc

Overview: This repository is a curated collection of resources for Prompt Engineering, focusing on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM, and other large language models. It aims to provide developers with comprehensive guides, papers, tools, models, APIs, benchmarks, courses, and communities for working with these models effectively. Key features: - Papers and Surveys - Prompt Optimization and Automatic Prompting - Prompt Compression - Reasoning Advances - In-Context Learning - Agentic Prompting and Multi-Agent Systems - Multimodal Prompting - Structured Output and Format Control - Prompt Injection and Security - Applications of Prompt Engineering - Text-to-Image Generation - Text-to-Music/Audio Generation - Foundational Papers (Pre-2024) Tech stack: TypeScript Why it matters: This repository serves as a valuable resource for developers looking to enhance their Prompt Engineering skills, enabling them to effectively work with large language models and improve the quality of their AI applications.
Python 6,365 stars

yl4579/StyleTTS2

StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Models

### Overview: StyleTTS 2 is a text-to-speech (TTS) model that leverages style diffusion and adversarial training with large speech language models (SLMs) to achieve human-level TTS synthesis. This model surpasses human recordings on the single-speaker LJSpeech dataset and matches it on the multispeaker VCTK dataset, showcasing the potential of style diffusion and adversarial training with large SLMs. ### Key features: - **Style Diffusion and Adversarial Training with Large SLMs**: The model uses style diffusion and adversarial training with large SLMs to generate the most suitable style for the text without requiring reference speech. - **Efficient Latent Diffusion**: The model models styles as a latent random variable through diffusion models to generate the most suitable style for the text, achieving efficient latent diffusion. - **Improved Speech Naturalness**: The model employs large pre-trained SLMs, such as WavLM, as discriminators with our novel differentiable duration modeling for end-to-end training, resulting in improved speech naturalness. - **Human-Level TTS Synthesis**: StyleTTS 2 surpasses human recordings on the single-speaker LJSpeech dataset and matches it on the multispeaker VCTK dataset, showcasing the potential of style diffusion and adversarial training with large SLMs. ### Tech stack: Python ### Why it matters: This work achieves the first human-level TTS synthesis on both single and multispeaker datasets, demonstrating the potential of style diffusion and adversarial training with large SLMs