Project directory

Projects

Open-source AI projects tracked by the leaderboard, ordered by GitHub stars.

Python 597 stars

HavenFeng/photometric_optimization

Photometric optimization code for creating the FLAME texture space and other applications

### Overview: This repository provides an analysis-by-synthesis framework for fitting a textured FLAME model to in-the-wild images. FLAME is a lightweight generic 3D head model learned from over 33,000 head scans, but it does not come with an appearance space. This repository describes how to build a texture space for FLAME from in-the-wild images, provides code to fit a textured FLAME model to images, and optimizes for FLAME's parameters, appearance, and lighting. The FLAME model and the texture space can be downloaded from the FLAME project website, where you need to sign up and agree to the license for access. ### Key Features: - **Texture Space Construction**: Builds a texture space from in-the-wild images to cover a large range of ethnicities, age groups, etc. - **Model Fitting**: Fits FLAME to in-the-wild images, optimizing for FLAME's parameters, appearance, and lighting, and optimizing for the FLAME texture to match an in-the-wild image. - **Code Implementation**: Provides code to build a texture space, fit a textured FLAME model, and optimize for the FLAME texture to match an in-the-wild image. ### Tech Stack: Python ### Why It Matters: This repository provides a comprehensive solution for creating a texture space for FLAME, enabling the fitting of FLAME models to in-the-wild images. The use of FLAME and the texture space can be beneficial in various applications, such as creating realistic textures for virtual avatars or enhancing the appearance
Unknown 597 stars

hassony2/useful-computer-vision-phd-resources

Lists of resources useful for my PhD in computer vision

Overview: This repository contains a curated list of resources and advice useful for a PhD in computer vision, compiled by the author. Key features: - General advice on conducting research - Better/faster paper reading tools and resources - Tips for writing a good CVPR/ECCV/ICCV paper - How to write a good review - How to release code that is easy to understand and reuse - Tools for fast and reproducible experimentation (in Python/PyTorch) - Tricks for neural networks - Some coding tips Tech stack: Python/PyTorch Why it matters: This repository serves as a concise and accessible resource for researchers in computer vision, providing a quick overview of essential tools and advice. It helps researchers efficiently manage their research and stay updated with the latest practices in the field.
Python 597 stars

jzjzzzzzzz/agent-me

Distill your knowledge, memories, and decisions into an open-source, inspectable AI Agent Twin.

### Overview: Agent-Me is an open-source, inspectable AI Agent Twin that distills your knowledge, memories, and decisions into an AI representation of yourself. It provides a stable, version-controlled knowledge base and a reviewable memory substrate, allowing for durable identity and memory models. ### Key Features: - **Reviewable Knowledge Base**: Uses Markdown for version-controlled knowledge, providing a stable and inspectable body of personal information. - **Memory Substrate**: Supports SQLite-backed typed memory, including reviewed identity/relationships, declared valid and event times, and persisted chat transcripts. - **Memory Workbench**: Offers a browser review workbench for approved-source ingestion, conflict review, provenance, and local evidence-grounded answers. - **Scoped Model-Assisted Extraction**: Proposes pending classifications over exact source quotations for more precise and contextually relevant responses. ### Tech Stack: - **Python**: The primary programming language used for the implementation. - **FastAPI**: For the backend API. - **React**: For the frontend user interface. ### Why It Matters: Agent-Me aims to bridge the gap between a personal AI and a fully realized, contextually aware representation of a person. By providing a stable, reviewable knowledge base and a system that can reason and verify its own responses, it opens the door to building more comprehensive and useful AI systems that can truly represent and interact with individuals in a meaningful way. ### Repository: - **Repository**: jzjzzzzzzz/agent-me - **GitHub Stars**: 586 - **Primary Language**: Python - **
Python 596 stars

BYU-PCCL/holodeck

High Fidelity Simulator for Reinforcement Learning and Robotics Research.

Overview: Holodeck is a high-fidelity simulator designed for reinforcement learning and robotics research, built on Unreal Engine 4. Key features: - 7+ rich worlds for training agents in, and many scenarios for those worlds - Linux and Windows support - Easily extend and modify training scenarios - Train and control more than one agent at once - Simple, OpenAI Gym-like Python interface - High performance - simulation speeds of up to 2x real time are possible. Performance penalty only for what you need - Run headless or watch your agents learn Tech stack: Python Why it matters: Holodeck provides a powerful and flexible environment for researchers to test and refine their reinforcement learning algorithms and robotics models, offering a high-fidelity simulation that can be easily extended and modified to suit various research needs.
Python 596 stars

vladfi1/phillip

The SSBM "Phillip" AI.

Overview: The SSBM "Phillip" AI is a project based on Deep Reinforcement Learning, designed as a successor to the original "Phillip" project. It is no longer actively maintained but has a successor project based on imitation learning. Key features: - Runs on various operating systems including Linux, macOS, and Windows. - Supports Dolphin emulator for SSBM. - Includes a set of pre-trained agents, with the best human-like agent being "delay18/FalcoBF". - Supports training and running on slurm clusters for advanced users. Tech stack: Python 3 Why it matters: The project provides a powerful AI assistant for SSBM players, offering a unique combination of AI and human-like playstyle.
Python 595 stars

DivergentAI/dreamGPT

Leverage hallucinations from Large Language Models (LLMs) for novelty-driven explorations.

Overview: dreamGPT is a GPT-based solution that leverages hallucinations from Large Language Models (LLMs) to generate new, innovative ideas. This approach aims to explore a wide range of possibilities rather than focusing on specific problem-solving. Key features: - Divergent thinking using hallucinations from LLMs - Novelty-driven exploration - Supports Python 3.10+ and Poetry - Optional storage of "dreams" in Pinecone for further processing Tech stack: Python Why it matters: dreamGPT offers a unique approach to creativity and innovation by harnessing the potential of hallucinations, which can be seen as a positive aspect in this context. This method aims to generate a diverse range of ideas, which can be particularly valuable in brainstorming sessions and creative problem-solving. Repository: DivergentAI/dreamGPT GitHub stars: 595 GitHub description: Leverage hallucinations from Large Language Models (LLMs) for divergent thinking to generate new innovative ideas.
Unknown 595 stars

OmicsML/awesome-foundation-model-single-cell-papers

### Overview: This repository is a curated list of foundational models in single-cell genomics, organized into three categories: unimodal, multimodal, and LLM-based scFMs. The papers are grouped by perturbation modeling, virtual cells, pretraining datasets, benchmarks, infrastructure & agents, and surveys. Contributions are welcome to expand the list and improve the quality of the curated content. ### Key Features: - **Unimodal scFMs**: Organized by single-cell RNA sequencing (scRNA-seq) and single-cell ATAC-seq (scATAC-seq). - **Multimodal scFMs**: Includes transcriptomics and perturbation, spatial, proteomics, and histology. - **LLM-based scFMs**: Grouped into LLM-based scFMs and LLM-based models and frameworks. ### Tech Stack: The repository is structured using Markdown, HTML, and various images for visual representation. ### Why it Matters: This curated list provides a comprehensive overview of foundational models in single-cell genomics, helping researchers and practitioners stay updated with the latest advancements and challenges in the field.
Python 595 stars

hirofumi0810/neural_sp

End-to-end ASR/LM implementation with PyTorch

### Overview: NeuralSP is an end-to-end ASR/LM implementation built with PyTorch, designed to handle a wide range of speech recognition tasks. It includes advanced features such as frame stacking, sequence summary networks, and various encoder-decoder architectures, making it highly versatile for different applications. ### Key Features: - **Corpus Support:** Supports multiple ASR and LM corpora including AISHELL-1, AISHELL-2, AMI, CSJ, Librispeech, Switchboard, TEDLIUM2/TEDLIUM3, TIMIT, and WSJ. - **Front-End Enhancements:** Includes frame stacking, sequence summary networks, and SpecAugment for robust training. - **Encoder Architectures:** Supports RNN encoders, Transformer encoders, Conformer encoders, Time-Depth Separable (TDS) convolution encoders, and Gated CNN encoders. - **Decoding Techniques:** Implements Beam search, Shallow fusion, Cold fusion, Deep fusion, Forward-backward attention decoding, and ensemble decoding for accurate transcriptions. - **Language Models:** Utilizes RNNLM, Gated Convolutional LM, Transformer LM, and Transformer-XL LM for improved language modeling. - **Output Units:** Supports phoneme, grapheme, wordpiece (BPE, sentencepiece), word, and word-char mix outputs for flexible post-processing. - **Multi-Task Learning:** Supports hybrid CTC/attention, hierarchical attention, hierarchical CTC, and hierarchical CTC+Attention for alleviating data sparsity. ### Tech Stack
Python 595 stars

miguelvr/dropblock

Implementation of DropBlock: A regularization method for convolutional networks in PyTorch.

Overview: DropBlock is a structured dropout method designed for convolutional neural networks, addressing the limitations of dropout in regularizing convolutional layers. It introduces DropBlock2D and DropBlock3D, improving accuracy and robustness in various tasks. Key features: - DropBlock2D: Structured dropout for convolutional layers, dropping units in contiguous regions. - DropBlock3D: Structured dropout for 3D inputs, dropping units in 3D space. - Scheduled DropBlock: Gradually increases the drop probability during training. Tech stack: Python Why it matters: DropBlock significantly improves the accuracy and robustness of convolutional networks, particularly in tasks like image classification and object detection, achieving notable improvements over standard dropout methods.
Go 594 stars

solo-agent/solo

Solo Agent — an open-source, local-first workspace where humans and AI coding agents collaborate through channels, tasks, teams, and persistent memory.

Overview: Solo Agent is an open-source, local-first workspace designed for collaboration between humans and AI coding agents, providing channels, task boards, and persistent memory for seamless teamwork. Key features: - Agent team templates - Channels for collaboration - Task boards for task management - Persistent memory for shared context Tech stack: Go, Node.js, PostgreSQL, Docker Why it matters: Solo Agent simplifies the integration of AI agents into traditional development workflows, making complex tasks and projects more accessible and transparent. Repository: solo-agent/solo GitHub stars: 594 GitHub description: Solo Agent — an open-source, local-first workspace where humans and AI coding agents collaborate through channels, tasks, teams, and persistent memory.
Go 594 stars

thunder-id/thunderid

ThunderID, an LF Decentralized Trust project, is a high-performance, open-source identity stack designed for developers to secure and manage access for humans, AI agents, and machines through fully composable identity flows.

Overview: ThunderID is an open-source identity stack designed for developers to secure access for humans, AI agents, and machines through fully composable identity flows. Key features: - Supports human, AI agents, and machine identities - Provides lightweight runtime with GitOps support - Enables post-quantum-safe by design Tech stack: Go Why it matters: ThunderID is tailored for the agentic era, offering a developer-first IAM stack and tools for securing applications, APIs, services, and agent-driven workflows. It bridges traditional and decentralized identity ecosystems, ensuring security and traceability. Repository: thunder-id/thunderid GitHub stars: 594 GitHub description: ThunderID, an LF Decentralized Trust project, is a lightweight, open-source identity stack designed for developers to secure and manage access for humans, AI agents, and machines through fully composable identity flows.
TypeScript 593 stars

NextAdminHQ/nextjs-admin-dashboard

AI-Native Next.js admin dashboard template and UI components that come with pre-built elements, components, pages, high-quality design, integrations, and much more.

Overview: NextAdmin is a free, open-source Next.js admin dashboard template featuring pre-built UI components, pages, high-quality design, integrations, and more. Key features: - Pre-built pages for login, signup, profile, settings, and more - Multiple dashboards for analytics, e-commerce, CRM, and marketing - Dark and light mode - Figma design source - Mock REST APIs - Tailgrids UI, Recharts, Leaflet, TanStack Table, Zod, and FullCalendar integrations Tech stack: TypeScript Why it matters: NextAdmin provides a comprehensive admin dashboard solution with pre-configured components and pages, making it easy to get started and deploy quickly. The AI-native features like customizable prompts and agent skills streamline development and integration, ensuring consistent and efficient workflows.
C++ 593 stars

PaddlePaddle/FlyCV

FlyCV is a high-performance library for processing computer visual tasks.

Overview: FlyCV is a cutting-edge library designed for efficient computer vision tasks, offering high performance and ease of use. Key features: - Real-time object detection - Image segmentation - Facial recognition - Video analysis Tech stack: C++ and CUDA Why it matters: FlyCV simplifies complex computer vision tasks, making it an indispensable tool for developers working on real-time applications and projects requiring high performance.
TypeScript 593 stars

iannuttall/seo

SEO for agent-native teams. Your agent gets your real Search Console, Google Analytics, Bing and crawl data through an MCP server and CLI, so it stops guessing.

### Overview: SEO for Agent-Native Teams is a free, open-source tool designed to provide accurate and actionable SEO data directly to agents, eliminating the guesswork and leading to more effective and optimized results. ### Key Features: - **Real Data Access:** Seamlessly integrates with Google Search Console, Google Analytics, Bing, and site crawl data through an MCP server and CLI. - **No Guessing:** Provides detailed insights into traffic, impressions, positions, visits, and more, enabling agents to make informed decisions. - **Customizable Commands:** Offers a wide range of commands to ask about specific issues or queries, such as why traffic dropped, which pages are close to page one, and more. ### Tech Stack: - TypeScript ### Why It Matters: SEO is crucial for any digital marketing team, especially those working with agent-native teams. This tool ensures that agents have access to the most accurate and up-to-date SEO data, allowing them to make informed decisions and improve their websites' performance. By providing real numbers and insights, it eliminates the need for agents to rely on generic advice or keyword estimates, leading to more effective and optimized SEO strategies.
Python 593 stars

kydlikebtc/awesome-jev

1207 public resources for Jev, TypeSafe AI's System One decision model, indexed by decision pattern. Source citations, dated link checks and scheduled call-site text checks; runtime and performance are not independently tested here. EN/中文, JSON schema and platform compatibility.

### Overview: Jev Decision Atlas is a repository of public examples of using TypeSafe AI's Jev decision model. It categorizes resources by the decision being made, providing a comprehensive index of how Jev operates and its outputs. ### Key features: - **Decision Pattern Organized**: Resources are grouped by the specific decision being made, making it easy to understand how Jev is applied in various contexts. - **Source Citations**: Every resource includes call-site citations, primitive claims, and caveats, allowing users to verify the information and understand the context. - **Decision Pattern and Resource Kind**: The repository categorizes resources by the decision pattern and resource type, providing a detailed breakdown of how Jev is used. ### Tech Stack: Python ### Why it Matters: This repository serves as a valuable resource for developers looking to understand and implement Jev decision models. It provides a clear and organized way to explore how Jev operates in different scenarios, backed by detailed source citations and performance insights.
Python 593 stars

nianticlabs/mickey

[CVPR 2024 - Oral] Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences

### Overview: MicKey is a project that introduces **Metric Keypoints (MicKey)**, a feature detection pipeline for establishing metric correspondences between 2D images. MicKey regresses keypoint positions in camera space and leverages descriptor matching to recover metric relative poses. The project is a reference implementation of the paper "Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences" presented at CVPR 2024. ### Key Features: - **Metric Keypoints (MicKey)**: A differentiable approach for establishing metric correspondences via descriptor matching. - **Metric Relative Pose Recovery**: MicKey recovers metric relative poses from metric correspondences. - **End-to-End Training**: MicKey is trained in an end-to-end fashion using differentiable pose optimization, requiring only image pairs and their ground truth relative poses for supervision. ### Tech Stack: - **Python**: The project is implemented using Python. ### Why It Matters: MicKey addresses the problem of instant Augmented Reality (AR) in the Map-free benchmark, where instead of building 3D maps from hundreds of images and scale calibrations, users can use a single photo of a scene as the map. MicKey aims to evaluate the accuracy of the estimated metric relative pose between the reference image (the map) and the query image (the user).
JavaScript 593 stars

samtecspg/articulate

A platform for building conversational interfaces with intelligent agents (chatbots)

Overview: Articulate is a platform designed for building conversational interfaces with intelligent agents, utilizing Rasa NLU and Duckling for natural language processing and TensorFlow for deep learning capabilities. Key features: - Rasa NLU for natural language processing - Duckling for date and time extraction - TensorFlow for complex dialog management - Custom dialogue management solution Tech stack: JavaScript Why it matters: Articulate simplifies the process of building conversational interfaces, making it accessible for developers without extensive machine learning expertise, while maintaining high performance and complexity in dialog management. Repository: samtecspg/articulate Primary language: JavaScript GitHub stars: 593 GitHub description: A platform for building conversational interfaces with intelligent agents
Python 593 stars

timbmg/Sentence-VAE

PyTorch Re-Implementation of "Generating Sentences from a Continuous Space" by Bowman et al 2015 https://arxiv.org/abs/1511.06349

### Overview: Sentence Variational Autoencoder is a PyTorch implementation of the model described in "Generating Sentences from a Continuous Space" by Bowman et al. 2015. This model aims to generate new sentences by sampling from a continuous latent space, providing a probabilistic approach to text generation. ### Key Features: - **Model Architecture**: The model is based on a Variational Autoencoder (VAE) with a continuous latent space. - **Training Details**: The training process includes ELBO (Evidence Lower Bound) and negative log likelihood (NLL) metrics, with KL divergence as a regularization term. - **Performance Metrics**: The model achieves a true ELBO optimized for approximately 1 epoch, with results averaged over the entire validation set. - **Interpolating Sentences**: Samples can be obtained by interpolating between two generated sentences. ### Tech Stack: - **Programming Language**: Python - **Dependencies**: PyTorch ### Why It Matters: This implementation is significant for researchers and developers interested in natural language processing, particularly in text generation and machine learning applications. The ability to generate new sentences from a continuous space offers a promising approach to text synthesis and could have applications in various fields such as content creation, language modeling, and more. ### Repository Information: - **Repository**: timbmg/Sentence-VAE - **GitHub Stars**: 593 - **Description**: PyTorch re-implementation of "Generating Sentences from a Continuous Space" by Bowman et al. 2015 - **Primary Language**: Python
Python 593 stars

vacancy/SceneGraphParser

A python toolkit for parsing captions (in natural language) into scene graphs (as symbolic representations).

Overview: SceneGraphParser is a Python toolkit designed for parsing natural language sentences into scene graphs, providing symbolic representations of scenes based on dependency parsing. Key features: - Easy-to-use user interface - Configurable design - Supports both English and spaCy backend - Parses sentences into graphs with nodes as nouns and edges as relations Tech stack: Python Why it matters: This project is still under development, offering a unique approach to dependency parsing by utilizing Python for implementation, making it accessible and user-friendly. The toolkit is particularly useful in fields like computer vision and natural language processing, where symbolic representations of scenes are crucial.
Unknown 592 stars

changwookjun/nlp-paper

NLP Paper

### Overview: This repository contains a comprehensive list of papers and resources related to natural language processing (NLP). It serves as a valuable resource for researchers, developers, and enthusiasts interested in the latest advancements in NLP. ### Key Features: - **BERT Series**: Papers on pre-training deep bidirectional transformers for language understanding. - **Transformer Series**: Papers on transformer-based models for various NLP tasks. - **Transfer Learning**: Papers on applying pre-trained models for downstream tasks. - **Text Summarization**: Papers on techniques for generating concise summaries of text. - **Sentiment Analysis**: Papers on analyzing the sentiment of text. - **Question Answering**: Papers on methods for answering questions using text. - **Machine Translation**: Papers on translating text between languages. - **Surver paper**: Papers on surveys and reviews of NLP techniques. - **Downstream task**: Papers on specific NLP tasks such as QA MC Dialogue, Slot-filling, Analysis, Word segmentation parsing NER, Pronoun coreference resolution, Word sense disambiguation, Sentiment analysis, Relation extraction, Knowledge base, Text classification, WSC WNLI NLI, Commonsense, Extractive summarization, IR, Generation, Quality evaluator, Modification (multi-task, masking strategy, etc.), Probe, Multi-lingual, Domain specific, Multi-modal, Model compression, LLM, Reasoning and Chain of Thought, Alignment and RLHF, Retrieval Augmented Generation, LLM Agents and Tool Use, Long Context and Efficient Architectures, Efficient Training Inference and Serving, Pretraining Data