Projects

Overview: This project provides a Python package for exploring large language models, designed to be lightweight and private, requiring only 512MB of RAM for inference. Key features: - Inference performed locally to keep data private. - Supports Python building blocks for easy usage of large language models. - Includes examples for basic usage, including translation, model performance adjustments, GPU acceleration, text completions, external retrieval, and semantic search. Tech stack: Python, PyPI, Lint, Test, Colab. Why it matters: This package simplifies the use of large language models in Python, making it accessible without the need for significant data storage or high computational resources, making it ideal for developers and researchers on limited hardware. Repository: jncraton/languagemodels GitHub stars: 1189

Overview: This repository contains code for DeepGCNs, a deep graph convolutional network framework that aims to replicate the success of deep convolutional neural networks (CNNs) in the context of graph data. The project includes implementations of various types of DeepGCNs, such as Multi-Resolution Graph Convolutional Networks (MRGCN), EdgeConv, GraphSage, and GIN, along with ablation studies on different components of these networks. Key features: - Implementations of various types of DeepGCNs - Ablation studies on different components of DeepGCNs - Extensive experiments to show the positive effect of different components on the performance of DeepGCNs Tech stack: Pytorch Why it matters: This project provides a comprehensive framework for training and evaluating deep graph convolutional networks, demonstrating the potential for deep learning to be applied to graph data in a similar manner to CNNs.

### Overview: Foundation Lab is a comprehensive iOS and macOS workbench designed for learning, testing, and shipping with Apple's Foundation Models framework. It streamlines the process by keeping all necessary components in one place, including prompts, configurations, and run evidence. ### Key features: - **Editable Recipes**: Open a recipe in the Playground and make changes, then run it immediately. - **Custom Prompts and Tools**: Compose prompts and tools, inspect runs, compare adapters, and export reproducible evidence. - **Focused Labs**: Compose custom prompts and tools, inspect every run, compare adapters, and export reproducible evidence from the app. ### Tech stack: Swift ### Why it matters: Foundation Lab simplifies the process of building, testing, and shipping apps with Apple's Foundation Models framework, making it easier to learn, test, and ship projects quickly and efficiently.

Overview: SearchCLI is an open command-line interface (CLI) designed for integrating AI search, recommendation, and conversational retrieval into agent systems and business systems. It provides a stable and tunable path for external agents to access production-grade search, recommendation, and conversational retrieval services. Key features: - Stable integration of AI search, recommendation, and conversational retrieval - Installable skills for external agents to onboard data, build flows, and validate runtime behavior - Reviewable execution model with dry-runs, confirmation gates, and read-after-write verification Tech stack: TypeScript Why it matters: SearchCLI simplifies the integration of AI-powered information distribution into business systems, enabling developers, teams, and operators to access stable, configurable, and reviewable search, recommendation, and conversational retrieval workflows. Repository: volcengine/SearchCLI Primary language: TypeScript GitHub stars: 1189

Overview: Secure, enterprise-ready landing zone for deploying AI agent applications on Microsoft Foundry. Key features: - Infrastructure and agent application deployment - Zero-Trust networking - Observability - IaC-first deployment Tech stack: Python Why it matters: Provides a secure, enterprise-ready environment for deploying AI agent applications on Azure, including infrastructure and agent applications. Repository: Azure/agent-landing-zone Primary language: Python GitHub stars: 1187

Overview: This repository provides a battle-tested setup for Claude Code, OpenAI Codex, and Cursor, including skills, commands, hooks, subagents, and GLM API support. It also includes Kimi, MiniMax, and Cursor agent plugins. Key features: - Claude Code setup - OpenAI Codex setup - Cursor setup - Skills, commands, and automations - GLM API support - Kimi, MiniMax, and Cursor agent plugins Tech stack: Python Why it matters: This setup aims to address common issues with Claude Code, Codex, and Cursor, providing a cleaner, more efficient setup that avoids overcomplication and dead code.

### Overview: NLP-IN-PRACTICE is a repository containing starter code and tools for solving real-world text data problems. It includes examples of large-scale phrase extraction, word cloud visualization, Gensim Word2Vec implementation, text classification with Logistic Regression, and more. The repository is designed to help developers tackle various NLP, text mining, and machine learning challenges. ### Key Features: - **Large Scale Phrase Extraction**: Extract phrases from large amounts of text using PySpark. - **Word Cloud for Jupyter Notebook and Python Web Apps**: Visualize top keywords using word counts or tfidf. - **Gensim Word2Vec**: How to work correctly with Word2Vec to get desired results. - **Reading Files and Word Count with Spark**: How to read files of different formats using PySpark with a word count example. - **Extracting Keywords with TF-IDF and SKLearn**: How to extract interesting keywords from text using TF-IDF and Python's SKLEARN. - **Text Preprocessing**: Code snippets on how to perform text preprocessing, including stemming, noise removal, lemmatization, and stop word removal. - **TFIDFTransformer vs. TFIDFVectorizer**: How to use TFIDFTransformer and TFIDFVectorizer correctly and the difference between the two. - **Accessing Pre-trained Word Embeddings with Gensim**: How to access pre-trained GloVe and Word2Vec Embeddings using Gensim and an example of how these embeddings can be leveraged for text similarity. - **Text Classification in Python (with news dataset

Overview: Gaussian-SLAM is a project that focuses on implementing photo-realistic Dense SLAM using Gaussian Splatting. The project includes a detailed README with instructions on setting up the environment, running the code, and reproducing results. The code is available on GitHub and has been used on various GPUs and operating systems. Key features: - Photo-realistic Dense SLAM with Gaussian Splatting - Environment setup with conda - Data downloading scripts for Replica, TUM_RGBD, ScanNet, and ScanNet++ - Running the code with specific configurations and paths - Reproducing results for single scenes and datasets - Demonstration of fly-through video using Gaussian Splatting Tech stack: Python Why it matters: This project is significant for developers interested in dense SLAM and photo-realistic rendering, offering a practical implementation of Gaussian Splatting techniques in SLAM.

### Overview: The "Treasure of Transformers" repository contains a collection of all the latest and most advanced NLP deep learning algorithms, including GPT-Neo, Transformer, BERT, and GPT. This repository is designed for developers and researchers interested in exploring and implementing cutting-edge NLP models. ### Key Features: - **GPT-Neo**: A state-of-the-art language model developed by EleutherAI. - **Transformer**: A powerful model introduced in 2017. - **BERT**: A pre-trained language model that has revolutionized NLP. - **GPT**: Another state-of-the-art language model developed by Hugging Face. ### Tech Stack: Jupyter Notebook ### Why It Matters: This repository is essential for developers and researchers looking to stay updated with the latest advancements in NLP. It provides a comprehensive collection of models and their implementations, making it a valuable resource for anyone working on NLP projects.

Overview: Hephaestus is a semi-structured agentic framework designed to dynamically build workflows based on agents discovering what needs to be done, rather than being confined to predefined instructions. Key features: - Agents can create tasks in any phase they discover, rather than being restricted to predefined branching logic. - Phase types like "Analysis," "Implementation," and "Validation" guide the workflow. - It's a Python project with 1,184 GitHub stars and an alpha status. Tech stack: Python. Why it matters: This framework allows for more flexible and adaptable workflows, enabling agents to discover and address real-world problems without being constrained by pre-written instructions, leading to more innovative and efficient solutions.

### Overview: Performer is an implementation of the Performer model, a linear attention-based transformer variant. It is designed to be efficient and fast, leveraging a FAVOR+ approach for improved performance. This model is particularly useful for applications requiring high-speed autoregressive capabilities. ### Key Features: - **Efficient Attention Mechanism**: Utilizes a FAVOR+ approach to achieve fast attention. - **Linear Attention**: The model employs linear attention, making it suitable for various modalities like images and other data types. - **Modular Architecture**: The Performer model is designed to be modular, allowing for easy integration with different types of data. - **Flexibility**: The model supports both encoder and decoder configurations, making it versatile for various tasks. ### Tech Stack: - **Programming Language**: Python ### Why It Matters: The Performer model is particularly valuable in scenarios where high-speed processing is crucial, such as in natural language processing (NLP), image processing, and other applications requiring real-time or near-real-time processing. Its fast attention mechanism and modular design make it an attractive choice for applications where performance is a critical factor. ### Repository: The repository is named `lucidrains/performer-pytorch`, and it has been starred by 1,184 developers, indicating its popularity and utility in the community. ### Install: To use the Performer model, you need to install it via pip: ```bash $ pip install performer-pytorch ``` ### Usage: The Performer model can be used for various tasks, including language modeling,

### Overview: Wunjo is a powerful open-source tool for face swapping, lip syncing, object control, text removal, background restoration, and more. It's designed to be both local and free, making it accessible to everyone. ### Key features: - Face swapping - Lip syncing - Object control - Text removal - Background restoration - Restyling - Audio separator - Clone voice - Video generation ### Tech stack: C++ with Qt 6 and KF6 ### Why it matters: Wunjo offers a comprehensive set of features for video manipulation, making it a valuable tool for content creators, educators, and anyone looking to enhance their videos. Its open-source nature ensures it remains free and accessible to all, making it a versatile solution for various creative projects.

### Overview: HyperGAN is a composable GAN framework that simplifies the process of training, inspecting, and recovering GAN models. It supports native CUDA training, flexible Python components, and a functional API for easy integration into projects. ### Key Features: - **Composable GAN Framework**: Configurable and practical GANs with a user-friendly interface. - **Native CUDA Training**: Supports CUDA training for efficient performance. - **Flexible Python Components**: Easy integration with Python code. - **Complete Training Checkpoints**: Saves and loads training checkpoints for easy recovery. - **CLI for Live and Historical Runs**: Docker-style CLI for managing runs from any directory. - **Web Observatory**: Provides a local Web Observatory for monitoring and inspecting models. ### Tech Stack: - Python 3.12+ - PyTorch 2.14.0 ### Why It Matters: HyperGAN simplifies the process of training, inspecting, and recovering GAN models, making it easier for developers to integrate GANs into their projects. The framework supports native CUDA training, flexible Python components, and a functional API, making it a powerful tool for researchers and developers alike.

### Overview: This repository contains a curated collection of books and references for various fields of programming, including Computer Vision, Machine Learning, Deep Learning, NLP, Python, and more. It offers over 200+ programming ebooks at no cost, making it an excellent resource for anyone looking to enhance their knowledge in these areas. ### Key Features: - Comprehensive coverage of Computer Vision, Machine Learning, Deep Learning, NLP, Python, and more. - Over 200+ programming ebooks available in one place. - No cost for accessing the ebooks. - Includes detailed guides for beginners, such as a roadmap for AI/ML (AIML) and a practical AI/ML roadmap. ### Tech Stack: None specified. ### Why It Matters: This repository serves as a valuable resource for developers looking to expand their knowledge in various programming fields. The ebooks cover a wide range of topics and are available for free, making it an ideal choice for those seeking to improve their skills without the financial burden of purchasing expensive textbooks.

### Overview: This series will guide developers through the foundational concepts of Natural Language Processing (NLP) and Computer Vision, culminating in the cutting-edge Vision-Language Models (VLMs). The series will cover essential topics such as distributed word representations, sequence-to-sequence learning, attention mechanisms, and the development of early and modern vision-language models. ### Key Features: - **Word2Vec with Sub-Sampling and Negative Sampling in PyTorch** - **Seq2Seq Models** - **Attention Mechanisms** - **BERT and GPT** - **Early Vision-Language Models** - **CLIP** - **Modern Vision-Language Models** ### Tech Stack: Jupyter Notebook ### Why It Matters: This series will provide a comprehensive and practical guide for developers looking to understand and implement state-of-the-art Vision-Language Models. By following the tutorials and reading the accompanying papers, developers will gain the knowledge and skills necessary to tackle complex NLP and CV tasks, including image captioning, visual language understanding, and more.

### Overview: This repository offers a comprehensive set of simulated manipulation policy evaluation environments for real robot setups, specifically designed to complement real-world evaluations. It provides valuable quantitative metrics and standardized setups for evaluating robot manipulation policies. ### Key features: - **Real-to-Sim Evaluation**: The repository includes two real-to-sim evaluation setups, including visual matching and variant aggregation, to simulate real-world environments efficiently. - **SAPIEN and ManiSkill2 Benchmark Integration**: Utilizes the SAPIEN simulator and the ManiSkill2 benchmark, with GPU parallelization for faster execution. - **Standardized Environments**: Offers a standardized setup for reproducibility, making it easier to evaluate and compare different policy approaches. ### Tech stack: Python with Jupyter Notebook and PyTorch. ### Why it matters: This repository simplifies the evaluation of robot manipulation policies by providing efficient and scalable simulation environments, enabling researchers to test and compare their policies more effectively and efficiently.

### Overview: 이 리소스는 개발자들이 필요한 모든 정보를 한 곳에汇聚합니다. AI 도구, 공식 문서, 커뮤니티 등 다양한 리소스를 제공하여 개발 과정에서 필요한 모든 정보를 한 곳에서 찾을 수 있습니다. ### Key features: - [AI 개발 도구](#ai-dev-tools) - Cursor, Claude Code, bolt.new 등 - [AI 디자인 도구](#ai-design-tools) - Figma AI, Galileo 등 - [대화형 AI](#conversational-ai) - ChatGPT, Claude, Gemini, DeepSea - [개발 도구](#development-infra) - Git, Docker, Kubernetes 등 - [커뮤니티](#tech-community) - Stack Overflow, GitHub, Reddit 등 ### Tech stack: Node.js, React, Express, Docker, Kubernetes ### Why it matters: 이 리소스는 개발자들이 필요한 모든 정보를 한 곳에汇聚하고, 다양한 AI 도구와 커뮤니티를 제공하여 개발 과정에서 필요한 모든 정보를 한 곳에서 찾을 수 있습니다.

Overview: This repository contains datasets and code for the paper "Benchmarking Neural Network Robustness to Common Corruptions and Perturbations" by Dan Hendrycks and Thomas Dietterich, presented at ICLR 2019. Key features: - ImageNet-C datasets with 1000 classes and 224x224x3 images - Tiny ImageNet-C datasets with 200 classes and 64x64 images - CIFAR-10-C and CIFAR-100-C datasets for quicker experimentation - ImageNet-C leaderboard with robustness metrics for various methods Tech stack: Python 3+, PyTorch 0.3+ Why it matters: This repository provides a comprehensive benchmark for evaluating the robustness of neural networks to common corruptions and perturbations, helping researchers and practitioners understand the effectiveness of various robustness techniques.

### Overview: RAG Search API is a powerful tool for developers looking to integrate advanced search functionality into their applications. It provides a simple and efficient way to perform semantic search using the latest AI techniques. ### Key features: - **Semantic Search**: RAG Search API uses AI models to understand and interpret the context of search queries. - **Customizable Search Providers**: Supports multiple search providers, including Google, Bing, and more. - **Detailed Results**: Retrieves detailed search results with improved relevance and accuracy. - **Reranking**: Enhances the search results by re-ranking based on user preferences. ### Tech stack: Python ### Why it matters: RAG Search API is essential for developers who need a robust and efficient search solution that leverages the latest AI techniques to provide accurate and relevant results.

### Overview Punica is a system designed to serve multiple LoRA finetuned language models efficiently. It optimizes the storage and memory usage by leveraging the parameter efficiency of LoRA, which only adds a small percentage of storage and memory overhead. ### Key Features - **Efficient Storage and Memory Usage**: By using LoRA, Punica reduces the storage and memory footprint of each model by 1%. - **Batching Effect**: The pretrained model's batching effect is preserved, making it highly efficient. - **CUDA Kernel Optimization**: A CUDA kernel called Segmented Gather Matrix-Vector multiplication (SGMV) is used to efficiently compute the LoRA addon. - **High Throughput**: Punica achieves 12x throughput compared to state-of-the-art systems, making it highly scalable for multi-tenant environments. ### Tech Stack - Python - CUDA ### Why It Matters Punica is crucial for applications that require serving multiple LoRA finetuned language models, such as multi-tenant environments where each tenant needs a different model. Its ability to maintain the strong batching effect and high throughput makes it an essential tool for such scenarios.