Skip to content
View rishikksh20's full-sized avatar
🖐️
Happy to help you !!!
🖐️
Happy to help you !!!

Organizations

@EpicGames @coala

Block or report rishikksh20

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
rishikksh20/README.md

Hi, I'm Rishikesh 👋

🧠 AI Research Engineer | 🎙️ Voice AI · LLMs · Agentic Systems · ⚡ Efficient Inference

I'm an AI Engineer & Researcher with ~8.5 years of experience in Generative AI, speech synthesis, LLM architectures, agentic systems, and AI infrastructure.

I enjoy implementing research papers from scratch, training and optimizing models, exploring GPU-level inference, and building real-world AI systems.

  • 🚀 Co-founder & CTO at Dubpro.ai (DeepSync Technologies) — building speech synthesis, multilingual AI, voice cloning, and generative audio technologies.
  • 🎙️ Former AI Consultant at MyClone.is (San Francisco) — worked on real-time Voice AI, digital personas, RAG, memory, and agent orchestration.
  • 📩 Email: rishikksh20@gmail.com

🔬 Research Interests & Engineering

  • LLMs & Architectures: Transformers, Hybrid/Linear Attention, SSMs, Mamba, model implementations from scratch.
  • Training & Post-training: SFT, RLHF, RLVR, GRPO, model distillation, and alignment.
  • Efficient Inference: Triton, CUDA, Flash Attention, KV caching, quantization, GPU memory and latency optimization.
  • Voice & Generative Audio: TTS, voice cloning, vocoders, neural codecs, diffusion, flow matching, real-time speech systems.
  • Agentic AI: Coding agents, MCP, multi-agent orchestration, RAG, persistent memory, tool calling, and sandboxing.

🚀 Featured AI Agent Projects

  • MyClone — Real-time Voice AI digital persona platform with RAG, persistent memory, voice cloning, and persona-aware conversations. LiveKit LlamaIndex FastAPI pgvector

  • Nexus Code Agent — CLI-first AI coding agent featuring MCP, sub-agents, skills, tools, session memory, context management, and sandboxed execution. AI Agents MCP Multi-Agent

  • Voice AI Agent — Real-time conversational AI with inbound/outbound Twilio calls, browser WebRTC, and text chat. Pipecat Twilio STT LLM TTS

🧠 LLM & Architecture Implementations

Minimal PyTorch implementations of modern model architectures, focusing on attention, SSMs, caching, decoding, and inference efficiency.

  • LFM2.5 2.6B — Hybrid convolution/attention LLM with Triton inference kernels.
  • Mamba-3 — Selective State Space Model implementation.
  • Qwen3.5 0.8B — Hybrid GatedDeltaNet + GQA architecture.
  • Gemma 3 270M — Lightweight LLM implementation and exploration.

🔊 Speech & Generative Audio Research

Selected open-source implementations from my work in speech synthesis, neural audio, and generative modeling:

  • Voxtral Codec — Neural audio codec with semantic/acoustic quantization.
  • NU-Wave — Diffusion-based neural audio upsampling.
  • iSTFTNet — Lightweight neural vocoder.
  • VocGAN — Real-time GAN-based neural vocoder.
  • AcademiCodec — Neural audio codec research.

Other paper implementations: ViViT · CvT · LocalViT · FNet · CoaT · SiT

🛠️ Tech Stack

AI & Research: PyTorch · Transformers · SSMs · RL/RLHF · Diffusion · TTS

Inference: Triton · CUDA · Flash Attention · vLLM · KV Cache · Quantization

Agents & Voice: MCP · RAG · LlamaIndex · LiveKit · Pipecat · Twilio

Backend & Infra: Python · FastAPI · PostgreSQL · Redis · Docker · AWS · GCP


🤝 Let's Connect

Open to AI research collaborations, challenging engineering problems, and ambitious AI projects.

🐙 GitHub · 𝕏 @ai_rishikesh · 📩 Email

Pinned Loading

  1. ViViT-pytorch ViViT-pytorch Public

    Implementation of ViViT: A Video Vision Transformer

    Python 560 71

  2. VocGAN VocGAN Public

    VocGAN: A High-Fidelity Real-time Vocoder with a Hierarchically-nested Adversarial Network

    Python 321 59

  3. ResUnet ResUnet Public

    Pytorch implementation of ResUnet and ResUnet ++

    Python 551 75

  4. FastSpeech2 FastSpeech2 Public

    PyTorch Implementation of FastSpeech 2 : Fast and High-Quality End-to-End Text to Speech

    Jupyter Notebook 237 53

  5. iSTFTNet-pytorch iSTFTNet-pytorch Public

    iSTFTNet : Fast and Lightweight Mel-spectrogram Vocoder Incorporating Inverse Short-time Fourier Transform

    Python 281 51

  6. convolution-vision-transformers convolution-vision-transformers Public

    PyTorch Implementation of CvT: Introducing Convolutions to Vision Transformers

    Python 225 34