hiep@hiepndev.pro
00

Selected projects

$ ls -lt ~/projects

No. 01

Jarvis

April 2026 – July 2026

Wearable AI Memory for Meta Ray-Ban Glasses

  • Built a real-time speaker identification pipeline for Meta Ray-Ban audio streams using Resemblyzer voice embeddings over a buffered WebSocket connection, dynamically mapping anonymous transcription labels to named contacts
  • Designed a conversational knowledge graph using Apache AGE (PostgreSQL), utilizing LLMs for Subject-Predicate-Object (SPO) triple extraction to surface context-aware contact briefings via graph traversal
WebSocketPostgreSQLLLMGitHub

No. 02

MiniAttention

April 2026 – June 2026

CUDA Attention Kernel

  • Implemented a tiled CUDA forward attention kernel featuring online softmax and shared-memory blocking, shifting arithmetic intensity from 7.5 to 131 FLOPs/byte to successfully transition the workload from memory-bound to compute-bound
  • Validated numerical correctness against PyTorch scaled_dot_product_attention across causal and non-causal paths within FP32 precision limits (zero absolute error); verified 99.8% of GPU time spent in-kernel via profiling
CUDAAttentionProfilingGitHub

No. 03

Bibo.AI

Feb 2025 – Dec 2025

Multilingual Children's Book Studio

  • Shipped a concurrent asset engine pairing a Go API with Celery/Redis workers to orchestrate parallel text, image, and voice generation
  • Implemented hybrid search pairing Elasticsearch and vector databases for semantic content recommendations in production
GoCeleryElasticsearchDemo

No. 04

IPELiNT

Fall 2023 – Spring 2024

AI Patent Analytics Platform

  • Led a 6-developer team to build a full-stack MERN application for automatic document parsing and patent analysis using GPT-4 with custom prompts, with a data pipeline to process 108GB of USPTO public patent application data for LLM training
  • Architected microservices for parsing PDFs to JSON, feeding custom prompts into LLM for inference, and generating PDF reports
React.jsExpress.jsNode.jsAWS DynamoDBAWS S3Amazon EKSSite