Steve Lerner's GitHub: Cloud, AI, OpenTelmetry, Observability, OpenAPI, DevOps, Network Engineering, Infra-As-Code
A collection of hands-on demonstrations and training materials focused on modern cloud-native technologies, observability, distributed systems, and AI/ML engineering.
Quick Overview:
- inferencerouter: OpenAI-compatible gateway that auto-routes requests between on-prem models and Claude based on data sensitivity and task complexity
- tinyolly: The World's First Desktop Observability Platform! 100% OpenTelemetry Native
- edot: Elastic Distro of OpenTelemetry demo with TinyOlly visualization
- agentic-ai-training: Agentic AI with ReAct patterns, tool calling, and model training fundamentals
- agentic-ai: Simple agentic AI demo with ReAct loop and observability
- kafka: Distributed streaming platform with producers, consumers, and real-time web UI
- openapi: Microservices platform with API Gateway and interactive OpenAPI documentation
- terraform: Infrastructure as Code demonstration with Docker orchestration
- networkdemo: Advanced Docker networking with VLANs, routing, DNS, and interactive visualizations
- otelworkshop-original: OpenTelemetry workshops and observability training (fork, authored by me)
- A ~200-line OpenAI-compatible gateway that auto-routes each request between an on-prem model and Claude on two deterministic axes: data sensitivity and task complexity
- Sensitive data and simple tasks stay local; non-sensitive, complex queries route to Claude
- Live operations console, editor integrations (Zed, VS Code), and safe fallback to local inference if the cloud API is unavailable
- Built with Python, Ollama (on-prem), and the Anthropic Claude API
- The World's First Desktop Observability Platform - lightweight OpenTelemetry-native observability platform for local dev of OpenTelemetry logs/metrics/traces in your apps
- AI Agents Tab: GenAI observability with LLM call tracking (prompts, responses, token usage, latency) via OpenTelemetry GenAI semantic conventions
- OpAMP Configuration: Remote OpenTelemetry Collector configuration management via OpAMP protocol with real-time validation
- Cardinality Explorer & Protection: Deep-dive into metric attributes with label analysis, raw series view, PromQL export, and visual warnings
- Service catalog with RED metrics, interactive service dependency map, distributed trace waterfall, and real-time metrics - all with full OTLP support
- Elastic Distribution of OpenTelemetry (EDOT) Collector demo, paired with TinyOlly for local visualization
- Demo apps generate real traffic/telemetry through the full pipeline
- Sherlock Holmes Agentic AI Demo: Teaches Llama 3.1 to become a consulting detective
- True Fine-Tuning: Apple's MLX framework for LoRA training on Mac GPUs
- Key Concepts: ReAct pattern, Tool Calling, LoRA, Token Efficiency
- Built with Python, Flask, MLX, and Ollama
- Simple agentic AI demo: ReAct (Reason → Act → Observe) loop with full observability
- Per-step token/timing metrics, tool intelligence, and a clean web UI
- Designed for macOS with Docker Desktop
- Apache Kafka streaming platform: multiple producers, consumers, topics, real-time web UI
- Consumer groups, partitioning, message delivery guarantees
- Built with Python, Docker Compose, and Kafka 3.6
- Next.js 15 demo comparing rendering strategies (SSG, SSR, ISR, Edge)
- Real-time weather data and OpenAI-powered chatbot, deployed on Vercel's edge network
- Infrastructure as Code demo: Terraform-provisioned Flask + PostgreSQL + Nginx stack on Docker
- Idempotent deployment via automated scripts and Makefile
- Microservices platform with API Gateway and interactive OpenAPI 3.0 documentation
- Products, Users, and Orders APIs with unified catalog and health monitoring
- Built with FastAPI and Docker
- Advanced Docker networking: multi-VLAN routing, DNS, DHCP, HTTPS, NAT/firewall
- Interactive webapp for exploring network topologies
- Built with Docker Compose, Python Flask, and Makefile automation
- Battle-tested DevOps techniques, scripts, and best practices for real-world infra/ops
- RetroPie setup for an X-Arcade Tankstick Max on Raspberry Pi (bookworm)
- Documents hardware fixes for input drivers, XRDP, and audio routing
- Archived Redis-backed version of TinyOlly, superseded by the current build
I've authored comprehensive observability training workshops used by engineering teams:
otelworkshop-original (fork, authored by me)
- OpenTelemetry workshops originally created at SignalFx
- Hands-on labs: instrumentation, exporters, collectors, tracing, metrics
cxworkshops (fork, authored by me)
- Coralogix observability workshops: log aggregation, metrics, APM, alerting, tracing
These workshops help teams transition to modern observability practices.
- Xarcade2Jstick (fork, authored by me): Patched user-space driver mapping the X-Arcade Tankstick to two gamepads
- bitdrift-public (fork, authored by me): bitdrift Solution Architects public repository
- LinkedIn: linkedin.com/in/stevelerner
- GitHub: @stevelerner


