kgrep
Search, watch, and export Kafka topic records without writing a one-off consumer. Inspect topics, understand consumer-group lag, and work with Schema Registry from the command line.
Explore on GitHubARUN@PORTFOLIO:~$ LS ~/WORK
Built for the problems
behind the platform.
Selected open-source tools across Kafka, infrastructure, observability, and daily intelligence. Each one starts with a practical problem worth making easier.
40 SECONDS / 5 PROJECTS
Different problems. Different tools.
Choose a project to explore its own illustrated workflow.
Silent · Play at your paceRead the walkthrough
- kgrep: kgrep scans sample Kafka records, highlights matching order IDs, and exports the matching records to CSV.
- Terraform sandbox: Terraform plans a resource graph, creates an environment, cluster and dependent resources through the local mock provider, then destroys them in reverse order.
- Kafka latency: The latency profiler compares T1 and T2 timestamps on sample messages, displays per-partition timing spans, and builds a distribution. The displayed timings are simulated examples, not project benchmarks.
- Recycling intelligence: The recycling intelligence agent collects news, trade feeds and government updates, removes duplicate articles, scores local relevance and creates a Markdown briefing covering opportunities, regulation and coastal Karnataka.
- Equity intelligence: Global Equity Intelligence links policy changes, input costs and global news to company exposure. It groups related articles into events, scores their impact with explicit reasons, and publishes a daily briefing with source links and optional AI explanations.
confluent-terraform-mock
A local Confluent Cloud stand-in for running real Terraform plan, apply, and destroy workflows. Develop and test infrastructure changes in a local sandbox.
Explore on GitHubKafkaEndToEndLatency
A Kafka latency profiler that measures time between message timestamps and reports topic-wide and per-partition results to Kafka or CSV.
Explore on GitHubplastic-recycling-intelligence
A Python agent that collects public news and government updates, removes duplicates, and ranks plastic-recycling developments by relevance. Publishes daily briefings with explainable scores and a focus on Karnataka’s Udupi–Mangaluru coastal belt.
Explore on GitHubglobal-equity-intelligence
A Python agent that connects public news, company disclosures, and policy changes to an Indian-equity watchlist through company and supply-chain exposure. Groups related articles into events and publishes daily briefings with explainable impact scores, source links, and optional AI analysis.
Explore on GitHubMore experiments and tooling on github.com/arunherga ↗