Pinned Loading

1. llm-eval-harness llm-eval-harness Public

   LLM eval harness for RAG systems: retrieval quality, hallucination detection, answer correctness, cost and latency tracking. LLM-as-judge scoring with Claude.

   Python

2. pipeline-doctor pipeline-doctor Public

   LLM-powered data quality system: detects anomalies (nulls, zeros, outliers) in BigQuery datasets using statistical analysis, then calls Anthropic Claude to generate natural-language diagnosis and e…

   Jupyter Notebook

3. curriculum-engine curriculum-engine Public

   Hybrid RAG pipeline: Claude Haiku generates a structured learning plan with search queries; live YouTube Data API + Serper.dev retrieve and validate every resource link. Prompt caching cuts input t…

   Python

4. customer-event-pipeline customer-event-pipeline Public

   3-stage Kubeflow Pipelines (KFP v2) ML pipeline on Vertex AI: BigQuery extraction → feature engineering → scikit-learn model training with full artifact lineage tracking. Components run in isolated…

   Python

5. customer-event-flink customer-event-flink Public

   PyFlink streaming pipeline: Kafka → 5-minute tumbling event-time windows → per-customer spend aggregation. Handles late-arriving events with watermarks and BoundedOutOfOrderness strategy.

   Python

6. snowflake-pipeline snowflake-pipeline Public

   End-to-end ELT pipeline: Python → Snowflake → dbt (3-layer modeling) → Apache Airflow orchestration. Incremental loading, data quality tests, GitHub Actions CI.

   Python