Lily Gniedziejko

Lily Gniedziejko

B.S. Computer Science, University of Illinois Urbana-Champaign

I am an undergraduate researcher in xLab at UIUC, advised by Prof. Tianyin Xu. I work on reinforcement learning environments for evaluating and improving AI agents that diagnose and mitigate failures in production systems.

lilyg3 at illinois.edu · CV · Google Scholar · GitHub · LinkedIn

Education

Research Interests

AI agents are increasingly trusted to diagnose and mitigate failures in critical infrastructure, but how well they actually do so is largely unmeasured. Evaluating these “AI SRE” agents requires environments that reproduce the way real systems break.

I approach this through fault injection at different layers of the stack. In SREGym, I inject faults into live Kubernetes clusters and the distributed systems running atop it. My current work focuses on the network layer: evaluating how well agents perform root cause analysis in emulated data center and campus network fabrics. In addition, building those environments surfaces a prerequisite problem: to check an agent against the intended state of a system, that state has to be specifiable in the first place. My current work also explores how to leverage formal verification to specify networks and distributed system states.

Publications

arXiv preprint, 2026
SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios [pdf]
Jackson Clark*, Yiming Su*, Saad Mohammad Rafid Pial, Yifang Tian, Lily Gniedziejko, Hans-Arno Jacobsen, Yinfang Chen, Tianyin Xu (*co-primary authors)
CAIS '26 - 1st ACM Conference on AI and Agentic Systems
SREGym: A Live Training Ground for AI SRE Agents with High-Fidelity Failure Drills [pdf]
Jackson Clark, Yiming Su, Saad Mohammad Rafid Pial, Lily Gniedziejko, Tianyin Xu

Experience

AI Engineering Intern, Ciroos (May 2026 – present)
  • Enabled data centers as a reinforcement learning environment by designing and building a network fault-injection platform for scalable VXLAN/EVPN data center fabrics.
  • Built virtualized data centers using VMs running vendor network operating systems.
  • Created a live topology explorer that auto-discovers all nodes and links into an interactive graph, letting users click any node to run vendor CLI commands and view output inline.
  • Built Grafana dashboards backed by a Prometheus telemetry pipeline for live fabric monitoring.
  • Designed a reflective prompt optimization loop that boosted a lightweight model's root-cause-analysis performance to match a frontier model.
  • Evaluated AI SRE agents by simulating Kubernetes and multi-cloud infrastructure faults.
Research Intern, xLab, UIUC (June 2025 – present)
  • Designed misoperation as a new fault mechanism by deploying TiDB on Kubernetes and building a custom microservice on top of it, extending the benchmark's coverage to management-plane failures.
  • Created and deployed the Kubernetes-based application used for TiDB fault injection and mitigation.
  • Implemented MCP tools for LangGraph agents, including Jaeger and Prometheus observability tools.
  • Built an automated distributed testing tool using tmux-based parallel execution to inject faults across remote nodes.
  • Created a trace visualization tool converting JSONL agent outputs into readable HTML, streamlining evaluation and debugging for the research team.
Software Engineering Intern, Mueller Water Products (May – September 2025)
  • Developed an internal chatbot that processes over 1,500 technical PDFs, including 400+ page manuals and engineering drawings, to assist the maintenance team, reduce downtime, and link directly to exact pages in source documents.
  • Created a Microsoft Teams bot that makes SQL queries and outputs Power BI dashboards.
  • Implemented a full-stack data entry application for autopour and melting machines.

Research

SREGym is a high-fidelity, interactive benchmark for AI Site Reliability Engineering: 90 SRE problems spanning hardware, OS, misoperation, and application-level faults across Kubernetes, TiDB, MongoDB, and Kafka. It models production complexity through noise injection and diverse failure modes, including metastable and correlated faults; agents diagnose and mitigate using Prometheus, Loki, and Jaeger MCP servers. SREGym is used by researchers at Microsoft Research, Resolve AI, TierZero (acquired by Cognition), the University of Washington, and SRE startups. [site] [code] [press]

Selected contributions:

Poster Sessions & Talks

News

Awards

Service & Leadership