POD 05

Secure AI & Model Ethics

Auditing adversarial threat vectors in open-weight language models and measuring demographic parity in automated evaluation pipelines. We build standardized red-teaming test suites mapped to OWASP and MITRE ATLAS security frameworks to detect jailbreaks, indirect prompt injection, and bias transfer.

2Investigated Projects
0Published Artifacts
Varun T.Pod Anchor
Cycle 2026.1Active Cohort

Core Research Questions

  1. Which prompt injection attack vectors reliably bypass system prompt boundaries across quantized 7B-parameter models?
  2. How can disparate impact metrics be baked into continuous integration pipelines for tabular screening heuristics?
  3. What verifiable watermarking schemes survive temperature sampling and paraphrase attacks?

Scientific Methodology

◆Automated adversarial prompt fuzzing and boundary probing
◆Demographic parity and equalized odds statistical auditing
◆Model card and dataset lineage validation protocols
◆MITRE ATLAS threat matrix mapping

Investigated Projects (2)

All lab projects →