Case Study

RegImpact AI

AI-powered regulatory impact assessment for Indian fintech products, built to answer a specific question: can an AI compliance tool prove its findings are correct, not just produce them?

Product Strategy
AI Product
RegTech
FinTech
RAG
Explainable AI
V_01 / The Problem

Most AI compliance demos are good at generating plausible-sounding findings. Few of them can show their work — which specific clause a finding is based on, and whether the model quoted it accurately or paraphrased it into something that sounds right but isn't. For a regulated domain like RBI fintech compliance, an unverifiable citation is worse than no citation at all.

V_02 / Constraints
Budget$0 — free-tier AI inference and Supabase, by explicit choice, not a fallback.
TeamSolo build, portfolio timeline — not an enterprise team or roadmap.
Source dataA verified source document existed for one regulatory area (DLG), not the second (KYC/AML).
V_03 / Strategy Options

Cover every RBI regulation, shallowly

Looks impressive in a demo — until a reviewer checks one citation and finds it doesn't hold up. Breadth without verification is the fastest way to lose all credibility at once.

Not selected
Selected

Prove citation-verification depth-first, one area, then expand

Get the trust mechanism right on Digital Lending Guidelines end to end before adding a second regulatory area. Depth a reviewer can actually check beats coverage they can't.

Selected

Skip citations, ship findings faster

Faster to build, but defeats the entire premise — an AI compliance tool without a paper trail is exactly the "trust me" problem this project exists to solve.

Not selected
V_04 / Why AI, RAG, Adaptive Questioning

Why AI

Reading a product description against a regulation is language work, not arithmetic. The value isn't raw speed — it's applying the same standard every time, consistently, which manual review can't guarantee across reviewers.

Why retrieval, not memory

Findings are tested against real clauses pulled from a corpus at request time, never recalled from training data. At 19 clauses today, that's a direct filter, not embeddings-based search — a deliberate, disclosed scope limit, not a hidden one. See the architecture walkthrough for the honest version.

Why adaptive questioning

A generic intake form asks the same questions regardless of what you're building. The AI inference engine only asks the 3-5 questions that would actually change the compliance answer for this specific product.

V_05 / System Design
1
DescribePOST /api/synthesize
Plain-language product description in, product model + triggered regulatory areas out.
2
Understand(client-only)
Model mirrored back for the user to confirm or correct — no network call.
3
DiscoverPOST /api/questions
3-5 targeted clarifying questions, scoped to what the corpus can actually test.
4
AssessPOST /api/generate
Every clause tested and classified, streamed to the UI as each finding completes.
5
ReportGET /report/[id]
Findings, citations, and executive summary assembled into a shareable report.
V_06 / Tradeoffs

Shipping KYC/AML with an unverified flag, not leaving it out

No verified source document existed for KYC/AML — only general regulatory knowledge. Options were: leave it out, ship it looking as trustworthy as the verified DLG clauses, or ship it with an explicit "unverified — needs legal review" flag that follows the citation everywhere it's shown. Chose the third — hiding the uncertainty would have contradicted the entire premise of the project.

A daily hard quota, not trusting the model provider's own limit

Discovered live, during this build, that the AI inference engine's free-tier quota can be exhausted by normal testing volume. Rather than let the app depend on the provider's own rate limiting (and fail with a raw error when it hits), RegImpact enforces its own configurable daily cap in Postgres and refuses to call the inference engine at all once it's reached — a deliberate constraint, not an afterthought.

V_07 / Technical Decisions
  • Next.js (App Router) + React + TypeScript
  • Tailwind CSS
  • Supabase (Postgres)
  • AI inference engine (interchangeable model provider), via the Vercel AI SDK
  • Zod for schema validation at every AI boundary
V_08 / Product Success Metrics

RegImpact AI hasn't run against real reviewer traffic yet, so nothing below is a claimed result — it's the KPI framework I'd instrument on day one in production, the same way I'd define success metrics before shipping any product. The one thing already true today, structurally, is that every finding carries a citation — the rest needs real usage to measure.

Reviewer Acceptance RateShare of findings a compliance reviewer accepts without edits.The real test of citation trust — this is the metric the whole product is built to move.
Time-to-First-InsightElapsed time from product description submitted to the first finding surfacing.Compliance review today is measured in days; this is where AI assistance should show up first.
Compliance Review Time SavedReviewer hours on an AI-assisted assessment vs. a fully manual one.The business case for the product — speed without a trust tradeoff.
Citation Trust RateHow often reviewers escalate an unverified citation vs. a verified one.Tests whether the "needs legal review" flag actually changes reviewer behavior, or gets ignored.
Hallucination Flag RateHow often the evidence-consistency guard fires, and reviewer agreement with it.A flag reviewers routinely override is miscalibrated and needs retuning, not removal.
Assessment Completion RateShare of started assessments that reach a final report.Drop-off between Discovery and Report is the clearest signal of onboarding friction.
Adaptive Question EffectivenessShare of Discovery answers that actually changed a finding's classification.Justifies asking questions at all instead of a static intake form — proves it isn't decorative.
Retrieval PrecisionShare of retrieved clauses actually relevant to the declared product categories.Validates category-based filtering over testing the full corpus against every product regardless of fit.
V_09 / Product Roadmap

The current build proves the citation-verification approach end to end on two regulatory areas — Digital Lending Guidelines and KYC/AML — deliberately, before scaling breadth. Here's where the product goes from there.

Enterprise Collaboration & Team WorkspacesMultiple reviewers on one assessment, with role-based access instead of a single-owner admin gate.
Versioned Regulation UpdatesTrack when a regulatory clause changes and which past assessments relied on the superseded version.
Workflow IntegrationsPush findings into the tools compliance teams already work in — ticketing, GRC platforms, Slack.
Continuous Compliance MonitoringRe-assess automatically when either the product or the underlying regulation changes, not just on demand.
Regulatory Change AlertsNotify affected teams the moment a regulator amends a clause their product was assessed against.
Audit HistoryA full change log per assessment — every re-run, every edit, every reviewer decision, timestamped.
Explainable AI ImprovementsDeeper reasoning traces beyond evidence/citation — surfacing the model's full chain of inference on request.
Additional JurisdictionsSingapore, UAE, UK, and EU are already selectable at onboarding — the roadmap is building real regulatory corpora behind them.
Additional Regulatory DomainsPPI, UPI-specific rules, and insurance regulation, using the same citation-verification approach proven on DLG and KYC/AML.
Offline AssessmentA downloadable assessment kit for environments where a live AI call isn't an option.
Human-in-the-Loop ReviewA structured reviewer workflow for confirming, editing, or overriding a finding — with that decision feeding back into future assessments.
Policy ComparisonDiff two versions of the same product, or the same product against two regulatory regimes, side by side.

See the architecture walkthrough for exactly what's built today versus what's ahead.

V_10 / About the Creator

I'm Shriyashish Mishra, a Product Manager. I'm drawn to problems that start ambiguous — where the hard part isn't writing code, it's deciding what “correct” even means before you can build toward it.

AI products interest me because they make that ambiguity structural: a model can sound confident and still be wrong, and most products don't give a user any way to tell the difference. I think that gap — between confidence and correctness — is the actual product problem of this generation of AI tools, not a footnote to solve later. Trust and explainability aren't features you add on top; they're the design constraint everything else has to work within.

I built RegImpact AI to work that constraint end to end in a domain where it matters most — regulatory compliance, where an unverifiable answer is worse than no answer at all. See more of my work at my portfolio.