Why ChatGPT and a GRC Consultant Is Not a Compliance Program

Why “ChatGPT + a GRC consultant” Isn’t a Compliance Program

Talia Baxter

Head of Brand

Linkedin

We’ve been hearing a version of this a lot lately:

“Why would we pay for a compliance platform when we can hire a GRC consultant and run Claude or ChatGPT alongside them? Same output, lower cost, no vendor lock-in.”

This isn’t fringe. It’s a coherent argument. 

Large language models are genuinely good at drafting information security policies. They map controls well. They generate questionnaire responses for vendor reviews. If your goal is to produce compliance documents, a capable consultant armed with a frontier AI model can get there faster and cheaper than they could three years ago.

The problem is that documents are about 10% of what compliance actually is.

The 90% you should be talking about

Compliance isn’t a documentation problem. It’s an evidence problem, a monitoring problem, and an accountability problem. Let’s walk through what that means in practice.

1. Evidence collection at scale

A well-drafted access control policy is not evidence that your access controls work. Evidence is access logs from Okta cross-referenced against your HR system, provisioning records from GitHub showing that offboarding happened within your SLA, AWS CloudTrail entries proving that privileged access reviews ran on schedule, and Jamf reports confirming device compliance.

Collecting that evidence manually, across 30, 40, or 50 integrated tools, then normalizing it into a format your auditor accepts, then doing it again next quarter, is not something a consultant and a chatbot can automate. A language model has no authenticated connection to your environment. It cannot pull your data, validate your controls, or prove on any given Tuesday afternoon that your policies are being followed.

Compliance requires a continuous, integrated evidence layer. A document factory doesn’t build one.

2. Continuous monitoring vs. point-in-time snapshots

Here’s a scenario that plays out constantly: a company completes a SOC 2 audit, passes, and then six months later an engineer makes a configuration change that disables MFA for a service account. Nobody notices. The next audit rolls around and the auditor finds the gap. Now, there’s a finding, an exception to explain, and a question about how long the control was broken.

A consultant with an AI assistant produces snapshots. They assess your environment at a point in time, document what they find, and move on. The gap between engagements is where risk lives.

Purpose-built compliance tooling watches controls continuously and surfaces drift the moment it happens, not at the next audit, not when a customer’s security review catches it, not after a breach. That operational difference isn’t a feature distinction. It’s a fundamentally different category of product.

3. Auditor trust doesn’t transfer

This is the least visible cost of the DIY approach, and often the most painful.

When you build a compliance program on top of a general-purpose LLM, you’re generating control language, framework mappings, and evidence formats that your auditor has never seen before. Every audit cycle, you’re re-explaining your methodology, re-defending your control interpretations, and re-negotiating what constitutes acceptable evidence.

Established compliance platforms carry pre-vetted framework mappings and evidence standards that auditors already trust. That trust was built over years of actual audits with actual auditors. It doesn’t exist in a bespoke program built on generic AI, and building it from scratch is expensive in both time and risk.

4. Institutional memory doesn’t survive consultant transitions

Ask any compliance team what happens when a consultant rolls off after 12 months. The answer is almost always the same: the tribal knowledge leaves with them. What was the reasoning behind a particular control interpretation? Why was that compensating control accepted? What did the auditor push back on last year and how was it resolved?

General-purpose AI models have no memory between sessions. A consultant’s notes live in their head, their personal files, or a handoff document that gets outdated immediately. Scytale‘s agents accumulate context about your specific environment, i.e. your integrations, your history, your prior audit findings, and that context compounds over time. The program gets smarter as your business evolves. That doesn’t happen with a rotating cast of humans and a stateless chatbot.

5. Accountability isn’t optional

When an audit produces a finding, someone is accountable. “Claude told me to” is not a defense in an audit room, and it won’t satisfy an enterprise customer’s security review team or a regulator asking questions about your controls.

A consultant disclaims. An LLM vendor has no liability for your compliance posture. A purpose-built compliance platform carries SLAs, maintains auditor relationships, and stands behind the quality of what it produces. That accountability is part of what you’re buying, and it has real value when things get complicated.

The math doesn’t hold up

The “cheaper alternative” framing tends to collapse when you model it out honestly. Stack consultant fees against the internal time required to manage them. Add the labor cost of manual evidence collection across multiple tools. Factor in the overhead of running parallel programs when SOC 2, ISO 27001, and HIPAA need to share a control set. Include the cost of re-explaining your methodology to a new auditor who’s never seen your bespoke framework.

By most calculations, the “build it yourself” option costs more than a purpose-built platform within 18 months, before you account for the opportunity cost of your team’s time or the risk cost of a control gap that monitoring would have caught.

What the DIY approach is actually saying

The buyer who raises this objection is usually communicating something real: generic compliance platforms haven’t been customized enough for their business. That’s a legitimate frustration, and it’s worth acknowledging directly.

The right reframe isn’t “AI versus no AI.” It’s asking which AI: a general-purpose model that has to be re-prompted every session and has no connection to your environment, or compliance-specific agents that know your business, know your frameworks, and get smarter over time on both.

The question to ask back is simple: How will you collect evidence across your tools, continuously, without an integration layer? Who’s accountable to the auditor when something fails?

A consultant with a chatbot gives you a smarter document factory. That’s genuinely useful for the 10%. The 90% including evidence, monitoring, institutional memory, auditor trust, accountability, requires infrastructure that’s purpose-built for the job.

AI-native GRC for how teams work today.

Scytale G2 badge

The category is moving

Generic AI will keep getting better at drafting policies and mapping controls. That’s good for the industry. It raises the floor on what’s table stakes.

But the compliance problem was never really a document problem. It’s an operating problem i.e. running controls continuously, proving they work, and carrying accountability when they don’t. That’s what a compliance operating system does. It’s what a document factory, no matter how sophisticated, cannot.

If you’re evaluating your options, the right questions aren’t about document quality. They’re about what happens between the documents.

Talia Baxter

Talia Baxter

With over four years of experience in B2B SaaS marketing, Talia Baxter is the Head of Brand at Scytale and has played a key role in shaping the company’s brand and messaging around major security and data privacy frameworks like SOC 2, ISO 27001, GDPR, HIPAA, PCI DSS, and more. Talia leads brand, content, SEO, and product marketing... Read more

Share this article

SOC 2 For Startups.

If you are up against
SOC 2 then this is for you.

SOC 2 For Startups eBook