THIS EXPLANATION
THE ROOM
CDA·220 Computing, Data & AI 7 MIN · 8 STATIONS

The audit record as the product

A Socratic walk-through of the audit record as the product — reasoned out one step at a time, not lectured.

abcdefgh
a

The question we started with

THE QUESTION #

When an automated system acts on your behalf, why is the log of what it did worth more than the result?

You asked an assistant to tidy up an old project, and it did. The folder looks right. The result is in front of you and it is fine.

Now suppose that a month later someone asks why a particular file is gone. The folder cannot answer. It shows a state, not a history — and the state is consistent with a dozen different sequences of events, some of which you would have approved and some of which you would not. So here is the awkward question: if the outcome cannot tell you whether the right thing happened, what exactly did you receive when you received the outcome?

b

Reasoning it through

REASONING #

Begin by separating two things that ordinarily travel together: what happened, and whether it should have. When you do a job yourself, the second question is answered by your own memory, and you rarely notice you are relying on it. Delegate the job, and that memory is gone — unless something wrote it down.

Now ask what the outcome, on its own, can establish. It can show the end state. It cannot show which of several paths reached it. It cannot show what was nearly done and abandoned. It cannot show what the agent read along the way, which matters enormously if any of it was confidential. And it cannot show whose authority was used — your credentials, a service account, something inherited from an earlier step. All of those are questions about the process, and a result is not a process.

Is this any different from ordinary software? Somewhat, and the difference is worth being precise about. A deterministic program's behaviour can be reconstructed by rerunning it: same inputs, same path. An agent's cannot, and not merely because sampling makes it stochastic — its inputs include a world that has since changed. Rerun the same request tomorrow and it may take a different route for entirely good reasons. So the usual fallback, reproduce it and see, is unavailable. The contemporaneous record is not a convenience; it is the only evidence there will ever be.

Then there is the question of authority, which delegation splits in two. The identity that acted is the agent. The identity that is answerable is you. Those are different, and a log that records only one of them cannot answer the question anyone actually asks after an incident, which is not "what ran?" but "on whose behalf, and who agreed to that?" This is why delegated-authority systems record a chain rather than an actor — principal, delegate, scope, and the moment of consent — and why an entry naming only the service account is nearly worthless.

Notice what follows for design. If the record is the thing that carries accountability, then the record cannot be a by-product of the action written by the actor at its own discretion. An agent that logs its own conduct is a witness testifying about itself; it can omit, and it can be manipulated by the very input it was processing. The stronger arrangement is that the log is written at the boundary — by whatever gateway grants the credential and forwards the call — so that nothing can act without leaving the record, because the record is produced by the same component that permits the action.

And once that is true, something inverts. The action becomes the side effect of the audited event, rather than the audit being a side effect of the action. That is what the phrase "the record is the product" means: not that the outcome is worthless, but that the outcome is the part you can see and the record is the part that makes it accountable, and only one of those two can be reconstructed later.

c

The analogy

THE ANALOGY #
THE FIGURE

Think of a prescription. The medicine is what the patient wanted, and after it is taken there is nothing left to inspect. What persists is the script: who prescribed it, for whom, on what date, at what dose, dispensed by which pharmacist. If a harm surfaces months later, no one examines the empty bottle — the entire investigation runs on that record, and a pharmacy that dispensed correctly but kept no script has nothing to offer in its own defence.

WHERE IT BREAKS DOWN

a prescription is written before the medicine is handed over and signed by two parties who are answerable, whereas a system log is usually written by the acting component after the fact — which is why an audit trail must be produced somewhere the actor cannot edit, or it carries far less weight than the analogy suggests.

d

Clarifying the model

THE MODEL #

Three refinements, one of them a caution.

First, a record that only names actions is thin. What makes a trail reconstructable is that each entry carries the things that cannot be inferred: which principal, under what delegated scope, with what arguments, against what resource version, and what came back. "Deleted file" tells you nothing you could not have guessed. "Deleted this path, at this version, under this task's scope, granted at this time by this user" can be argued about.

Second, integrity is what separates a log from a diary. Append-only storage, a separate trust domain from the actor, and a tamper-evident structure — entries chained by hash, so a later edit invalidates everything after it — are what let the record survive contact with someone who wishes it said otherwise. Without those properties you have operational telemetry, which is useful for debugging and nearly useless in a dispute.

Third, the caution, and it is the honest limit of the whole idea. Recording an assistant's stated reasoning is evidence of what it said, not proof of why it acted. A model's explanation of its own behaviour is generated text, and there is active research showing such explanations do not always reflect the factors that actually drove the output. So a chain of thought in the log is genuinely useful context and genuinely weak causation. Log the observable facts — inputs seen, calls made, results returned — and treat the narration as commentary.

e

A picture of it

THE PICTURE #
The audit record as the product
The audit record as the product read left to right as time. The two entries in each of the first three sections are the pair worth comparing -- notice that the record accumulates throughout while the outcome appears only at the end. The final section is the test: both survive, but only one of them can answer a question about authority, and it is not the one you asked for. {"generator":"[email protected]","source":"../Socrates/.diagram-cache/_src/the-audit-record-as-the-product.md","sourceIndex":1,"sourceLine":4,"sourceHash":"b4ca233090ae39179bff3d6a3edc37b4b830920c29e56e34610aa53f09e55329","diagramType":"timeline","layoutVariant":"source","repairedDuplicateIds":[],"motion":"entrance-with-reduced-motion-fallback","presentation":"editorial","attempt":1,"viewBox":{"x":0,"y":0,"width":1955,"height":702},"qa":{"passed":true,"findings":[]}} Before the action Delegation User grants ascoped authority Consent capturedwith its limits Issuance Gateway mints ashort livedcredential Principal anddelegate bothnamed During the action Each call Arguments andtarget recorded atthe boundary Result and failurerecorded too Reading What the agentsaw is recorded Not only what itchanged After the action Outcome The folder, thebalance, thedeployed build Shows a state, nota path Record Append only andtamper evident The onlyreconstructableaccount A month later Question Why is this filegone Who authorised it Answer The outcomecannot say Only the record can

How to readread left to right as time. The two entries in each of the first three sections are the pair worth comparing — notice that the record accumulates throughout while the outcome appears only at the end. The final section is the test: both survive, but only one of them can answer a question about authority, and it is not the one you asked for.

f

What became clearer

WHAT CLEARED #
WHAT CLEARED

An outcome is a state, and a state is compatible with many histories. Because a delegated action cannot be rerun to find out which history occurred, the contemporaneous record is the only evidence that will ever exist about authority, scope and consent — so the design question is not whether to log but whether the log is produced somewhere the actor cannot shape it. The result is what you wanted; the record is what makes it defensible.

g

Where to go next

ONWARD #
  • What a delegated-authority chain must actually contain to survive a dispute, and how existing token standards express it.
  • Why hash-chained or externally witnessed logs are worth their cost, and what attack each property closes.
  • How to log what an agent read without the log itself becoming the largest disclosure in the system.
h

Key terms

TERMS #
TermWhat it means
Audit trailan ordered record of actions with enough context to reconstruct what happened and under whose authority.
Delegated authorityan arrangement where one identity acts on behalf of another, so the acting party and the answerable party differ.
Principalthe identity on whose behalf an action is taken, as distinct from the component performing it.
Tamper-evident loga record structured, typically by chaining entries with hashes, so that any later alteration is detectable.
Append-only storagestorage that permits new entries but not modification or deletion of existing ones.

Every term the collection defines is gathered in the glossary.

Nearby on the shelf

4