Audit evidence in the age of AI

For many years, auditors have relied on documents, records, signatures, financial transactions, and other forms of evidence with a reasonable expectation that the material presented to them is authentic. This does not mean auditors have simply accepted everything at face value. Professional scepticism has always required auditors to question evidence, consider its source and reliability, identify inconsistencies, and seek corroboration where necessary. Fraud, document manipulation, and falsification are certainly not new risks.

In my own experience of auditing, confidence in evidence has never come simply from what a document says or how convincing it appears. Understanding where evidence originated, how it was produced, and how it relates to other available evidence has always formed part of assessing whether it can reasonably be relied upon.

What is changing is the ease with which convincing evidence can be created. Advances in artificial intelligence mean that documents, correspondence, images, recordings, approvals, and entire datasets can now be generated artificially. The results can look authentic, internally consistent, and entirely plausible.

For auditors and audit teams, this introduces a fundamental question. It is no longer sufficient to consider what the evidence tells us. Auditors must also ask what gives them confidence that the evidence is authentic.

The changing nature of evidence

Traditional audit techniques have developed around assessing the sufficiency, appropriateness, and reliability of evidence.

An auditor might examine a document, identify its source, compare it with other records, confirm an approval, or trace a transaction through an organisation’s systems. Where evidence originates from an independent or authoritative source, greater confidence may generally be placed in its reliability.

Artificial intelligence does not make these principles obsolete. It does, however, change the environment in which they are applied.

Creating convincing false evidence once required time, specialist knowledge, and, in many cases, considerable effort. Generative AI has substantially reduced those barriers.

I recall one audit where I was provided with a spreadsheet containing Active Directory user account details. The information appeared unusually clean and tidy, so I asked to review the accounts directly within Active Directory. The two did not match. I subsequently discovered that the spreadsheet had been cleaned up as part of a review of leaver accounts, but the corresponding changes had not yet been made in Active Directory.

There was nothing inherently wrong with the spreadsheet, but it demonstrated an important distinction between information presented for review and the underlying source system. The reliability of evidence can depend as much upon its provenance as its appearance, a distinction that becomes increasingly important when AI can be used to create or transform information so convincingly.

One thing my auditing experience has taught me is that the absence of evidence does not necessarily mean that something has not happened. I have encountered situations where people genuinely believed that the evidence I was requesting did not exist, only for it to emerge later from another system, department, or individual. Equally, information provided in good faith may turn out to be inaccurate or incomplete. Neither situation necessarily involves deliberate deception, but both demonstrate why auditors need to look beyond the information initially presented to them.

A fabricated approval can resemble a genuine executive communication. A false document can adopt an organisation’s terminology, formatting, and writing style. Synthetic data can populate thousands of spreadsheet rows with realistic-looking transactions, values, dates, and descriptions.

Perhaps more importantly, AI could be used to generate not just an individual piece of false evidence, but an apparently coherent collection of supporting evidence.

A fabricated transaction could be accompanied by a purchase order, invoice, approval email, spreadsheet entry, meeting record, and supporting correspondence. Each item might appear to corroborate the others.

The traditional principle of corroboration therefore remains important, but auditors may increasingly need to consider whether apparently independent pieces of evidence genuinely originate from independent sources.

Professional scepticism in an AI world

Professional scepticism has always been central to effective auditing. Auditors are expected to maintain a questioning mind and critically assess the evidence presented to them. In an environment where convincing synthetic content can be created quickly, that mindset becomes even more important.

Professional scepticism may increasingly need to incorporate a form of digital scepticism. Looking back at my own audits, I recognise that I have already applied elements of this approach, although I would not necessarily have described it as digital scepticism at the time. Questioning where information came from, comparing it with source systems, and investigating something that did not appear quite right were simply part of the audit process.

This does not mean assuming that every document has been generated by AI or treating every dataset as potentially fraudulent. Such an approach would make effective auditing almost impossible. Instead, auditors may need to broaden the questions they ask about evidence, for example:

  • Where did the evidence originate?
  • Who, or what, created it?
  • Can its origin be independently established?
  • Has it been altered since it was created?
  • Does the evidence exist within the organisation’s source systems, or has it been produced specifically for the audit?
  • Can the underlying transaction or activity be verified through another source?

These questions move the auditor’s attention beyond the appearance of evidence and towards its provenance. In other words, the audit trail increasingly needs to demonstrate not only what happened, but also why the auditor can trust the evidence showing that it happened.

Can we identify synthetic evidence?

There may be indicators that warrant further investigation. These could include unusual statistical patterns, repeated structures, unexpected similarities between records, inconsistent metadata, improbable distributions, unexplained changes in writing style, or discrepancies between documents and the systems from which they supposedly originated.

Large datasets may present their own warning signs. Artificially generated data could contain patterns that appear random to a human reviewer but become apparent when the complete population is analysed. Values might be distributed too evenly, relationships between fields might be unusually consistent, or supposedly independent transactions might exhibit unexpected similarities.

However, auditors should be cautious about assuming that AI-generated material will always contain identifiable characteristics. Generative technologies will continue to improve, and methods designed to detect synthetic content will need to evolve alongside them. An apparent indicator of AI generation may also have an entirely legitimate explanation.

The objective should therefore not simply be to determine whether a document looks AI-generated. A stronger approach may be to focus on verification rather than detection. The more useful question is not whether an auditor can prove that something was generated by AI, but whether the evidence came from the source it claims to have come from.

Using technology to challenge technology

Artificial intelligence creates new risks for audit evidence, but technology can also form part of the response. Analytical tools allow auditors to examine far larger populations of information than would be practical through manual sampling alone.

Instead of reviewing a small number of individual transactions, auditors can increasingly analyse complete datasets, identify unusual relationships, compare information across systems, and highlight anomalies requiring further investigation. This could become particularly important when dealing with synthetic data.

Analysis might identify duplicate structures, improbable transaction sequences, unusual timing patterns, unexpected relationships between fields, or inconsistencies between operational systems and information supplied specifically for audit purposes. AI itself may also support this process by helping auditors identify patterns across large quantities of evidence that a human reviewer might reasonably overlook.

AI is contributing to the problem of evidence authenticity, but AI and advanced analytics may also become increasingly important tools for addressing that problem.

The challenge will be ensuring that auditors understand both the capabilities and the limitations of those tools. An auditor should not simply replace unquestioning trust in a document with unquestioning trust in an AI system analysing that document. Professional judgement remains essential.

Provenance may become as important as content

Historically, much of an auditor’s attention has understandably focused on the content of evidence, for example:

  • Does the invoice support the transaction?
  • Does the approval demonstrate appropriate authorisation?
  • Does the spreadsheet reconcile with the financial or operational system?
  • Does the record demonstrate that the required process was followed?

Increasingly, however, auditors may also need to understand the provenance of the evidence itself. A document retrieved directly from a controlled system may provide a different level of assurance from an identical document supplied as an email attachment.

A transaction independently extracted from the source system may provide greater confidence than a spreadsheet prepared specifically for an audit.

Evidence obtained directly by the auditor may carry different risks from evidence selected, compiled, or transformed before being presented by the auditee. None of these distinctions are entirely new to auditing, but AI changes their significance.

When convincing evidence can be generated cheaply, quickly, and at scale, understanding the route by which evidence reached the auditor becomes increasingly important.

The audit trail of the future

Traditionally, an audit trail allows an auditor to follow an activity or transaction through records and systems. In an AI-enabled environment, the audit trail may increasingly need to provide confidence in the origin and integrity of those records as well.

That could mean placing greater emphasis on source systems, access controls, document histories, system logs, digital signatures, timestamps, independently obtained evidence, and other mechanisms capable of establishing provenance. It could also mean reconsidering how evidence is requested.

Where possible, auditors may prefer to obtain information directly from authoritative systems rather than receiving documents that have been extracted, reformatted, or compiled specifically for the audit. This does not mean that every audit needs to become a digital forensic investigation. The response should remain proportionate to the risk.

However, where evidence is particularly significant to an audit conclusion, or where the circumstances create a heightened risk of manipulation, establishing authenticity may need to become an explicit part of the auditor’s evidence assessment.

A new dimension of professional scepticism

Artificial intelligence does not invalidate the fundamental principles of auditing. If anything, it reinforces them. Professional scepticism, corroboration, independence of evidence, reliability of sources, and professional judgement remain as important as ever. What is changing is the environment in which those principles must operate.

Auditors have always needed to consider whether evidence is reliable. The difference is that producing convincing false evidence is becoming easier, faster, and more scalable.

The challenge for the next generation of auditors may therefore not be learning how to recognise AI-generated evidence, but learning how to conduct assurance in an environment where authenticity can no longer be assumed from appearance alone.

When seeing is no longer believing, the strength of an audit conclusion will increasingly depend not simply on what the evidence says, but on how confidently the auditor can establish where that evidence came from, how it was created, and whether it can be trusted.