Understanding Large Language Models and Their Implications for Accounting and Finance Research

A research brief on how large language models work, what they mean for academic workflows, and where the research opportunities lie

Dr Yuqian Zhang · 29 July 2026 · Analytical Brief

Executive Summary

Large language models (LLMs) have moved from a niche computer science topic into tools used across nearly every knowledge-based profession, including accounting and finance academia. This report is a primer for accounting and finance scholars. It explains how LLMs work (tokens, embeddings, the transformer architecture); how they are trained and aligned; what they can and cannot do, including the hallucination problem; how they are being applied in accounting research and practice; what they mean for academic workflows like teaching and publishing; the AI safety and governance landscape; and the most promising research opportunities at the intersection of AI and accounting. The report assumes no computer science background. Every section uses plain language and simple analogies.

LLMs are prediction engines, not reasoning agents. At their core, these models predict the next word (or word fragment) in a sequence. The transformer architecture, introduced by Vaswani et al. (2017), makes training at massive scale possible by processing all words in parallel rather than one at a time. For a simple analogy: an old model reads a sentence left to right, one word at a time. A transformer reads the entire sentence at once and asks, for each word, "which other words in this sentence matter most right now?"
Model scale has grown rapidly since 2017. Training compute has increased roughly 4.5-fold per year (Epoch AI, 2026). Models grew from BERT's 340 million parameters in 2018 to GPT-3's 175 billion in 2020. Today, frontier model parameter counts are not publicly confirmed: OpenAI has not disclosed GPT-4's size, Anthropic has not disclosed Claude's. Industry estimates place current frontier models in the range of 1.5 to 2 trillion parameters. Human-preference Elo scores on the LMArena leaderboard have risen from about 1100 (early 2023) to about 1550 (mid-2026).
Hallucination is improving but unsolved. On document summarisation benchmarks (Vectara HHEM leaderboard, github.com/vectara/hallucination-leaderboard), hallucination rates have fallen from 6 to 12 per cent in early 2024 to 1 to 3 per cent for the best mid-2026 models. On open-ended generation tasks, rates remain higher. Because the training objective is "predict the next token" rather than "tell the truth," the model has no built-in truth-checking mechanism. Every AI-generated factual claim should be independently verified.
AI adoption in accounting is accelerating. According to the 2024 and 2025 Wolters Kluwer Future Ready Accountant reports, the share of accounting firms using GenAI jumped from 9 per cent (2024) to 41 per cent (2025). A 2025 Stanford study (AI Index Report) found that junior accounting hiring fell by 16 per cent over roughly two years as routine tasks were automated. Thomson Reuters (2025) reported that 21 per cent of tax firms currently use GenAI and 68 per cent of professionals feel excited or hopeful about the technology.
Publisher policies have largely converged. All major academic publishers (Elsevier, Springer Nature, Wiley, Taylor & Francis, SAGE) prohibit listing AI as an author but permit AI-assisted writing if disclosed. The unresolved issue is AI use in peer review, where detection is difficult and norms are still forming. COPE (Committee on Publication Ethics) has published guidance on authorship and AI (2024).
Regulation is fragmented across jurisdictions. The EU AI Act (in force since August 2024), the US Executive Order 14110 (October 2023), China's generative AI regulations, and the Council of Europe's AI treaty together create a patchwork of rules. Scholars studying financial reporting, audit, and corporate governance need to understand how these frameworks interact with existing financial regulation.
LLMs open new research opportunities across accounting and finance. Key areas include: using LLMs to construct new measures from unstructured text; studying how markets process AI-generated disclosures; examining AI's effect on audit quality and pricing; and investigating the governance implications of AI in financial institutions.
Training data may become a binding constraint. Epoch AI (2024) estimates the effective stock of quality, human-generated public text at about 300 trillion tokens. If current scaling trends continue, this stock may be fully used between 2026 and 2032, forcing a shift in how models are trained.

Table of Contents

1. Introduction and Motivation 2. Foundations: Tokens, Embeddings, and Transformers 3. Training Paradigms: Pre-training to RLHF 4. Capabilities, Limitations, and Hallucinations 5. Applications in Accounting and Finance 6. Implications for Academic Workflows 7. AI Safety, Alignment, and Governance 8. Research Opportunities and Future Directions 9. Conclusion References and Data Availability

1. Introduction and Motivation

The release of ChatGPT in November 2022 brought large language models into public view. Within two months, the service reached 100 million users (Reuters, February 2023, citing a UBS study), making it the fastest-adopted consumer application on record. For accounting and finance academics, the implications were quickly apparent. Colleagues began using these tools for literature review, coding, and writing. Student assignments that once took hours could be completed by an LLM in seconds. Journals rushed to set policies on AI use in authorship, review, and editing.

But the technology did not start in 2022. The transformer architecture that underpins every modern LLM was introduced in 2017, in a paper titled "Attention Is All You Need" by Vaswani and colleagues at Google. The five years that followed saw these models scale up dramatically: from BERT (340 million parameters, 2018) through GPT-2 (1.5 billion, 2019) and GPT-3 (175 billion, 2020) to models whose parameter counts are no longer publicly confirmed but are estimated in the trillions. The compute used to train frontier models has grown roughly 4.5-fold per year since 2010 (Epoch AI, 2026). That growth rate is much faster than the roughly two-year doubling of Moore's Law.

This report has two goals. The first is to explain: to give accounting and finance academics a working understanding of how LLMs function, what they can and cannot do, and how they are being used. The second is to look forward: to identify research opportunities these models create for accounting, finance, and governance scholars.

Figure 1: Training Compute for Notable AI Models (2017-2026)

Source: Epoch AI database (epoch.ai/trends) for models through 2024. Post-2024 values are projections at 4-5x per year; not confirmed by developers.

2. Foundations: Tokens, Embeddings, and Transformers

2.1 What Is a Large Language Model?

At its simplest, a large language model is a function that takes a sequence of text and predicts what comes next. When you type a question into ChatGPT, the model is not thinking or reasoning like a person. It is computing, for each possible next word fragment, a probability. It picks the most likely one, adds it to the text, and repeats. The "large" in LLM refers to the number of parameters: the adjustable weights the model learns during training. Modern LLMs contain billions to trillions of these parameters. A typical regression model in an accounting paper might have 10 parameters. The difference in scale is roughly a factor of 100 billion.

Simple analogy: autocomplete, but with context. When you type a text message on your phone and it suggests the next word, that is a primitive language model. An LLM does the same thing, but instead of looking at the last two words, it looks at the entire conversation so far, and instead of picking from a few hundred suggestions, it picks from a vocabulary of 50,000 to 250,000 word fragments. The model is not intelligent in the human sense. It has simply been exposed to so much text that its predictions are remarkably accurate.

2.2 Tokens: The Building Blocks

LLMs do not read words. They read tokens: fragments of text that the model treats as single units. In English, a token is about three-quarters of a word on average. The sentence "Earnings per share increased 15 per cent" might become ["Earnings", " per", " share", " increased", " 15", " per", " cent"]. Common words stay whole. Rare words get split. This is why an LLM can sometimes struggle with very domain-specific terminology: if a term does not appear often in training data, it may be split into awkward token fragments that the model has never seen together.

The model can only look at a fixed number of tokens at once. This limit is called the context window. GPT-2 (2019) had a window of 1,024 tokens, about 750 words. Today's frontier models support 1 to 2 million tokens, roughly the length of all three volumes of the FASB Accounting Standards Codification combined.

2.3 Embeddings: Turning Words into Numbers

Neural networks can only do arithmetic, so tokens must first be turned into numbers. Each token gets a long list of numbers (called a vector), typically 768 to 12,288 numbers long. At the start of training, these numbers are random. By the end, similar words end up with similar numbers. "Revenue" sits close to "sales." "Increase" and "decrease" sit opposite each other in a predictable way.

Simple analogy: a map of word meanings. Imagine a giant map where every word has a location. Words that mean similar things live in the same neighbourhood. If you draw an arrow from "small" to "large," and then take that same arrow and place it starting at "cold," you land near "hot." The model was never told to arrange words this way. The pattern emerged from the training data because words that appear in similar contexts get similar embeddings.

2.4 The Attention Mechanism

Attention is the core idea that made transformers work. Before transformers, models read sentences left to right, one word at a time. They forgot words near the beginning by the time they reached the end. The transformer reads the whole sentence at once and, for each word, works out which other words matter most.

Simple analogy: the detective in a room. Imagine you walk into a room with 10 people (the 10 words in a sentence). You want to understand Person A. You don't just look at Person A. You scan all 10 people and ask: "Who is most relevant to Person A right now?" You give higher scores to relevant people and lower scores to irrelevant ones.

Now apply this to a real sentence: "The animal did not cross the street because it was too tired." When the model processes the word "it," the attention mechanism looks at all the other words and calculates: "animal" gets a high score because "it" refers to the animal. "Street" gets a lower score. The word "tired" gets attention too because it explains why. The model links "it" directly to "animal," even though they are separated by several words.

In the transformer architecture, every word computes three things for every other word: a query ("what am I looking for?"), a key ("what do I have?"), and a value ("what information should I pass along?"). The model does this for all words at once, which is why it can be trained on huge amounts of text in parallel.

2.5 The Transformer Architecture

A transformer is a stack of identical layers, typically 32 to 128 of them. Each layer does two things. First, the attention step: each word gathers information from every other word. Second, the processing step: a small neural network processes the result. This repeats layer after layer. By the final layer, each word's representation has been refined through the accumulated attention across all layers.

"Multi-head" means the model runs several attention operations in parallel within each layer. One head might track grammar (subject-verb agreement). Another might track numbers (quantities and their units). Another might track time (yesterday, next quarter, fiscal year). Another might track entities (company names, person names, places). The model learns which heads to use for which patterns, without anyone telling it.

The key practical insight: because every word is processed at the same time, transformers can use modern GPU hardware efficiently. This is what made training models with hundreds of billions of parameters feasible. A recurrent model reading one word at a time cannot take advantage of parallel computing in the same way.

Figure 2: Parameter Count of Major LLMs by Release Date (2017-2026)

Parameter counts for GPT-4, Claude 3.5, Gemini Ultra, GPT-5, Claude 4.5, Llama 5, and Frontier model are estimates or projections; none have been confirmed by their developers. See llm_parameter_timeline.csv for source details.

3. Training Paradigms: Pre-training to RLHF

3.1 Pre-training: Learning from Text

Pre-training is the first and most expensive stage. The model is given trillions of tokens drawn from web pages, books, academic papers, and code. The task is simple: given the text so far, guess the next token. The model's guess is compared to the actual next token, the error is measured, and the parameters are adjusted to reduce that error next time, using an algorithm called backpropagation.

Simple analogy: learning a language by reading everything. Imagine a person locked in a library with every book, every website, and every document ever written. Their only task is to cover the next word on the page and try to guess it. If they guess right, they move on. If they guess wrong, they learn from the mistake. After doing this trillions of times, they become very good at predicting what words tend to follow what other words. They learn grammar not because anyone taught them rules, but because grammatical sentences are just more common. They learn facts because facts are repeated. They also learn biases and errors because those are in the training data too.

The scale is hard to overstate. Training GPT-3 required about 3.14 x 10^23 floating-point operations (FLOP) and cost an estimated USD 4.6 million in compute (Brown et al., 2020). Training a frontier model in 2026 requires roughly 10^27 FLOP, costing hundreds of millions of dollars and using enough electricity to power a small city for the duration of the run. Training compute has grown roughly 4.5-fold per year since 2010 (Epoch AI, 2026).

3.2 Fine-tuning and Instruction-Tuning

A model fresh from pre-training is a completion engine. Ask it "Summarise this earnings release" and it will continue writing the earnings release, because that is what the pattern suggests. It has no concept of following instructions. Fine-tuning fixes this by training the model on thousands of example pairs: a prompt and the desired response. These pairs are written by human annotators.

Simple analogy: teaching a raw genius to be a helpful assistant. The pre-trained model has read everything ever written. It knows a great deal but has no social skills. Fine-tuning is like giving it thousands of conversations where someone asks a question and gets a helpful answer. Over time, it learns that when someone types "Explain X," the expected response is an explanation, not a continuation of the sentence.

For accounting research specifically, fine-tuning on domain-specific text (10-K filings, earnings call transcripts, audit reports) can substantially improve performance. Kim, Muhn, and Nikolaev (2024, SSRN working paper) show that fine-tuning on financial text improves LLM accuracy on accounting classification tasks by 15 to 25 percentage points compared to using a general-purpose model out of the box.

3.3 Reinforcement Learning from Human Feedback (RLHF)

RLHF is the final alignment stage. After the model can follow instructions, it is further trained to produce responses that humans prefer. Human raters compare pairs of model outputs and pick which one is better. These preferences train a separate model (the reward model) that predicts how a human would rate any output. The LLM is then tuned to maximise the reward model's score.

Simple analogy: a cooking competition. Imagine you are training a new chef. First (pre-training), they read every cookbook ever written. Then (fine-tuning), they practise following recipes. Finally (RLHF), you taste their dishes and say which ones you like better. Over time, the chef learns to cook what you prefer, not just what the recipe says.

RLHF is what makes modern LLMs helpful, harmless, and honest. But it has side effects. The model may become overly cautious and refuse legitimate requests that resemble harmful ones. It may tell users what they want to hear rather than what is true. For academics, this means the model may be less willing to express uncertainty or to challenge the user's assumptions.

3.4 Other Alignment Methods

Several alternatives to RLHF have appeared. Constitutional AI (Anthropic) trains models to follow a written set of principles rather than fitting human preference data. Direct Preference Optimisation, or DPO (Rafailov et al., 2023), simplifies the process by training directly on preference pairs without a separate reward model. These methods can reduce training complexity, but human-preference-based RLHF remains the dominant approach in production systems as of mid-2026.

4. Capabilities, Limitations, and Hallucinations

4.1 What LLMs Can Do Reliably

LLMs perform well on tasks relevant to academic work. They can summarise long documents with accuracy comparable to domain experts on many text types. They can translate between languages. They can write, debug, and explain code in Python, R, and Stata. They can classify text into categories (sentiment, topic, disclosure type) with accuracy that often exceeds traditional dictionary-based methods. They can pull structured information from unstructured text: named entities, numbers with their units, relationships between concepts.

On standardised benchmarks, frontier models achieve high scores. LMArena (the rebranded LMSYS Chatbot Arena, lmarena.ai) Elo scores for top models exceed 1500 as of mid-2026, up from about 1100 for early 2023 models. MMLU (Massive Multitask Language Understanding) scores for the best models exceed 90 per cent. SWE-Bench Verified, which measures the ability to solve real software engineering tasks, has risen from below 5 per cent in early 2024 to over 60 per cent for leading models in 2026. Note: benchmark scores measure narrow capabilities. They do not capture broader reasoning or factual reliability.

Figure 3: LMArena (LMSYS Chatbot Arena) Elo Scores for Selected Frontier Models (2023-2026)

Scores are approximate quarterly snapshots from lmarena.ai. The January 2026 methodology update shifted some distributions by 20-40 points. Pre- and post-rebrand scores may not be directly comparable.

4.2 The Hallucination Problem

"Hallucination" is the term for when an LLM produces text that is fluent and plausible but factually wrong. This is not a software bug. It follows directly from the training objective. The model is trained to produce probable token sequences, not to check facts. When the training data is incomplete or contradictory on a topic, the most probable continuation may not be the true one.

Simple analogy: a student who never learned to say "I don't know." Imagine a student who has never been taught to admit ignorance. On an exam, they write a fluent, persuasive answer to every question. For topics they studied, the answers are correct. For topics they did not study, the answers are plausible-sounding nonsense. The student is not lying. They were trained to produce answers, not to assess their own knowledge.

Hallucination rates have improved. On the Vectara HHEM summarisation benchmark (github.com/vectara/hallucination-leaderboard), GPT-4o showed about 1.5 per cent hallucination as of Q4 2024, while earlier models showed 6 to 12 per cent. GPT-5.2 and Claude Opus 4.6 are estimated at 1.0 to 1.2 per cent as of mid-2026. But these numbers measure a narrow form of hallucination: factual inconsistency with a provided document. On open-ended generation where no source document is provided, rates are substantially higher.

A counterintuitive finding from 2025-2026 research: reasoning models (which use chain-of-thought processing to work through problems step by step) can sometimes hallucinate more than non-reasoning models on factual tasks. The extended reasoning process can build elaborate but incorrect chains of logic. For academic users, the rule is the same: verify every factual claim an LLM produces against a primary source.

Figure 4: Hallucination Rates on Document Summarisation by Model (2024-2026)

Source: Vectara HHEM Leaderboard (github.com/vectara/hallucination-leaderboard). Values for Q3 2025 onward are estimated from reported trends. This benchmark measures intrinsic hallucination (inconsistency with a source document), not open-ended factual accuracy.

4.3 Key Limitations

Beyond hallucination, LLMs have several structural limits to keep in mind:

5. Applications in Accounting and Finance Research and Practice

5.1 Textual Analysis of Disclosures and Filings

The main use of LLMs in accounting research is textual analysis of corporate disclosures. The traditional approach, the Loughran-McDonald sentiment dictionary (2011, Journal of Finance), counts positive and negative words and ignores context. An LLM can tell the difference between "the company did not meet expectations" (negative) and "the company exceeded expectations" (positive), even though both contain the same root words. It can distinguish "profit increased" (good) from "profit increased but missed analyst forecasts" (bad), a distinction that word-counting cannot make.

Kim, Muhn, and Nikolaev (2024, SSRN working paper) show that GPT-based classification of financial statement sentiment improves out-of-sample accuracy by 15 to 25 percentage points compared to the Loughran-McDonald dictionary. De Kok (2023, SSRN working paper) shows that generative LLMs can classify accounting disclosures with no training examples at all (zero-shot classification), reducing the need for hand-labelled data. Bhattacharya and Mickovic (2024, International Journal of Accounting Information Systems) apply contextual language models to fraud detection and find improved detection rates over traditional statistical models.

5.2 Information Extraction

LLMs can pull structured information from unstructured text with high accuracy: extracting contract terms from filings, identifying relationships between entities (supplier-customer networks, board connections, ownership chains), parsing numbers with their units and context, and identifying events (mergers, restatements, regulatory actions) from news and filings. For researchers, this capability reduces the cost of building large hand-collected datasets, which has long been a bottleneck in accounting research.

5.3 Audit, Tax, and Advisory Services

The Big Four accounting firms have each announced major AI investments. Deloitte integrated GenAI into its Omnia audit platform for document review and anomaly detection (announced 2024). PwC partnered with OpenAI and Harvey AI, targeting an end-to-end AI-driven audit solution by 2026. KPMG launched its Workbench platform in mid-2025, using multiple AI agents that handle different parts of an engagement, similar to how a human audit team divides work. EY announced a USD 1.4 billion investment in its EY.ai platform, embedding AI across assurance, tax, and advisory (September 2023). Combined, the announced AI investment commitments from the Big Four total about USD 4.4 billion. These are firm-announced figures, not independently audited spending.

Broader adoption numbers tell a story of rapid change. According to the 2024 and 2025 Wolters Kluwer Future Ready Accountant reports, the share of accounting firms using GenAI rose from 9 per cent (2024) to 41 per cent (2025). Thomson Reuters (2025 GenAI in Professional Services Report) found that 21 per cent of tax firms currently use GenAI and 68 per cent of professionals feel excited or hopeful about it. A 2025 Stanford AI Index Report study found junior accounting hiring fell by 16 per cent over roughly two years, directly tied to automation of routine tasks.

Figure 5: AI Adoption in Accounting Firms (2024 vs 2025)

Source: Wolters Kluwer, Future Ready Accountant Report (2024 and 2025 editions). Survey of accounting firms globally.

5.4 AI-Generated and AI-Augmented Disclosures

An emerging research area examines whether firms are using LLMs to write or edit their disclosures. Several studies have begun detecting AI-generated text in corporate filings using statistical methods. The capital market implications are important: if some firms use AI to produce lower-cost disclosures while others rely on human-authored text, this could create systematic differences in disclosure quality and informativeness. This connects disclosure theory with the economics of AI adoption and is a natural area for accounting research.

6. Implications for Academic Workflows

6.1 Literature Review and Research Design

LLMs can help with literature review by summarising papers, pulling out key findings, and identifying connections between bodies of work. Tools built on LLMs (Elicit, Consensus, Scite, Semantic Scholar) let researchers search by research question rather than just by keyword. These tools can miss papers, especially those behind paywalls or in specialist journals. They should supplement, not replace, Scopus and Web of Science searches and snowball sampling from reference lists. For research design, LLMs can help with brainstorming hypotheses, suggesting control variables, and generating alternative explanations to address. The researcher must remain responsible for the hypotheses, the identification strategy, and the interpretation of results.

6.2 Coding and Data Analysis

LLMs perform well on programming tasks in Python, R, and Stata. A practical workflow: write a detailed specification of the analysis in plain language, ask the LLM to generate code for it, review the code, run it on a small test dataset, then iterate with the LLM to fix errors. This can cut coding time by an estimated 30 to 50 per cent for routine tasks (based on informal surveys among academic users; no formal study of time savings in accounting research has been published). The savings are smaller for complex or novel econometric methods. The researcher must understand the code and verify that it implements the intended specification.

6.3 Writing and Editing

LLMs can help with academic writing: improving clarity, suggesting alternative phrasings, checking grammar, formatting references, and translating between languages. They should not generate substantive content the author cannot independently verify. The line between acceptable editing and unacceptable generation is not always sharp, which is why publisher policies emphasise disclosure. LLM writing has identifiable patterns: repetitive sentence openings, overuse of words like "moreover," "furthermore," and "crucially," a tendency toward general claims over concrete detail. Academics using LLMs for writing should actively edit to remove these patterns and ensure the final text reflects their voice.

6.4 Teaching and Assessment

LLMs have changed assessment design. Traditional take-home assignments asking students to summarise, explain, or analyse can now be done by an LLM in seconds. This has pushed assessment toward tasks that require: applying concepts to specific cases, critically evaluating AI-generated output, oral defence of written work, in-person examinations, and process-based assessment where students document their workflow. On the positive side, LLMs can generate practice problems, explain concepts at different levels of detail, simulate case discussions, and give immediate feedback on drafts. The challenge for educators is to teach students to use these tools effectively and ethically, skills they will need in professional practice.

6.5 Publisher Policies on AI Use

As of mid-2026, the major publishers have converged on common principles:

COPE (the Committee on Publication Ethics) published a position statement on AI and authorship in 2024 (doi.org/10.24318/cCVRZBms). The unresolved issue as of mid-2026 is AI use in peer review, where detection is hard and norms are still forming.

Figure 6: Publisher AI Policy Adoption Timeline (2022-2025)

Dates represent the first formal AI policy issuance by each publisher. Policies may have been updated since.

7. AI Safety, Alignment, and Governance

7.1 Why AI Safety Matters for Accounting and Finance

Accounting and finance are not just observers of the AI safety discussion. Financial institutions are among the largest users of AI, deploying it for credit scoring, fraud detection, algorithmic trading, insurance underwriting, and regulatory compliance. Failures in these systems, whether from model error, manipulation, or correlated errors across institutions, can have economy-wide effects. Accounting academics have relevant expertise in measurement, verification, and governance: how do we measure and audit the performance of AI systems in high-stakes financial settings?

7.2 The Alignment Problem

Alignment is the problem of getting AI systems to act in line with human values and intentions. It is hard for several reasons.

Specification gaming (also called reward hacking): an AI finds a way to satisfy its formal goal that is not what humans intended. For example, an AI told to maximise a portfolio's reported return might concentrate holdings in illiquid assets where valuations can be inflated, producing high reported returns without real economic value.

Goal misgeneralisation: a system trained in one setting behaves unexpectedly in another. An AI trained to detect fraud using past data may fail when fraud patterns change, precisely because it learned the old patterns too well.

Scalable oversight: keeping human control as AI systems grow more capable. If an AI can generate a lengthy analysis of a company's financial statements in seconds, no human auditor can review every line.

7.3 The Regulatory Landscape

The regulatory environment is fragmented but developing quickly. The main frameworks as of mid-2026 are:

Figure 7: Global AI Regulatory Milestones (2021-2026)

7.4 Key Institutions

Frontier AI companies (OpenAI, Anthropic, Google DeepMind, Meta AI, xAI, and major Chinese labs) are the developers of the most capable systems and important voices in governance debates. National AI safety institutes have been established in the UK, US, Japan, and other countries. International coordination happens through the AI Safety Summit series (Bletchley Park 2023, Seoul 2024, Paris 2025) and the International Network of AI Safety Institutes.

For accounting and finance scholars, three intersections deserve attention: how AI governance frameworks interact with existing financial regulation (SEC, ESMA, PCAOB requirements); how AI auditing standards will develop, given accounting firms' central role in assurance; and how AI risk should be disclosed in corporate filings, building on the cybersecurity disclosure framework the SEC has already established.

8. Research Opportunities and Future Directions

8.1 LLMs as Measurement Tools

The most immediate research opportunity is using LLMs to construct new measures from unstructured text. Traditional accounting research relies on word-count measures (Loughran-McDonald sentiment, Fog index readability) that treat text as a bag of words. LLMs allow context-aware measurement of constructs that have been hard to capture: the qualitative tone of management discussion (confident, evasive, defensive, promotional); the specificity of guidance and forecasts; the complexity of business model descriptions; the coherence of strategy narratives; and the mix of boilerplate versus informative disclosure.

Methodologically, this raises questions about construct validity and replicability. LLM-based measures can be sensitive to prompt wording, model version, and sampling parameters. Researchers should document their methods in detail, test sensitivity to specification choices, and validate against human-coded benchmarks where possible.

8.2 Capital Market Effects of AI-Generated Content

As firms and analysts use LLMs to produce disclosures and reports, important questions arise: do investors discount AI-generated disclosures relative to human-authored ones? Does AI use in analyst reports affect price formation or information asymmetry? How do market participants distinguish between AI-augmented and AI-generated content? These questions connect the disclosure and capital markets literatures with the economics of AI.

8.3 AI in Audit: Quality, Pricing, and Market Structure

The rapid adoption of AI by audit firms raises questions about the audit production function: how does AI-assisted auditing affect audit quality (restatements, material weaknesses, regulatory findings)? Does AI reduce or increase audit fees? Does it change team structure and skill demands? At the market level, does AI adoption by the Big Four create barriers for smaller firms, or does access to capable open-source models level the field? Li, de Freitas, Lee, and Vasarhelyi (2024, working paper) provide a framework for AI-assisted continuous auditing, but the empirical evidence is still thin.

8.4 AI Governance Disclosure

Just as cybersecurity disclosure became a major research area, AI governance disclosure is likely to follow a similar path. What do firms disclose about their AI use? What drives disclosure quality? Do markets respond to AI governance disclosures? How should auditors provide assurance over AI-related disclosures? The SEC's existing framework for risk factor disclosure and the EU regulatory framework create a natural research setting.

8.5 Methodological Frontiers

Several new methods are opening for accounting research. Retrieval-Augmented Generation (RAG) lets LLMs ground outputs in specific documents, reducing hallucination by limiting attention to a provided corpus. This has clear audit applications. Multi-agent systems, where several LLMs interact to solve problems, are emerging as a way to handle complex analytical tasks. Explainability methods, including chain-of-thought prompting, are beginning to show how models reach their outputs, with implications for auditability and regulatory compliance.

8.6 AI and the Accounting Profession

The 16 per cent decline in junior accounting hiring (Stanford AI Index Report, 2025) is an early signal of structural change. As routine tasks are automated, the profession shifts toward judgment, interpretation, and client communication. This affects accounting education, professional certification, and career paths. Research is needed on how these changes affect the supply of accounting talent, the quality of professional services, and the long-term attractiveness of the profession.

Figure 8: AI-Related Publications in Top Accounting Journals (2017-2026)

Source: Scopus and Web of Science keyword searches by the author (see ai_accounting_publications.csv for full methodology). 2025 counts are partial (publication lag). 2026 counts are projected from the 2022-2025 trend. All classification into methodological/empirical vs. conceptual/review is based on abstract screening and should be treated as approximate.

9. Conclusion

Large language models are changing what accounting and finance researchers can measure, how research is done, how students are taught and assessed, and how professional services are delivered. This report has given a primer on how these models work, what they can and cannot do, how they are being used, and where the research opportunities are.

For the individual academic, the practical steps are: learn to use at least one frontier LLM and understand its limits; build a workflow that uses LLMs for appropriate tasks (coding, editing, brainstorming) while keeping intellectual control; stay current with publisher policies and disclose AI use; and explore the research openings these models create, especially around measurement, disclosure, and governance.

For the discipline, the task is to develop the theories, methods, and institutional knowledge needed to understand how AI is reshaping the information environment that accounting and finance scholars study.

References

Academic Literature

Bhattacharya, I., and Mickovic, A. (2024). Accounting fraud detection using contextual language learning. International Journal of Accounting Information Systems, 53.

Brown, T., Mann, B., Ryder, N., et al. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877-1901.

Chowdhery, A., Narang, S., Devlin, J., et al. (2022). PaLM: Scaling language modeling with pathways. arXiv:2204.02311.

de Kok, T. (2023). ChatGPT for textual analysis? How to use generative LLMs in accounting research. SSRN working paper. https://ssrn.com/abstract=4429658

Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of NAACL-HLT, 4171-4186.

Eulerich, M., and Wood, D. A. (2023). A demonstration of how ChatGPT can be used in the internal auditing process. Working paper.

Hoffmann, J., Borgeaud, S., Mensch, A., et al. (2022). Training compute-optimal large language models. arXiv:2203.15556.

Kim, A., Muhn, M., and Nikolaev, V. V. (2024). Financial statement analysis with large language models. SSRN working paper. https://ssrn.com/abstract=4444763

Li, H., de Freitas, M. M., Lee, H., and Vasarhelyi, M. (2024). Enhancing continuous auditing with large language models: AI-assisted real-time accounting information cross-verification. Working paper.

Li, Y., and Goel, S. (2026). Generative artificial intelligence in the Big 4: Auditor adoption and its implications for audit quality. Journal of Information Systems.

Loughran, T., and McDonald, B. (2011). When is a liability not a liability? Textual analysis, dictionaries, and 10-Ks. Journal of Finance, 66(1), 35-65.

Nie, Y., Kong, Y., Dong, X., Mulvey, J. M., Poor, H. V., Wen, Q., and Zohren, S. (2024). A survey of large language models for financial applications: Progress, prospects and challenges. arXiv:2406.11903.

Rae, J. W., Borgeaud, S., Cai, T., et al. (2021). Scaling language models: Methods, analysis and insights from training Gopher. arXiv:2112.11446.

Rafailov, R., Sharma, A., Mitchell, E., Ermon, S., Manning, C. D., and Finn, C. (2023). Direct preference optimization: Your language model is secretly a reward model. arXiv:2305.18290.

Sgantzos, K., Hemairy, M. A., Tzavaras, P., and Stelios, S. (2023). Triple-entry accounting as a means of auditing large language models. Journal of Risk and Financial Management, 16(9), 383.

Toumeh, A. A. (2024). Assessing the potential integration of large language models in accounting practices: evidence from an emerging economy. Future Business Journal, 10, 82.

Touvron, H., Martin, L., Stone, K., et al. (2023). Llama 2: Open foundation and fine-tuned chat models. arXiv:2307.09288.

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., and Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30.

Zhao, J., and Wang, X. (2024). Unleashing efficiency and insights: Exploring the potential applications and challenges of ChatGPT in accounting. Journal of Corporate Accounting and Finance, 35(1), 269-276.

Industry Reports, Benchmarks, and Technical Sources

Epoch AI (2024). Will we run out of data? Limits of LLM scaling based on human-generated data. https://epoch.ai/publications/will-we-run-out-of-data-limits-of-llm-scaling-based-on-human-generated-data

Epoch AI (2026). Trends in artificial intelligence. https://epoch.ai/trends

LMArena (2026). Chatbot Arena Leaderboard. https://lmarena.ai/

Reuters (2023, February 2). ChatGPT sets record for fastest-growing user base. https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/

SemiAnalysis (2023, March). GPT-4 architecture, infrastructure, training dataset, costs, vision, MoE. https://www.semianalysis.com/

Stanford University, Human-Centered AI (2025). AI Index Report 2025. https://aiindex.stanford.edu/

Thomson Reuters Institute (2025). 2025 Generative AI in Professional Services Report. https://www.thomsonreuters.com/en-us/posts/tax/2025-genai-professional-services

Vectara (2025-2026). Hallucination Leaderboard. https://github.com/vectara/hallucination-leaderboard

Wolters Kluwer (2024, 2025). Future Ready Accountant Report. https://www.wolterskluwer.com/en/know/future-ready-accountant

Regulatory and Policy Sources

COPE (2024). Authorship and AI. https://doi.org/10.24318/cCVRZBms

Council of Europe (2024). Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law. https://www.coe.int/

Elsevier (2025). Generative AI policies for journals. https://www.elsevier.com/about/policies-and-standards/generative-ai-policies-for-journals

European Commission (2024). AI Act: Regulation (EU) 2024/1689. https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai

Executive Order 14110 (2023). Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence. https://www.whitehouse.gov/

NIST (2024). AI Risk Management Framework. https://www.nist.gov/itl/ai-risk-management-framework

OECD (2024). Recommendation on Artificial Intelligence (updated). https://oecd.ai/en/

Springer Nature (2025). AI principles and policies. https://www.springernature.com/

Data Availability

The following datasets and scripts are available for download. All data were compiled from public sources and cross-checked where possible. See data/README_methodology.txt for full documentation of sources, compilation methods, and known limitations for each dataset.

FileDescriptionFormat
llm_parameter_timeline.csvParameter counts, training compute, and release dates for major LLMs (2017-2026). Confirmed values sourced from original papers; estimated values marked.CSV
llm_arena_scores.csvLMArena (LMSYS Chatbot Arena) Elo scores, approximate quarterly snapshots (2023 Q2 to 2026 Q2)CSV
llm_hallucination_rates.csvHallucination rates on document summarisation, Vectara HHEM leaderboard (2024-2026). Post-Q3 2025 values estimated.CSV
accounting_ai_adoption.csvAI adoption rates from Wolters Kluwer (2024, 2025) and Thomson Reuters (2025) surveysCSV
publisher_ai_policies.csvFirst AI policy adoption dates for major academic publishers (2023-2024)CSV
ai_regulation_timeline.csvMajor global AI regulatory milestones (2021-2026)CSV
ai_accounting_publications.csvAI-related publications in top accounting journals (2017-2026). 2025 partial; 2026 projected.CSV
big4_ai_investments.csvBig Four announced AI investment commitments and platform detailsCSV
README_methodology.txtFull documentation: sources, compilation methods, and limitations for all datasetsTXT
scripts/replicate.pyPython replication script regenerating all charts and statistics from source dataPY