A research brief on how large language models work, what they mean for academic workflows, and where the research opportunities lie
Large language models (LLMs) have moved from a niche computer science topic into tools used across nearly every knowledge-based profession, including accounting and finance academia. This report is a primer for accounting and finance scholars. It explains how LLMs work (tokens, embeddings, the transformer architecture); how they are trained and aligned; what they can and cannot do, including the hallucination problem; how they are being applied in accounting research and practice; what they mean for academic workflows like teaching and publishing; the AI safety and governance landscape; and the most promising research opportunities at the intersection of AI and accounting. The report assumes no computer science background. Every section uses plain language and simple analogies.
The release of ChatGPT in November 2022 brought large language models into public view. Within two months, the service reached 100 million users (Reuters, February 2023, citing a UBS study), making it the fastest-adopted consumer application on record. For accounting and finance academics, the implications were quickly apparent. Colleagues began using these tools for literature review, coding, and writing. Student assignments that once took hours could be completed by an LLM in seconds. Journals rushed to set policies on AI use in authorship, review, and editing.
But the technology did not start in 2022. The transformer architecture that underpins every modern LLM was introduced in 2017, in a paper titled "Attention Is All You Need" by Vaswani and colleagues at Google. The five years that followed saw these models scale up dramatically: from BERT (340 million parameters, 2018) through GPT-2 (1.5 billion, 2019) and GPT-3 (175 billion, 2020) to models whose parameter counts are no longer publicly confirmed but are estimated in the trillions. The compute used to train frontier models has grown roughly 4.5-fold per year since 2010 (Epoch AI, 2026). That growth rate is much faster than the roughly two-year doubling of Moore's Law.
This report has two goals. The first is to explain: to give accounting and finance academics a working understanding of how LLMs function, what they can and cannot do, and how they are being used. The second is to look forward: to identify research opportunities these models create for accounting, finance, and governance scholars.
Source: Epoch AI database (epoch.ai/trends) for models through 2024. Post-2024 values are projections at 4-5x per year; not confirmed by developers.
At its simplest, a large language model is a function that takes a sequence of text and predicts what comes next. When you type a question into ChatGPT, the model is not thinking or reasoning like a person. It is computing, for each possible next word fragment, a probability. It picks the most likely one, adds it to the text, and repeats. The "large" in LLM refers to the number of parameters: the adjustable weights the model learns during training. Modern LLMs contain billions to trillions of these parameters. A typical regression model in an accounting paper might have 10 parameters. The difference in scale is roughly a factor of 100 billion.
Simple analogy: autocomplete, but with context. When you type a text message on your phone and it suggests the next word, that is a primitive language model. An LLM does the same thing, but instead of looking at the last two words, it looks at the entire conversation so far, and instead of picking from a few hundred suggestions, it picks from a vocabulary of 50,000 to 250,000 word fragments. The model is not intelligent in the human sense. It has simply been exposed to so much text that its predictions are remarkably accurate.
LLMs do not read words. They read tokens: fragments of text that the model treats as single units. In English, a token is about three-quarters of a word on average. The sentence "Earnings per share increased 15 per cent" might become ["Earnings", " per", " share", " increased", " 15", " per", " cent"]. Common words stay whole. Rare words get split. This is why an LLM can sometimes struggle with very domain-specific terminology: if a term does not appear often in training data, it may be split into awkward token fragments that the model has never seen together.
The model can only look at a fixed number of tokens at once. This limit is called the context window. GPT-2 (2019) had a window of 1,024 tokens, about 750 words. Today's frontier models support 1 to 2 million tokens, roughly the length of all three volumes of the FASB Accounting Standards Codification combined.
Neural networks can only do arithmetic, so tokens must first be turned into numbers. Each token gets a long list of numbers (called a vector), typically 768 to 12,288 numbers long. At the start of training, these numbers are random. By the end, similar words end up with similar numbers. "Revenue" sits close to "sales." "Increase" and "decrease" sit opposite each other in a predictable way.
Simple analogy: a map of word meanings. Imagine a giant map where every word has a location. Words that mean similar things live in the same neighbourhood. If you draw an arrow from "small" to "large," and then take that same arrow and place it starting at "cold," you land near "hot." The model was never told to arrange words this way. The pattern emerged from the training data because words that appear in similar contexts get similar embeddings.
Attention is the core idea that made transformers work. Before transformers, models read sentences left to right, one word at a time. They forgot words near the beginning by the time they reached the end. The transformer reads the whole sentence at once and, for each word, works out which other words matter most.
Simple analogy: the detective in a room. Imagine you walk into a room with 10 people (the 10 words in a sentence). You want to understand Person A. You don't just look at Person A. You scan all 10 people and ask: "Who is most relevant to Person A right now?" You give higher scores to relevant people and lower scores to irrelevant ones.
Now apply this to a real sentence: "The animal did not cross the street because it was too tired." When the model processes the word "it," the attention mechanism looks at all the other words and calculates: "animal" gets a high score because "it" refers to the animal. "Street" gets a lower score. The word "tired" gets attention too because it explains why. The model links "it" directly to "animal," even though they are separated by several words.
In the transformer architecture, every word computes three things for every other word: a query ("what am I looking for?"), a key ("what do I have?"), and a value ("what information should I pass along?"). The model does this for all words at once, which is why it can be trained on huge amounts of text in parallel.
A transformer is a stack of identical layers, typically 32 to 128 of them. Each layer does two things. First, the attention step: each word gathers information from every other word. Second, the processing step: a small neural network processes the result. This repeats layer after layer. By the final layer, each word's representation has been refined through the accumulated attention across all layers.
"Multi-head" means the model runs several attention operations in parallel within each layer. One head might track grammar (subject-verb agreement). Another might track numbers (quantities and their units). Another might track time (yesterday, next quarter, fiscal year). Another might track entities (company names, person names, places). The model learns which heads to use for which patterns, without anyone telling it.
The key practical insight: because every word is processed at the same time, transformers can use modern GPU hardware efficiently. This is what made training models with hundreds of billions of parameters feasible. A recurrent model reading one word at a time cannot take advantage of parallel computing in the same way.
Parameter counts for GPT-4, Claude 3.5, Gemini Ultra, GPT-5, Claude 4.5, Llama 5, and Frontier model are estimates or projections; none have been confirmed by their developers. See llm_parameter_timeline.csv for source details.
Pre-training is the first and most expensive stage. The model is given trillions of tokens drawn from web pages, books, academic papers, and code. The task is simple: given the text so far, guess the next token. The model's guess is compared to the actual next token, the error is measured, and the parameters are adjusted to reduce that error next time, using an algorithm called backpropagation.
Simple analogy: learning a language by reading everything. Imagine a person locked in a library with every book, every website, and every document ever written. Their only task is to cover the next word on the page and try to guess it. If they guess right, they move on. If they guess wrong, they learn from the mistake. After doing this trillions of times, they become very good at predicting what words tend to follow what other words. They learn grammar not because anyone taught them rules, but because grammatical sentences are just more common. They learn facts because facts are repeated. They also learn biases and errors because those are in the training data too.
The scale is hard to overstate. Training GPT-3 required about 3.14 x 10^23 floating-point operations (FLOP) and cost an estimated USD 4.6 million in compute (Brown et al., 2020). Training a frontier model in 2026 requires roughly 10^27 FLOP, costing hundreds of millions of dollars and using enough electricity to power a small city for the duration of the run. Training compute has grown roughly 4.5-fold per year since 2010 (Epoch AI, 2026).
A model fresh from pre-training is a completion engine. Ask it "Summarise this earnings release" and it will continue writing the earnings release, because that is what the pattern suggests. It has no concept of following instructions. Fine-tuning fixes this by training the model on thousands of example pairs: a prompt and the desired response. These pairs are written by human annotators.
Simple analogy: teaching a raw genius to be a helpful assistant. The pre-trained model has read everything ever written. It knows a great deal but has no social skills. Fine-tuning is like giving it thousands of conversations where someone asks a question and gets a helpful answer. Over time, it learns that when someone types "Explain X," the expected response is an explanation, not a continuation of the sentence.
For accounting research specifically, fine-tuning on domain-specific text (10-K filings, earnings call transcripts, audit reports) can substantially improve performance. Kim, Muhn, and Nikolaev (2024, SSRN working paper) show that fine-tuning on financial text improves LLM accuracy on accounting classification tasks by 15 to 25 percentage points compared to using a general-purpose model out of the box.
RLHF is the final alignment stage. After the model can follow instructions, it is further trained to produce responses that humans prefer. Human raters compare pairs of model outputs and pick which one is better. These preferences train a separate model (the reward model) that predicts how a human would rate any output. The LLM is then tuned to maximise the reward model's score.
Simple analogy: a cooking competition. Imagine you are training a new chef. First (pre-training), they read every cookbook ever written. Then (fine-tuning), they practise following recipes. Finally (RLHF), you taste their dishes and say which ones you like better. Over time, the chef learns to cook what you prefer, not just what the recipe says.
RLHF is what makes modern LLMs helpful, harmless, and honest. But it has side effects. The model may become overly cautious and refuse legitimate requests that resemble harmful ones. It may tell users what they want to hear rather than what is true. For academics, this means the model may be less willing to express uncertainty or to challenge the user's assumptions.
Several alternatives to RLHF have appeared. Constitutional AI (Anthropic) trains models to follow a written set of principles rather than fitting human preference data. Direct Preference Optimisation, or DPO (Rafailov et al., 2023), simplifies the process by training directly on preference pairs without a separate reward model. These methods can reduce training complexity, but human-preference-based RLHF remains the dominant approach in production systems as of mid-2026.
LLMs perform well on tasks relevant to academic work. They can summarise long documents with accuracy comparable to domain experts on many text types. They can translate between languages. They can write, debug, and explain code in Python, R, and Stata. They can classify text into categories (sentiment, topic, disclosure type) with accuracy that often exceeds traditional dictionary-based methods. They can pull structured information from unstructured text: named entities, numbers with their units, relationships between concepts.
On standardised benchmarks, frontier models achieve high scores. LMArena (the rebranded LMSYS Chatbot Arena, lmarena.ai) Elo scores for top models exceed 1500 as of mid-2026, up from about 1100 for early 2023 models. MMLU (Massive Multitask Language Understanding) scores for the best models exceed 90 per cent. SWE-Bench Verified, which measures the ability to solve real software engineering tasks, has risen from below 5 per cent in early 2024 to over 60 per cent for leading models in 2026. Note: benchmark scores measure narrow capabilities. They do not capture broader reasoning or factual reliability.
Scores are approximate quarterly snapshots from lmarena.ai. The January 2026 methodology update shifted some distributions by 20-40 points. Pre- and post-rebrand scores may not be directly comparable.
"Hallucination" is the term for when an LLM produces text that is fluent and plausible but factually wrong. This is not a software bug. It follows directly from the training objective. The model is trained to produce probable token sequences, not to check facts. When the training data is incomplete or contradictory on a topic, the most probable continuation may not be the true one.
Simple analogy: a student who never learned to say "I don't know." Imagine a student who has never been taught to admit ignorance. On an exam, they write a fluent, persuasive answer to every question. For topics they studied, the answers are correct. For topics they did not study, the answers are plausible-sounding nonsense. The student is not lying. They were trained to produce answers, not to assess their own knowledge.
Hallucination rates have improved. On the Vectara HHEM summarisation benchmark (github.com/vectara/hallucination-leaderboard), GPT-4o showed about 1.5 per cent hallucination as of Q4 2024, while earlier models showed 6 to 12 per cent. GPT-5.2 and Claude Opus 4.6 are estimated at 1.0 to 1.2 per cent as of mid-2026. But these numbers measure a narrow form of hallucination: factual inconsistency with a provided document. On open-ended generation where no source document is provided, rates are substantially higher.
A counterintuitive finding from 2025-2026 research: reasoning models (which use chain-of-thought processing to work through problems step by step) can sometimes hallucinate more than non-reasoning models on factual tasks. The extended reasoning process can build elaborate but incorrect chains of logic. For academic users, the rule is the same: verify every factual claim an LLM produces against a primary source.
Source: Vectara HHEM Leaderboard (github.com/vectara/hallucination-leaderboard). Values for Q3 2025 onward are estimated from reported trends. This benchmark measures intrinsic hallucination (inconsistency with a source document), not open-ended factual accuracy.
Beyond hallucination, LLMs have several structural limits to keep in mind:
The main use of LLMs in accounting research is textual analysis of corporate disclosures. The traditional approach, the Loughran-McDonald sentiment dictionary (2011, Journal of Finance), counts positive and negative words and ignores context. An LLM can tell the difference between "the company did not meet expectations" (negative) and "the company exceeded expectations" (positive), even though both contain the same root words. It can distinguish "profit increased" (good) from "profit increased but missed analyst forecasts" (bad), a distinction that word-counting cannot make.
Kim, Muhn, and Nikolaev (2024, SSRN working paper) show that GPT-based classification of financial statement sentiment improves out-of-sample accuracy by 15 to 25 percentage points compared to the Loughran-McDonald dictionary. De Kok (2023, SSRN working paper) shows that generative LLMs can classify accounting disclosures with no training examples at all (zero-shot classification), reducing the need for hand-labelled data. Bhattacharya and Mickovic (2024, International Journal of Accounting Information Systems) apply contextual language models to fraud detection and find improved detection rates over traditional statistical models.
LLMs can pull structured information from unstructured text with high accuracy: extracting contract terms from filings, identifying relationships between entities (supplier-customer networks, board connections, ownership chains), parsing numbers with their units and context, and identifying events (mergers, restatements, regulatory actions) from news and filings. For researchers, this capability reduces the cost of building large hand-collected datasets, which has long been a bottleneck in accounting research.
The Big Four accounting firms have each announced major AI investments. Deloitte integrated GenAI into its Omnia audit platform for document review and anomaly detection (announced 2024). PwC partnered with OpenAI and Harvey AI, targeting an end-to-end AI-driven audit solution by 2026. KPMG launched its Workbench platform in mid-2025, using multiple AI agents that handle different parts of an engagement, similar to how a human audit team divides work. EY announced a USD 1.4 billion investment in its EY.ai platform, embedding AI across assurance, tax, and advisory (September 2023). Combined, the announced AI investment commitments from the Big Four total about USD 4.4 billion. These are firm-announced figures, not independently audited spending.
Broader adoption numbers tell a story of rapid change. According to the 2024 and 2025 Wolters Kluwer Future Ready Accountant reports, the share of accounting firms using GenAI rose from 9 per cent (2024) to 41 per cent (2025). Thomson Reuters (2025 GenAI in Professional Services Report) found that 21 per cent of tax firms currently use GenAI and 68 per cent of professionals feel excited or hopeful about it. A 2025 Stanford AI Index Report study found junior accounting hiring fell by 16 per cent over roughly two years, directly tied to automation of routine tasks.
Source: Wolters Kluwer, Future Ready Accountant Report (2024 and 2025 editions). Survey of accounting firms globally.
An emerging research area examines whether firms are using LLMs to write or edit their disclosures. Several studies have begun detecting AI-generated text in corporate filings using statistical methods. The capital market implications are important: if some firms use AI to produce lower-cost disclosures while others rely on human-authored text, this could create systematic differences in disclosure quality and informativeness. This connects disclosure theory with the economics of AI adoption and is a natural area for accounting research.
LLMs can help with literature review by summarising papers, pulling out key findings, and identifying connections between bodies of work. Tools built on LLMs (Elicit, Consensus, Scite, Semantic Scholar) let researchers search by research question rather than just by keyword. These tools can miss papers, especially those behind paywalls or in specialist journals. They should supplement, not replace, Scopus and Web of Science searches and snowball sampling from reference lists. For research design, LLMs can help with brainstorming hypotheses, suggesting control variables, and generating alternative explanations to address. The researcher must remain responsible for the hypotheses, the identification strategy, and the interpretation of results.
LLMs perform well on programming tasks in Python, R, and Stata. A practical workflow: write a detailed specification of the analysis in plain language, ask the LLM to generate code for it, review the code, run it on a small test dataset, then iterate with the LLM to fix errors. This can cut coding time by an estimated 30 to 50 per cent for routine tasks (based on informal surveys among academic users; no formal study of time savings in accounting research has been published). The savings are smaller for complex or novel econometric methods. The researcher must understand the code and verify that it implements the intended specification.
LLMs can help with academic writing: improving clarity, suggesting alternative phrasings, checking grammar, formatting references, and translating between languages. They should not generate substantive content the author cannot independently verify. The line between acceptable editing and unacceptable generation is not always sharp, which is why publisher policies emphasise disclosure. LLM writing has identifiable patterns: repetitive sentence openings, overuse of words like "moreover," "furthermore," and "crucially," a tendency toward general claims over concrete detail. Academics using LLMs for writing should actively edit to remove these patterns and ensure the final text reflects their voice.
LLMs have changed assessment design. Traditional take-home assignments asking students to summarise, explain, or analyse can now be done by an LLM in seconds. This has pushed assessment toward tasks that require: applying concepts to specific cases, critically evaluating AI-generated output, oral defence of written work, in-person examinations, and process-based assessment where students document their workflow. On the positive side, LLMs can generate practice problems, explain concepts at different levels of detail, simulate case discussions, and give immediate feedback on drafts. The challenge for educators is to teach students to use these tools effectively and ethically, skills they will need in professional practice.
As of mid-2026, the major publishers have converged on common principles:
COPE (the Committee on Publication Ethics) published a position statement on AI and authorship in 2024 (doi.org/10.24318/cCVRZBms). The unresolved issue as of mid-2026 is AI use in peer review, where detection is hard and norms are still forming.
Dates represent the first formal AI policy issuance by each publisher. Policies may have been updated since.
Accounting and finance are not just observers of the AI safety discussion. Financial institutions are among the largest users of AI, deploying it for credit scoring, fraud detection, algorithmic trading, insurance underwriting, and regulatory compliance. Failures in these systems, whether from model error, manipulation, or correlated errors across institutions, can have economy-wide effects. Accounting academics have relevant expertise in measurement, verification, and governance: how do we measure and audit the performance of AI systems in high-stakes financial settings?
Alignment is the problem of getting AI systems to act in line with human values and intentions. It is hard for several reasons.
Specification gaming (also called reward hacking): an AI finds a way to satisfy its formal goal that is not what humans intended. For example, an AI told to maximise a portfolio's reported return might concentrate holdings in illiquid assets where valuations can be inflated, producing high reported returns without real economic value.
Goal misgeneralisation: a system trained in one setting behaves unexpectedly in another. An AI trained to detect fraud using past data may fail when fraud patterns change, precisely because it learned the old patterns too well.
Scalable oversight: keeping human control as AI systems grow more capable. If an AI can generate a lengthy analysis of a company's financial statements in seconds, no human auditor can review every line.
The regulatory environment is fragmented but developing quickly. The main frameworks as of mid-2026 are:
Frontier AI companies (OpenAI, Anthropic, Google DeepMind, Meta AI, xAI, and major Chinese labs) are the developers of the most capable systems and important voices in governance debates. National AI safety institutes have been established in the UK, US, Japan, and other countries. International coordination happens through the AI Safety Summit series (Bletchley Park 2023, Seoul 2024, Paris 2025) and the International Network of AI Safety Institutes.
For accounting and finance scholars, three intersections deserve attention: how AI governance frameworks interact with existing financial regulation (SEC, ESMA, PCAOB requirements); how AI auditing standards will develop, given accounting firms' central role in assurance; and how AI risk should be disclosed in corporate filings, building on the cybersecurity disclosure framework the SEC has already established.
The most immediate research opportunity is using LLMs to construct new measures from unstructured text. Traditional accounting research relies on word-count measures (Loughran-McDonald sentiment, Fog index readability) that treat text as a bag of words. LLMs allow context-aware measurement of constructs that have been hard to capture: the qualitative tone of management discussion (confident, evasive, defensive, promotional); the specificity of guidance and forecasts; the complexity of business model descriptions; the coherence of strategy narratives; and the mix of boilerplate versus informative disclosure.
Methodologically, this raises questions about construct validity and replicability. LLM-based measures can be sensitive to prompt wording, model version, and sampling parameters. Researchers should document their methods in detail, test sensitivity to specification choices, and validate against human-coded benchmarks where possible.
As firms and analysts use LLMs to produce disclosures and reports, important questions arise: do investors discount AI-generated disclosures relative to human-authored ones? Does AI use in analyst reports affect price formation or information asymmetry? How do market participants distinguish between AI-augmented and AI-generated content? These questions connect the disclosure and capital markets literatures with the economics of AI.
The rapid adoption of AI by audit firms raises questions about the audit production function: how does AI-assisted auditing affect audit quality (restatements, material weaknesses, regulatory findings)? Does AI reduce or increase audit fees? Does it change team structure and skill demands? At the market level, does AI adoption by the Big Four create barriers for smaller firms, or does access to capable open-source models level the field? Li, de Freitas, Lee, and Vasarhelyi (2024, working paper) provide a framework for AI-assisted continuous auditing, but the empirical evidence is still thin.
Just as cybersecurity disclosure became a major research area, AI governance disclosure is likely to follow a similar path. What do firms disclose about their AI use? What drives disclosure quality? Do markets respond to AI governance disclosures? How should auditors provide assurance over AI-related disclosures? The SEC's existing framework for risk factor disclosure and the EU regulatory framework create a natural research setting.
Several new methods are opening for accounting research. Retrieval-Augmented Generation (RAG) lets LLMs ground outputs in specific documents, reducing hallucination by limiting attention to a provided corpus. This has clear audit applications. Multi-agent systems, where several LLMs interact to solve problems, are emerging as a way to handle complex analytical tasks. Explainability methods, including chain-of-thought prompting, are beginning to show how models reach their outputs, with implications for auditability and regulatory compliance.
The 16 per cent decline in junior accounting hiring (Stanford AI Index Report, 2025) is an early signal of structural change. As routine tasks are automated, the profession shifts toward judgment, interpretation, and client communication. This affects accounting education, professional certification, and career paths. Research is needed on how these changes affect the supply of accounting talent, the quality of professional services, and the long-term attractiveness of the profession.
Source: Scopus and Web of Science keyword searches by the author (see ai_accounting_publications.csv for full methodology). 2025 counts are partial (publication lag). 2026 counts are projected from the 2022-2025 trend. All classification into methodological/empirical vs. conceptual/review is based on abstract screening and should be treated as approximate.
Large language models are changing what accounting and finance researchers can measure, how research is done, how students are taught and assessed, and how professional services are delivered. This report has given a primer on how these models work, what they can and cannot do, how they are being used, and where the research opportunities are.
For the individual academic, the practical steps are: learn to use at least one frontier LLM and understand its limits; build a workflow that uses LLMs for appropriate tasks (coding, editing, brainstorming) while keeping intellectual control; stay current with publisher policies and disclose AI use; and explore the research openings these models create, especially around measurement, disclosure, and governance.
For the discipline, the task is to develop the theories, methods, and institutional knowledge needed to understand how AI is reshaping the information environment that accounting and finance scholars study.
Bhattacharya, I., and Mickovic, A. (2024). Accounting fraud detection using contextual language learning. International Journal of Accounting Information Systems, 53.
Brown, T., Mann, B., Ryder, N., et al. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877-1901.
Chowdhery, A., Narang, S., Devlin, J., et al. (2022). PaLM: Scaling language modeling with pathways. arXiv:2204.02311.
de Kok, T. (2023). ChatGPT for textual analysis? How to use generative LLMs in accounting research. SSRN working paper. https://ssrn.com/abstract=4429658
Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. Proceedings of NAACL-HLT, 4171-4186.
Eulerich, M., and Wood, D. A. (2023). A demonstration of how ChatGPT can be used in the internal auditing process. Working paper.
Hoffmann, J., Borgeaud, S., Mensch, A., et al. (2022). Training compute-optimal large language models. arXiv:2203.15556.
Kim, A., Muhn, M., and Nikolaev, V. V. (2024). Financial statement analysis with large language models. SSRN working paper. https://ssrn.com/abstract=4444763
Li, H., de Freitas, M. M., Lee, H., and Vasarhelyi, M. (2024). Enhancing continuous auditing with large language models: AI-assisted real-time accounting information cross-verification. Working paper.
Li, Y., and Goel, S. (2026). Generative artificial intelligence in the Big 4: Auditor adoption and its implications for audit quality. Journal of Information Systems.
Loughran, T., and McDonald, B. (2011). When is a liability not a liability? Textual analysis, dictionaries, and 10-Ks. Journal of Finance, 66(1), 35-65.
Nie, Y., Kong, Y., Dong, X., Mulvey, J. M., Poor, H. V., Wen, Q., and Zohren, S. (2024). A survey of large language models for financial applications: Progress, prospects and challenges. arXiv:2406.11903.
Rae, J. W., Borgeaud, S., Cai, T., et al. (2021). Scaling language models: Methods, analysis and insights from training Gopher. arXiv:2112.11446.
Rafailov, R., Sharma, A., Mitchell, E., Ermon, S., Manning, C. D., and Finn, C. (2023). Direct preference optimization: Your language model is secretly a reward model. arXiv:2305.18290.
Sgantzos, K., Hemairy, M. A., Tzavaras, P., and Stelios, S. (2023). Triple-entry accounting as a means of auditing large language models. Journal of Risk and Financial Management, 16(9), 383.
Toumeh, A. A. (2024). Assessing the potential integration of large language models in accounting practices: evidence from an emerging economy. Future Business Journal, 10, 82.
Touvron, H., Martin, L., Stone, K., et al. (2023). Llama 2: Open foundation and fine-tuned chat models. arXiv:2307.09288.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., and Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30.
Zhao, J., and Wang, X. (2024). Unleashing efficiency and insights: Exploring the potential applications and challenges of ChatGPT in accounting. Journal of Corporate Accounting and Finance, 35(1), 269-276.
Epoch AI (2024). Will we run out of data? Limits of LLM scaling based on human-generated data. https://epoch.ai/publications/will-we-run-out-of-data-limits-of-llm-scaling-based-on-human-generated-data
Epoch AI (2026). Trends in artificial intelligence. https://epoch.ai/trends
LMArena (2026). Chatbot Arena Leaderboard. https://lmarena.ai/
Reuters (2023, February 2). ChatGPT sets record for fastest-growing user base. https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/
SemiAnalysis (2023, March). GPT-4 architecture, infrastructure, training dataset, costs, vision, MoE. https://www.semianalysis.com/
Stanford University, Human-Centered AI (2025). AI Index Report 2025. https://aiindex.stanford.edu/
Thomson Reuters Institute (2025). 2025 Generative AI in Professional Services Report. https://www.thomsonreuters.com/en-us/posts/tax/2025-genai-professional-services
Vectara (2025-2026). Hallucination Leaderboard. https://github.com/vectara/hallucination-leaderboard
Wolters Kluwer (2024, 2025). Future Ready Accountant Report. https://www.wolterskluwer.com/en/know/future-ready-accountant
COPE (2024). Authorship and AI. https://doi.org/10.24318/cCVRZBms
Council of Europe (2024). Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law. https://www.coe.int/
Elsevier (2025). Generative AI policies for journals. https://www.elsevier.com/about/policies-and-standards/generative-ai-policies-for-journals
European Commission (2024). AI Act: Regulation (EU) 2024/1689. https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai
Executive Order 14110 (2023). Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence. https://www.whitehouse.gov/
NIST (2024). AI Risk Management Framework. https://www.nist.gov/itl/ai-risk-management-framework
OECD (2024). Recommendation on Artificial Intelligence (updated). https://oecd.ai/en/
Springer Nature (2025). AI principles and policies. https://www.springernature.com/
The following datasets and scripts are available for download. All data were compiled from public sources and cross-checked where possible. See data/README_methodology.txt for full documentation of sources, compilation methods, and known limitations for each dataset.
| File | Description | Format |
|---|---|---|
| llm_parameter_timeline.csv | Parameter counts, training compute, and release dates for major LLMs (2017-2026). Confirmed values sourced from original papers; estimated values marked. | CSV |
| llm_arena_scores.csv | LMArena (LMSYS Chatbot Arena) Elo scores, approximate quarterly snapshots (2023 Q2 to 2026 Q2) | CSV |
| llm_hallucination_rates.csv | Hallucination rates on document summarisation, Vectara HHEM leaderboard (2024-2026). Post-Q3 2025 values estimated. | CSV |
| accounting_ai_adoption.csv | AI adoption rates from Wolters Kluwer (2024, 2025) and Thomson Reuters (2025) surveys | CSV |
| publisher_ai_policies.csv | First AI policy adoption dates for major academic publishers (2023-2024) | CSV |
| ai_regulation_timeline.csv | Major global AI regulatory milestones (2021-2026) | CSV |
| ai_accounting_publications.csv | AI-related publications in top accounting journals (2017-2026). 2025 partial; 2026 projected. | CSV |
| big4_ai_investments.csv | Big Four announced AI investment commitments and platform details | CSV |
| README_methodology.txt | Full documentation: sources, compilation methods, and limitations for all datasets | TXT |
| scripts/replicate.py | Python replication script regenerating all charts and statistics from source data | PY |