--- title: "Computational Epistemology: Foundations for the Assessment of Propositional Validity in AI Systems" subtitle: "Why Retrieval Cannot Establish Truth and What Must Replace It" format: arxiv-pdf: keep-tex: true linenumbers: false doublespacing: false runninghead: "Computational Epistemology" pdf-engine: pdflatex arxiv-html: default author: - name: Gerd Graßhoff affiliations: - name: Deutsches Museum department: Forschungsinstitut address: Museumsinsel 1 city: München country: Germany postal-code: 80538 - name: Humboldt-Universität zu Berlin department: Institute of Philosophy address: Unter den Linden 6 city: Berlin country: Germany postal-code: 10099 orcid: 0000-0002-4450-357X email: gerd.grasshoff@hu-berlin.de url: https://www.philosophie.hu-berlin.de/de/institut/mitarbeiter/grasshoff abstract: | [DRAFT SKELETON - NOT FOR CITATION] This article establishes the foundational framework for computational epistemology—the systematic, machine-supported assessment of propositional validity in textual sources. Contemporary retrieval-augmented generation (RAG) systems commit a fundamental category error: they operate on sentences (linguistic objects) whilst purporting to deliver knowledge of propositions (semantic contents that alone can be true or false). I demonstrate that retrieval cannot establish validity, since validity is a property of arguments (structured relations among propositions), not a relation of textual similarity. The article develops the conceptual architecture for an alternative approach: systems that reconstruct argumentative structure, trace evidential relations, and direct inquiry toward the substantiation of premises. This framework integrates with AI-mediated document processing to enable genuine computational support for scholarly assessment of claims, moving beyond retrieval toward evaluation. The goal is not to replace human epistemic judgement but to provide infrastructure for rigorous, evidence-directed inquiry at scale. keywords: - computational epistemology - propositional validity - argument reconstruction - retrieval-augmented generation - evidence assessment - philosophy of artificial intelligence - knowledge representation bibliography: computational-epistemology-bibliography.bib --- # Part I: Prolegomena — Linguistic and Conceptual Foundations ## Section 0: Philosophical Foundations and Methodological Commitments {#sec-foundations} ### Core Argument Before introducing the technical apparatus of computational epistemology, we must make explicit the philosophical tradition within which this inquiry proceeds. The considerations developed in this article are grounded in **analytic philosophy**—specifically, in its understanding of the philosophy of language, logic, and practical reasoning. This is not an arbitrary methodological choice but a necessary one: the questions of propositional validity, truth-preservation, and evidential support that concern us here can only be addressed with the conceptual precision that the analytic tradition provides. More specifically, this work is grounded in **Wittgenstein's philosophy**—both the early philosophy of the *Tractatus Logico-Philosophicus* and the later philosophy developed in the *Philosophical Investigations* and *On Certainty*. This dual grounding is not eclectic but principled: the *Tractatus* provides the logical framework for understanding propositions as pictures of facts and the conditions of meaningful discourse; the later work provides the framework for understanding meaning as use, language-games, and—crucially for computational systems—**rule-following**. ### Why These Foundations Matter for Computational Epistemology The motivation for making these commitments explicit is threefold: 1. **Against conceptual confusion**: Contemporary AI discourse is rife with category errors—speaking of "AI knowledge," "model beliefs," and "emergent understanding" without any rigorous analysis of what these terms could mean. Analytic philosophy provides the tools to dissolve such confusions. 2. **For hermeneutical adequacy**: The interpretation of texts—the extraction of propositional content from sentences—presupposes a theory of meaning. Wittgenstein's concept of meaning as use, and his analysis of rule-following, provides the foundation for understanding how AI models can be trained to interpret texts according to established practices. 3. **For computational implementation**: AI models do not access "meanings" directly; they process tokens according to learned patterns. The question of whether such processing constitutes genuine understanding, or merely simulates it, is precisely the question Wittgenstein's rule-following considerations address. ### Key Claims 1. **The analytic tradition as methodological framework**: This article proceeds within the tradition of Frege, Russell, the early and later Wittgenstein, and their successors. The central commitment is to **conceptual clarity through logical analysis**—the disambiguation of terms, the explicit statement of presuppositions, and the rigorous evaluation of arguments. 2. **The Tractarian foundation**: From the *Tractatus* we inherit: - The proposition (*Satz*) as the fundamental unit of meaning - Propositions as pictures (*Bilder*) of facts (*Tatsachen*) - The logical space within which propositions have determinate truth-values - The distinction between what can be said and what can only be shown These commitments ground the treatment of propositions in Section 1 and the analysis of validity in Part III. 3. **The later Wittgenstein and rule-following**: From the *Philosophical Investigations* and *On Certainty* we inherit: - Meaning as use (*Bedeutung als Gebrauch*) within language-games - The impossibility of private rule-following (the rule-following considerations, PI §§138–242) - The bedrock of certainty: propositions that stand fast (*stehen fest*) as hinges of our epistemic practices (OC §§341–343) - Understanding as mastery of a technique, not possession of a mental state 4. **Rule-following and AI training**: The rule-following considerations are of central importance for computational epistemology. Wittgenstein asks: what constitutes following a rule correctly? His answer—that rule-following is a practice embedded in forms of life, not a matter of grasping abstract meanings—has direct implications for AI: - AI models are trained to follow rules (patterns) established by human practice - The "correctness" of AI outputs is parasitic on human normative practices - AI systems can be trained to adhere to rules, but this adherence is constituted by agreement with human judgements, not by access to meanings 5. **Hermeneutics grounded in Wittgensteinian practice**: The interpretation of texts—central to argument reconstruction—is not a matter of divining authorial intentions but of applying shared interpretive practices. These practices are rule-governed in Wittgenstein's sense: they can be taught, corrected, and extended, but cannot be reduced to explicit algorithms. ### The Motivation for Each Subsequent Distinction Every technical distinction introduced in this article is motivated by a specific problem that cannot be resolved without it: | Distinction | Motivating Problem | Wittgensteinian Connection | |-------------|-------------------|---------------------------| | Sentence vs. Proposition | AI processes tokens, not meanings | *Tractatus*: the proposition is not the sentence-sign (3.12) | | Proposition vs. Statement | Same content, different assertoric force | *PI*: meaning is use in context | | Validity vs. Truth | Valid arguments can have false conclusions | *Tractatus*: logical necessity (6.37) | | Retrieval vs. Justification | Finding is not knowing | *OC*: grounds must come to an end (§204) | | Rule-following vs. Interpretation | AI outputs require normative assessment | *PI*: rule-following paradox (§201) | ### Wittgenstein on Rule-Following: The Core Insight The rule-following considerations (PI §§138–242) establish a fundamental point: **there is no fact about an individual, considered in isolation, that determines what rule they are following**. This is not scepticism about rules but an insight into their nature: rules are constituted by practices, and practices are social. For AI systems, this means: - An AI model's outputs are not self-interpreting - Whether the model is "following the rule correctly" is determined by comparison with human practice - Training is the inculcation of patterns of response that accord with human judgements - There is no deeper fact about "what the model really means" This grounds our insistence that AI serves as epistemic *assistant*, not *oracle* (Section 16): the AI's outputs require human assessment precisely because correctness is not intrinsic to the outputs but relational to our practices. ### On Certainty and the Limits of Justification *On Certainty* addresses the structure of epistemic justification. Wittgenstein argues that justification must come to an end—not in self-evident axioms, but in propositions that "stand fast" for us, that function as hinges (*Angeln*) around which our inquiries turn: > "The questions that we raise and our doubts depend on the fact that some propositions are exempt from doubt, are as it were like hinges on which those turn." (OC §341) For computational epistemology, this means: - Not every proposition requires (or admits of) justification - Some propositions function as presuppositions of inquiry, not objects of inquiry - The demand for universal justification leads to regress; practice provides the stopping point - AI systems must be calibrated against human practices that embody these certainties ### Epistemic Systems and Action-Oriented Knowledge Acquisition A further foundational commitment of this article derives from earlier work on the methodology of scientific discovery, developed systematically in *Die Kunst wissenschaftlicher Entdeckungen* [@Grashoff1995-zj] and elaborated in subsequent publications on experimental methodology, causal reasoning, and model construction [@Grashoff2001-sn; @Baumgartner2003-iq; @Grashoff1998-mb]. In these works, I argued for the introduction of **epistemic systems** (*epistemische Systeme*)—action-oriented frameworks in which scientific activities are understood as goal-directed operations aimed at knowledge acquisition. The central insight was that knowledge is not passively received but actively produced through structured sequences of epistemic actions: observation, experimentation, inference, and argumentation. This action-oriented conception of epistemology provides the conceptual foundation for understanding contemporary AI agents and sub-agents. What are today called "agents" and "agentic systems" in the AI literature are nothing other than **mechanical actors operating within epistemic systems**. They execute sequences of actions—querying, retrieving, reasoning, planning—directed toward epistemic goals. The vocabulary has changed; the conceptual structure remains. The implications for computational epistemology are profound: 1. **Agents as epistemic actors**: AI agents are not merely information processors but participants in epistemic systems, executing actions aimed at knowledge states. 2. **Sub-agents and epistemic division of labour**: Just as human inquiry involves division of labour (the observer, the analyst, the critic), agentic AI systems decompose epistemic tasks into sub-tasks performed by specialised sub-agents. 3. **Goal-directedness**: Epistemic systems are teleological—they aim at knowledge. AI agents inherit this teleology: they are designed to achieve epistemic goals (answer questions, verify claims, discover patterns). 4. **Action sequences as inference chains**: The sequence of actions an agent performs constitutes an inference chain. Each action transforms the epistemic state; the chain as a whole moves from initial uncertainty toward (one hopes) justified belief. 5. **Normative assessment of agents**: Just as human epistemic actions are subject to normative assessment (was the observation careful? was the inference valid?), AI agent actions are subject to analogous assessment. The framework of epistemic systems provides the criteria. This conceptual continuity—from epistemic systems as theorised in 1995 to agentic AI systems in 2025—demonstrates that the foundations of computational epistemology were laid before the technology existed to implement them. The task now is to make explicit the epistemological commitments implicit in agentic AI and to assess whether these systems genuinely achieve epistemic goals or merely simulate doing so. ### Key Citations - [cite:wittgenstein-1921-tractatus] — Propositions as pictures; logical space; the limits of language - [cite:wittgenstein-1953-pi] — Meaning as use; rule-following; language-games - [cite:wittgenstein-1969-certainty] — The structure of justification; hinge propositions - [cite:kripke-1982-wittgenstein] — The rule-following paradox and its resolution - [cite:mcDowell-1984-wittgenstein] — Non-reductive reading of rule-following - [cite:baker-hacker-1984-scepticism] — Wittgenstein: rules, grammar, necessity - [cite:frege-1892-sinn] — The foundations of the analytic tradition ### Notes for Development - Develop the connection between Tractarian picture theory and computational representation - Elaborate on how AI training exemplifies Wittgensteinian rule-following - Discuss the implications of "meaning as use" for natural language processing - Address potential objections: Is AI rule-following genuine, or mere causal regularity? - Connect to contemporary debates on LLMs and understanding (Bender & Koller, etc.) ### Cross-References - See @sec-terminology for the sentence/proposition distinction (Tractarian foundation) - See @sec-ai-assistant for the role of human judgement (rule-following implications) - See @sec-community-arbiter for the social constitution of epistemic norms --- ## Section 1: The Necessity of Terminological Precision {#sec-terminology} ### Motivation Why begin with terminological distinctions? Because **conceptual confusion is the primary obstacle to clear thinking about AI and knowledge**. When practitioners speak of "knowledge bases," "true information," and "model understanding," they employ terms with precise philosophical meanings in ways that obscure rather than illuminate. The sentence/proposition distinction is not pedantry; it is the foundation without which no coherent account of truth, validity, or justification is possible. The motivation is practical as well as theoretical: computational systems process *sentences* (sequences of tokens). Whether such processing bears any relation to *propositional* content—to meanings, truth-conditions, and logical relations—is precisely what must be established, not assumed. The terminological apparatus developed here provides the framework for that investigation. ### Core Argument Contemporary discourse concerning artificial intelligence and knowledge is vitiated by a pervasive conflation of distinct conceptual categories. When we speak of "AI knowing things" or "models containing true information," we systematically confuse linguistic objects with semantic contents. This section establishes, with the precision demanded by the analytic tradition, the fundamental distinctions without which no coherent computational epistemology is possible. ### Key Claims 1. **Sentences are linguistic entities**: A sentence is a syntactically well-formed string of symbols in a natural or formal language. The English sentence "Snow is white" and the German sentence "Schnee ist weiß" are distinct sentences. 2. **Propositions are semantic contents**: A proposition is what a declarative sentence expresses—its meaning or content. The two distinct sentences above express the *same* proposition: that snow is white. 3. **Only propositions bear truth-values**: It is a category error to predicate truth or falsity of a sentence *qua* syntactic object. The sentence "Snow is white" is neither true nor false; the proposition *that snow is white* is true. 4. **Statements are propositions-in-context**: A statement is a proposition asserted by a speaker in a particular context. Aristotle's statement that the heavens are unchanging differs from Galileo's denial of that same proposition. 5. **Facts are obtaining states of affairs**: A fact is not a true proposition but what *makes* a proposition true—the worldly correlate that grounds truth. The fact of snow's being white is the truth-maker for the proposition that snow is white. ### Terminological Table | Term | Category | Definition | Example | |------|----------|------------|---------| | Sentence | Linguistic | Syntactically well-formed expression | "The Earth orbits the Sun" | | Proposition | Semantic | Content expressed by declarative sentence | *that the Earth orbits the Sun* | | Statement | Pragmatic | Proposition asserted in context | Copernicus's heliocentric claim | | Truth-bearer | Logical | That which can be true or false | Propositions (not sentences) | | Fact | Ontological | Obtaining state of affairs | The Earth's actual orbit | | Belief | Psychological | Propositional attitude | S believes *that p* | | Knowledge | Epistemological | Justified true belief (with caveats) | S knows *that p* | ### Key Citations - [cite:frege-1892-sinn] — The foundational distinction between Sinn (sense) and Bedeutung (reference) - [cite:russell-1905-denoting] — Analysis of propositional content and definite descriptions - [cite:wittgenstein-1921-tractatus] — Propositions as pictures of facts - [cite:quine-1960-word] — The indeterminacy of translation and meaning - [cite:davidson-1984-truth] — Truth-conditional semantics ### Notes for Development - Include Frege's example: "The morning star" and "the evening star" refer to the same object (Venus) but differ in sense - Discuss the proposition/sentence distinction in the context of translation: same proposition, different sentences - Note that computational systems process sentences (token sequences); the question is their relation to propositions ### Cross-References - See @sec-rag-category-error for how this conflation operates in RAG systems - See @sec-propositions-arguments for the role of propositions in argumentative structure --- ## Section 2: Propositions as the Objects of Knowledge {#sec-propositions-knowledge} ### Motivation Why must we analyse knowledge in terms of propositions? Because **the attribution of knowledge to AI systems is conceptually confused without such analysis**. When we ask whether an AI "knows" something, we are asking whether it stands in an appropriate relation to a propositional content—not to a sentence or a token sequence. The epistemological tradition, from Plato through contemporary analytic philosophy, has developed a sophisticated apparatus for analysing this relation. Ignoring this apparatus leads to pseudo-questions ("Does GPT-4 really know things?") that cannot be coherently answered. The motivation is also methodological: Wittgenstein's *On Certainty* shows that knowledge-claims presuppose a background of certainties that are not themselves objects of knowledge but conditions of its possibility. Understanding this structure is essential for designing systems that make knowledge-claims and for assessing such claims when made. ### Core Argument Knowledge is fundamentally a relation between a cognitive agent and a proposition. One does not know a sentence; one knows *that p*, where *p* is a propositional content. The classical analysis identifies knowledge with justified true belief, though post-Gettier epistemology has complicated this picture. For computational epistemology, the critical point is that any system purporting to deliver or assess knowledge must operate at the level of propositions, not merely sentences. ### Key Claims 1. **The propositional structure of knowledge**: Knowledge-that is the paradigmatic form. S knows *that p* requires: - p is a proposition - p is true - S believes that p - S is justified in believing that p (or: S's belief is non-accidentally true) 2. **The Gettier problem and its aftermath**: Justified true belief is not sufficient; lucky true beliefs fail to constitute knowledge [cite:gettier-1963]. Various responses: - Reliabilism: belief must be produced by a reliable process [cite:goldman-1979] - Virtue epistemology: belief must manifest intellectual virtue [cite:sosa-2007] - Knowledge-first: knowledge is primitive, not analysable [cite:williamson-2000] 3. **Relevance for computational systems**: A system cannot deliver *knowledge* merely by retrieving sentences. It must: - Identify propositional content - Assess truth-conditions - Track justificatory relations - Avoid epistemic luck 4. **The distinction between information and knowledge**: Information (in Shannon's sense) is a measure of uncertainty reduction. Knowledge requires more: truth, justification, and appropriate connection to reality. ### Key Citations - [cite:plato-theaetetus] — The classical locus for knowledge as justified true belief - [cite:gettier-1963] — The famous counterexamples - [cite:goldman-1979] — Reliabilist epistemology - [cite:williamson-2000] — Knowledge as the most general factive mental state - [cite:sosa-2007] — Virtue epistemology ### Notes for Development - Provide a Gettier case to illustrate why justified true belief is insufficient - Discuss whether AI systems can be said to "believe" propositions - Consider the distinction between first-person and third-person knowledge attributions ### Cross-References - See @sec-evidence-justification for the structure of justification - See @sec-ai-assistant for the proper role of AI in knowledge acquisition --- ## Section 3: The Architecture of Arguments {#sec-propositions-arguments} ### Motivation Why introduce arguments as structured sets of propositions? Because **the assessment of reasoning in texts requires identifying argumentative structure, and this structure is propositional, not sentential**. A text may contain many sentences, but only some of them express premises; only one (typically) expresses the conclusion; and the relations among them—support, inference, implication—are logical relations among propositions. Without this analysis, we cannot distinguish valid from invalid reasoning, cannot identify missing premises (enthymemes), and cannot reconstruct the inferential structure that authors intended but did not make explicit. The architecture of arguments is the foundation for all subsequent work on validity assessment and argument reconstruction. ### Core Argument An argument is not a sentence or a collection of sentences; it is a structured set of propositions standing in logical relations. An argument consists of premises (propositions offered as reasons) and a conclusion (the proposition for which reasons are offered). Understanding this structure is essential for any system that would assess the validity of reasoning in texts. ### Key Claims 1. **The abstract structure of arguments**: - An argument is an ordered pair: ⟨{P₁, P₂, ... Pₙ}, C⟩ - The Pᵢ are the premises (a set of propositions) - C is the conclusion (a single proposition) - The premises are offered as support for the conclusion 2. **Arguments are not sentences**: The sentences used to express an argument are distinct from the argument itself. The same argument may be expressed in different languages using different sentences. 3. **The distinction between argument and inference**: - Argument: a static structure of propositional relations - Inference: a mental act of moving from premises to conclusion - Implication: a logical relation (if P then Q) 4. **Enthymemes and implicit premises**: Real-world arguments rarely state all premises explicitly. Argument reconstruction must identify suppressed premises required for validity. ### Structural Diagram ``` ARGUMENT STRUCTURE Premises: P₁: All humans are mortal. P₂: Socrates is human. ───────────────────────── Conclusion: C: Socrates is mortal. Formal representation: {P₁, P₂} ⊢ C ``` ### Key Citations - [cite:aristotle-prior-analytics] — The syllogistic as the first formal theory of argument - [cite:toulmin-1958-uses] — The layout of arguments: claim, data, warrant, backing - [cite:walton-1996-schemes] — Argumentation schemes for presumptive reasoning ### Notes for Development - Contrast deductive arguments (validity as truth-preservation) with inductive arguments (strength as probability-raising) - Discuss the Toulmin model as an alternative to classical logic - Consider how natural language obscures argumentative structure ### Cross-References - See @sec-validity-soundness for the definition of validity - See @sec-argument-reconstruction for extracting arguments from text --- ## Section 4: Inference, Reasoning, and Explanation {#sec-inference-reasoning} ### Motivation Why distinguish inference, reasoning, and explanation as separate cognitive operations? Because **contemporary AI systems conflate these operations in ways that obscure their epistemic status**. When an LLM produces a "chain-of-thought," is it inferring, reasoning, or explaining? The answer matters profoundly: inference is truth-preserving (when valid); practical reasoning is action-directed; explanation is retrospective justification. Each has different success conditions and different relations to truth. Moreover, Wittgenstein's rule-following considerations bear directly on each operation. Inference follows rules—but what constitutes following a logical rule correctly? The *Tractatus* presents logical inference as movement within logical space, determined by the internal relations of propositions. The *Investigations* asks how such rule-following is possible given that no interpretation of a rule determines its application. For AI systems, this means: the "correctness" of an inference is not intrinsic to the computational process but is judged against human inferential practice. The distinction between theoretical and practical reasoning is also Wittgensteinian: the *Investigations* distinguishes sharply between reasons that justify belief and reasons for action. AI planning systems engage in practical reasoning; this does not entail that they assess propositional truth. ### Core Argument Epistemology stands at the junction of three fundamental cognitive operations: inference, reasoning, and explanation. Inference is the truth-preserving transition from premises to conclusions—a walk through logical space that, when valid, guarantees the transmission of truth. Reasoning encompasses the broader activity of constructing and evaluating such transitions, whether in theoretical inquiry or practical deliberation. Explanation provides the reasons why a thesis—an asserted proposition—is true or false. Each of these operations admits of distinct logical forms: propositional logic, predicate logic, causal reasoning, and practical reasoning. Modern AI systems, when they develop plans, engage in a form of practical reasoning; yet this activity must be distinguished from the epistemic assessment of propositional truth. ### Key Claims 1. **Inference as truth-preserving transition**: Inference is the movement from premises to conclusion. In deductive inference, this movement is truth-preserving: if the premises are true, the conclusion must be true. This is the core of logical validity. 2. **Propositional and predicate logic as formal frameworks**: - **Propositional logic**: Concerns relations among whole propositions (P, Q, R) connected by logical operators (∧, ∨, →, ¬). Validity is determined by truth-functional structure. - **Predicate logic**: Analyses the internal structure of propositions into subjects, predicates, and quantifiers (∀x, ∃x). Enables reasoning about properties and relations. 3. **Causal reasoning as a distinct mode**: Causal inference moves from observed regularities to causal claims. This involves: - Identification of causal regularities in data [@Grashoff2001-wj; @Baumgartner2003-iq] - Distinction between correlation and causation - Counterfactual reasoning: "If C had not occurred, E would not have occurred" - Causal models and directed acyclic graphs 4. **Practical reasoning as action planning**: Practical reasoning moves from goals and beliefs to intended actions: - Premise: Agent A desires goal G - Premise: Action X is a means to G - Conclusion: A should (intends to) do X This is the form of reasoning modern AI systems employ when developing plans. It is a sequence of action-directed inferences, not truth-directed inferences. 5. **Explanation as providing reasons for truth**: Explanation answers the question "Why is P true?" (or "Why is P false?"). To explain a thesis is to provide the reasons—the premises and inferences—that ground its truth-value. Explanation is thus the articulation of the argumentative structure that supports or undermines a proposition. 6. **The epistemological junction**: Epistemology is concerned with all three: - **Inference**: How do we move validly from what we know to what we can conclude? - **Reasoning**: How do we construct, evaluate, and critique such inferences? - **Explanation**: How do we articulate the grounds for propositional truth? ### Logical Forms Compared | Mode | Premises | Conclusion | Relation | Example | |------|----------|------------|----------|---------| | **Propositional** | P → Q, P | Q | Truth-functional | If it rains, the ground is wet. It rains. ∴ The ground is wet. | | **Predicate** | ∀x(Fx → Gx), Fa | Ga | Quantificational | All humans are mortal. Socrates is human. ∴ Socrates is mortal. | | **Causal** | C regularly precedes E, intervention analysis | C causes E | Causal regularity | Heating water causes boiling. | | **Practical** | Goal G, Means M to G | Intention to do M | Means-end | I want coffee. The café sells coffee. ∴ I shall go to the café. | ### The Structure of Explanation ``` EXPLANATORY STRUCTURE Explanandum (thesis to be explained): "Why is P true?" or "Why did E occur?" Explanans (the explanation): - Background conditions: C₁, C₂, ... Cₙ - Causal or logical laws: L₁, L₂, ... Lₘ - Inferential chain: From {C₁...Cₙ, L₁...Lₘ} derive P (or E) The explanation shows WHY the thesis is true by exhibiting the premises and inferences that necessitate (or probabilify) its truth. ``` ### Practical Reasoning in AI Planning Modern AI systems engage in practical reasoning when they: - Decompose goals into subgoals - Identify actions that achieve subgoals - Sequence actions into executable plans - Evaluate plans against constraints This is genuine reasoning, but it is *practical* (action-directed), not *theoretical* (truth-directed). The AI system asks "What should I do to achieve G?" not "What is true about the world?" The epistemological assessment of propositions requires theoretical reasoning—the evaluation of truth-values through evidence and inference. ### The Distinction: Planning vs. Knowing | Dimension | Practical Reasoning (Planning) | Theoretical Reasoning (Knowing) | |-----------|-------------------------------|--------------------------------| | Goal | Achieve an outcome | Establish truth | | Question | "What should I do?" | "What is true?" | | Success criterion | Goal achieved | Proposition justified | | Failure | Plan fails | Belief unjustified | | Output | Action sequence | Justified belief | AI systems that excel at planning (e.g., chain-of-thought prompting, tool use, agentic workflows) are not thereby epistemically reliable. The capacity to devise effective plans is distinct from the capacity to assess propositional truth. ### Key Citations - [cite:aristotle-prior-analytics] — The syllogistic and demonstrative reasoning - [cite:frege-1879-begriffsschrift] — The foundation of predicate logic - [@Grashoff2001-wj] — Causal regularities and causal reasoning methodology - [@Baumgartner2003-iq] — Kausalität und kausales Schliessen - [cite:hempel-1965-aspects] — The deductive-nomological model of explanation - [cite:bratman-1987-intention] — Intention, plans, and practical reason - [cite:anscombe-1957-intention] — Practical reasoning and intentional action ### Notes for Development - Elaborate the distinction between deductive and inductive inference - Provide examples of causal reasoning from history of science (e.g., Semmelweis, Snow) - Discuss how LLM "chain-of-thought" is practical reasoning, not epistemic validation - Connect to AI planning literature (STRIPS, hierarchical task networks) ### Cross-References - See @sec-propositions-arguments for the structure of arguments - See @sec-validity-soundness for validity in deductive inference - See @sec-ai-assistant for the proper role of AI in epistemic inquiry --- # Part II: The Fundamental Inadequacy of Current RAG Systems ## Motivation for Part II Why devote an entire part to the critique of RAG systems? Because **RAG represents the dominant paradigm for "grounding" AI outputs in knowledge, yet this paradigm is epistemically bankrupt**. The critique is not merely technical but conceptual: RAG systems commit category errors that no amount of engineering can remedy, because the errors are philosophical, not implementational. From a Wittgensteinian perspective, the fundamental problem is this: RAG systems operate on sentence-tokens (signs) without access to their use in language-games. The *Tractatus* insists that the proposition is not the sentence-sign (*Satzzeichen*) but rather the sentence-sign in its projective relation to the world (3.12). RAG retrieves sentence-signs without this projective relation. The later Wittgenstein would observe that meaning is use—and retrieval based on distributional similarity captures patterns of use only superficially, without the normative dimension that constitutes genuine understanding. The sections that follow demonstrate, in detail, why retrieval cannot establish truth, why similarity is not validity, and why the entire enterprise of "retrieval-augmented generation" is epistemically confused. ## Section 5: What Retrieval-Augmented Generation Actually Does {#sec-rag-mechanism} ### Motivation We begin with a descriptive account: what does RAG actually do? This is necessary because **much confusion arises from imprecise descriptions of RAG capabilities**. By specifying the operations precisely, we can then assess their epistemic status rigorously. ### Core Argument To assess the epistemic capacities of RAG systems, we must first understand what they actually do. A RAG system: (1) encodes a query as a vector embedding, (2) retrieves corpus chunks with similar embeddings, and (3) conditions a generative model on the retrieved context. At no point does this process evaluate propositional content, assess logical relations, or weigh evidence. It operates entirely at the level of sentence similarity. ### Key Claims 1. **Vector embeddings encode distributional semantics**: Words and sentences are embedded in high-dimensional spaces based on co-occurrence patterns. Similar embeddings indicate similar distributional profiles, not semantic equivalence. 2. **Retrieval is a similarity relation on sentences**: The retrieval operation finds corpus sentences (or chunks) that are "near" the query in embedding space. This is a relation on linguistic objects, not propositions. 3. **Conditioning does not constitute evaluation**: When a generative model is conditioned on retrieved context, it produces text consistent with that context. This is pattern completion, not truth assessment. 4. **The absence of logical structure**: RAG systems have no representation of: - Propositional content (as distinct from sentences) - Argumentative structure (premises and conclusions) - Logical relations (entailment, contradiction, independence) - Evidential relations (what supports what) ### Technical Schema ``` RAG PIPELINE (Epistemic Audit) 1. Query: "What causes tides?" ↓ 2. Embedding: query → vector v_q ∈ ℝⁿ ↓ 3. Retrieval: find corpus chunks c_i where sim(v_q, v_cᵢ) > threshold ↓ 4. Context: concatenate retrieved chunks ↓ 5. Generate: LLM(query + context) → response EPISTEMIC STATUS AT EACH STAGE: - Stage 1: A sentence (linguistic object) - Stage 2: A numerical representation (not semantic content) - Stage 3: Similar sentences (not verified propositions) - Stage 4: Text aggregation (not logical synthesis) - Stage 5: Fluent continuation (not justified assertion) NO STAGE INVOLVES: ✗ Propositional content identification ✗ Truth-value assessment ✗ Logical relation evaluation ✗ Evidential weight calculation ``` ### Key Citations - [cite:lewis-2020-rag] — Original RAG architecture - [cite:borgeaud-2022-retrieval] — RETRO and retrieval-enhanced LLMs - [cite:bender-2020-climbing] — The octopus test: LLMs and meaning - [cite:marcus-2020-next] — Limitations of neural approaches to reasoning ### Notes for Development - Include concrete examples of RAG retrieving irrelevant but similar sentences - Discuss the difference between distributional and denotational semantics - Consider the analogy: RAG is to knowledge as a library catalogue is to truth ### Cross-References - See @sec-rag-category-error for the philosophical analysis of RAG's limitations - See @sec-computational-validity for the alternative architecture --- ## Section 6: The Category Error — Retrieval as Pseudo-Justification {#sec-rag-category-error} ### Core Argument RAG systems commit a fundamental category error: they treat the retrieval of similar sentences as if it constituted justification for propositional claims. But retrieval is not justification. The mere fact that a sentence appears in a corpus—however authoritative the corpus—does not establish the truth of the proposition that sentence expresses. The proposition must be *evaluated*, not merely *found*. ### Key Claims 1. **Similarity is not entailment**: Two sentences may be similar in embedding space whilst expressing logically independent, or even contradictory, propositions. 2. **Co-occurrence is not evidence**: That two sentences appear in proximity (and thus might be co-retrieved) does not establish any evidential relation between the propositions they express. 3. **Relevance is not truth**: A retrieved sentence may be highly relevant to the query whilst expressing a false proposition. Relevance and truth are orthogonal. 4. **Retrieval is not inference**: Inference is a logical operation on propositions (deriving conclusions from premises). Retrieval is a similarity operation on sentences (finding nearby vectors). 5. **The category error**: To present a retrieved sentence as an answer to a question is to confuse: - The syntactic level (sentences) with the semantic level (propositions) - The operational level (retrieval) with the epistemic level (justification) ### Illustrative Cases **Case 1: Contradictory Retrievals** - Query: "Is the Earth flat?" - Retrieved: "The Earth is flat according to Flat Earth Society." (high similarity) - Retrieved: "The Earth is an oblate spheroid." (high similarity) - Problem: Both retrieved; no mechanism to adjudicate truth. **Case 2: Relevant but False** - Query: "What is the phlogiston theory?" - Retrieved: "Combustion releases phlogiston from burning materials." - Problem: Sentence is relevant and historically accurate *as a report of the theory*, but the proposition *that combustion releases phlogiston* is false. **Case 3: True but Irrelevant** - Query: "What caused the 2008 financial crisis?" - Retrieved: "The sun rose on 15 September 2008." - Problem: The retrieved proposition is true but irrelevant to the causal question. ### Key Citations - [cite:ryle-1949-concept] — The concept of a category mistake - [cite:floridi-2011-information] — Philosophy of information and semantic content - [cite:michael-2023-nlp] — Evaluating factual accuracy in language models ### Notes for Development - Develop the category error concept with reference to Ryle's original formulation - Discuss how the appearance of authority (e.g., Wikipedia as corpus) masks the absence of evaluation - Consider the pragmatic effects: users treat RAG outputs as if they were justified ### Cross-References - See @sec-terminology for the sentence/proposition distinction - See @sec-validity-soundness for what validity actually requires --- ## Section 7: Why Retrieval Cannot Establish Validity {#sec-rag-validity-failure} ### Core Argument Validity is a property of arguments—structured sets of propositions. An argument is valid if and only if, necessarily, if the premises are true, then the conclusion is true. RAG systems have no access to argumentative structure: they do not identify premises, conclusions, or logical relations. Therefore, they cannot in principle assess validity. The question of whether an argument is valid is not a question about sentence similarity; it is a question about the logical relations among propositions. ### Key Claims 1. **Validity is a logical property of arguments**: An argument is valid iff there is no possible world in which the premises are true and the conclusion false. 2. **RAG operates on sentences, not propositions**: As established in @sec-terminology, RAG manipulates linguistic objects (sentences) via their vector representations. It has no access to propositional content. 3. **RAG has no representation of argumentative structure**: To assess validity, one must: - Identify which propositions are premises - Identify which proposition is the conclusion - Evaluate the logical relation between them - RAG performs none of these operations 4. **The impossibility in principle**: Even a perfect retrieval system—one that found all and only relevant sentences—could not assess validity, because validity is not determined by which sentences exist but by logical relations among the propositions they express. 5. **Implications**: RAG systems cannot: - Distinguish valid from invalid arguments - Identify enthymemes (missing premises) - Detect non sequiturs - Assess inferential strength ### Validity and RAG Compared | Dimension | Validity Assessment | RAG Retrieval | |-----------|---------------------|---------------| | Objects | Propositions | Sentences | | Structure | Premises → Conclusion | Query → Similar chunks | | Relation | Logical entailment | Vector similarity | | Question | "Does C follow from P₁...Pₙ?" | "What is similar to Q?" | | Answer | Yes/No (+ explanation) | Ranked list of chunks | ### Key Citations - [cite:tarski-1936-truth] — The semantic conception of truth and logical consequence - [cite:beall-restall-2005-consequence] — Logical pluralism and consequence - [cite:priest-2008-logic] — Introduction to non-classical logic ### Notes for Development - Provide examples of valid arguments with false premises to illustrate that validity ≠ truth - Discuss the difference between validity (deductive) and strength (inductive) - Consider whether RAG could be augmented with logical reasoning modules (spoiler: this requires solving the harder problem first) ### Cross-References - See @sec-validity-soundness for the full treatment of validity - See @sec-argument-reconstruction for how arguments can be extracted from text --- # Part III: The Structure of Arguments and the Concept of Validity ## Section 8: Validity, Soundness, and Cogency {#sec-validity-soundness} ### Core Argument The assessment of arguments requires distinguishing several properties. Validity concerns truth-preservation: a valid argument is one in which the conclusion cannot be false if the premises are true. Soundness adds a factual requirement: a sound argument is valid *and* has true premises. Cogency adds an epistemic requirement: a cogent argument is sound *and* the premises are known. Each property represents a stronger constraint on the epistemic status of the conclusion. ### Key Claims 1. **Validity (logical property)**: - Definition: An argument is valid iff, necessarily, if all premises are true, the conclusion is true. - Equivalently: There is no possible world where the premises are true and conclusion false. - Validity does not guarantee true conclusion; it guarantees truth-transmission. 2. **Soundness (logical + metaphysical)**: - Definition: An argument is sound iff it is valid and all its premises are actually true. - A sound argument has a true conclusion (by modus ponens on validity). - Soundness is unknowable without knowing the truth-values of premises. 3. **Cogency (logical + metaphysical + epistemic)**: - Definition: An argument is cogent iff it is sound and the premises are known. - A cogent argument transmits knowledge from premises to conclusion. - Cogency is the goal of rational inquiry. 4. **Hierarchy of assessment**: ``` WEAKEST STRONGEST Validity ⊂ Soundness ⊂ Cogency (form) (form + truth) (form + truth + knowledge) ``` ### Important Distinctions **A valid argument can have**: - True premises, true conclusion (sound) - True premises, true conclusion, but unknown premises (sound but not cogent) - False premises, true conclusion (unsound) - False premises, false conclusion (unsound) **A valid argument cannot have**: - True premises, false conclusion (this is the defining exclusion) ### Example Analysis ``` Argument A: P1: All philosophers are immortal. P2: Socrates is a philosopher. C: Socrates is immortal. Validity: VALID (the form is truth-preserving) Soundness: UNSOUND (P1 is false) Conclusion: FALSE (Socrates died) Argument B: P1: All humans are mortal. P2: Socrates is human. C: Socrates is mortal. Validity: VALID (the form is truth-preserving) Soundness: SOUND (P1 and P2 are true) Conclusion: TRUE (Socrates was mortal) ``` ### Key Citations - [cite:aristotle-prior-analytics] — The original account of syllogistic validity - [cite:tarski-1936-truth] — Logical consequence in semantic terms - [cite:copi-cohen-logic] — Standard textbook treatment of validity and soundness ### Notes for Development - Emphasise that validity is a formal property, determinable without knowing truth-values - Discuss the asymmetry: we can establish invalidity by counterexample, but validity requires proof - Consider non-deductive arguments: inductive strength, abductive inference ### Cross-References - See @sec-propositions-arguments for the structure of arguments - See @sec-evidence-justification for how premises come to be known --- ## Section 9: The Computational Representation of Argumentative Structure {#sec-argument-representation} ### Core Argument If computational systems are to assess the validity of arguments, they must first represent argumentative structure in a formal, processable manner. This section surveys approaches to argument representation, from classical logic to contemporary argumentation theory, and identifies the requirements for a computational epistemology system. ### Key Claims 1. **Classical formal representation**: - Propositions as well-formed formulae in a formal language - Arguments as sequents: Γ ⊢ φ (from premises Γ, derive conclusion φ) - Validity as derivability or semantic entailment 2. **Toulmin's practical model**: - Claim (C): the proposition being argued for - Data (D): the evidence offered in support - Warrant (W): the principle licensing the inference from D to C - Backing (B): the support for the warrant itself - Qualifier (Q): the degree of confidence (probably, necessarily) - Rebuttal (R): exceptions and defeaters 3. **Argumentation schemes** [cite:walton-1996-schemes]: - Stereotypical patterns of presumptive reasoning - Examples: argument from authority, argument from analogy, argument from consequences - Each scheme has associated critical questions 4. **Requirements for computational representation**: - Propositional content extraction (from sentences to propositions) - Structural markup (premise/conclusion identification) - Logical relation encoding (entailment, support, attack) - Defeasibility handling (non-monotonic reasoning) ### Representational Schema ```xml All observed instances of X have property Y. Instance x is an X. The observed sample is representative. enthymematic Instance x has property Y. inductive ``` ### Key Citations - [cite:aristotle-prior-analytics] — The syllogistic forms - [cite:toulmin-1958-uses] — The layout of arguments - [cite:walton-1996-schemes] — Argumentation schemes - [cite:dung-1995-acceptability] — Abstract argumentation frameworks - [cite:pollock-1987-defeasible] — Defeasible reasoning ### Notes for Development - Compare logic-based and argumentation-theoretic approaches - Discuss the trade-off between expressiveness and tractability - Consider how natural language processing can identify argument components ### Cross-References - See @sec-argument-reconstruction for extracting arguments from text - See @sec-schema-validation for validating argument representations --- ## Section 10: Argument Reconstruction — From Text to Logical Form {#sec-argument-reconstruction} ### Core Argument Texts rarely present arguments in explicit logical form. Claims are asserted without clear indication of their role as premise or conclusion; supporting reasons may be implicit; logical structure is obscured by rhetorical elaboration. Argument reconstruction is the scholarly and computational task of extracting the underlying argumentative structure from natural language text. This section develops the methodology for systematic argument reconstruction. ### Key Claims 1. **The problem of implicit structure**: Natural language conceals argumentative structure: - Conclusion may appear before, after, or interspersed with premises - Premises may be presupposed rather than stated - Logical connectives are obscured by discourse markers - Rhetorical flourishes distract from logical content 2. **Enthymemes and implicit premises**: Most real arguments are enthymematic—they suppress premises that are assumed to be obvious or shared. Reconstruction requires: - Identifying the stated premises - Determining what additional premises are required for validity - Adding only those premises genuinely assumed by the arguer 3. **The principle of charity**: Reconstructions should maximise the strength and coherence of the argument being analysed: - Assume the arguer is rational - Prefer stronger interpretations over weaker - Avoid attributing obvious fallacies without evidence 4. **Stages of reconstruction**: 1. Identify the main claim (conclusion) 2. Identify explicit supporting reasons (stated premises) 3. Determine required implicit premises 4. Formalise the argument structure 5. Assess validity of the reconstructed argument ### Reconstruction Example **Source text** (Newton, Principia, paraphrase): > "The planets revolve around the Sun in ellipses. This motion requires a centripetal force directed toward the Sun. The force diminishes with the square of the distance. Therefore, the Sun exerts a gravitational attraction on the planets." **Reconstruction**: ``` P1: Planets revolve around the Sun in elliptical orbits. [observational premise] P2: Elliptical orbital motion requires a centripetal force directed toward the focus of the ellipse. [mechanical principle] P3: The centripetal force varies inversely with the square of the distance from the focus. [derived from orbital mechanics] P4*: [Implicit] A force directed toward a body is a force exerted by that body. [physical interpretation principle] P5*: [Implicit] A force exerted by the Sun on planets, varying inversely with distance, is gravitational attraction. [definitional] ───────────────────────────────────────────────────── C: The Sun exerts gravitational attraction on the planets. ``` ### Key Citations - [@Grashoff2001-wj] — Methodology of argument reconstruction in history of science - [cite:fisher-1988-logic] — The logic of real arguments - [cite:feldman-1999-reconstruction] — Principles of argument reconstruction - [cite:groarke-2020-stanford-informal] — Stanford Encyclopedia entry on informal logic ### Notes for Development - Provide examples from primary historical sources (Euler, Kepler, Newton) - Discuss the challenge of computational automation of reconstruction - Consider the role of LLMs as assistants in reconstruction (suggesting candidates, not determining results) ### Cross-References - See @sec-propositions-arguments for the structure being reconstructed - See @sec-evidence-directed for how reconstructed arguments guide inquiry --- # Part IV: Evidence, Justification, and the Hierarchy of Epistemic Support ## Section 11: What Constitutes Evidence for a Proposition? {#sec-evidence-justification} ### Core Argument Evidence is that which provides rational support for a proposition's truth. Not all relations between propositions are evidential; mere association or co-occurrence does not constitute evidence. This section develops a theory of evidence suitable for computational implementation, distinguishing genuine evidential relations from spurious correlations. ### Key Claims 1. **Evidence as probability-raiser**: On the probabilistic conception, E is evidence for H iff P(H|E) > P(H). Evidence raises the probability of the hypothesis. 2. **Types of evidential relation**: - **Direct evidence**: Observational data directly bearing on the proposition - **Indirect evidence**: Data bearing on propositions that, together with background knowledge, support the target proposition - **Testimonial evidence**: Reports from sources deemed reliable - **Inferential evidence**: Propositions derivable from other propositions already evidenced 3. **Conditions for genuine evidence**: - Relevance: The evidence must bear on the proposition in question - Credibility: The evidence must be trustworthy (reliable observation, honest testimony) - Independence: Multiple pieces of evidence are more compelling when independent - Specificity: Evidence that supports only the hypothesis (not also its rivals) is stronger 4. **The distinction between evidence and indication**: Mere correlation (even perfect correlation) is not evidence. Evidence requires an explanatory or inferential connection. ### Key Citations - [cite:achinstein-2001-evidence] — The theory of evidence - [cite:carnap-1950-probability] — Logical foundations of probability - [cite:hempel-1965-aspects] — Confirmation and explanation - [cite:williamson-2000-knowledge] — E = K thesis (one's evidence is all and only what one knows) - [cite:kelly-2016-evidence] — Stanford Encyclopedia entry on evidence ### Notes for Development - Contrast Bayesian and non-Bayesian conceptions of evidence - Discuss the problem of old evidence (evidence known before the hypothesis) - Consider how computational systems can represent evidential relations ### Cross-References - See @sec-best-evidence for the hierarchy of evidential quality - See @sec-evidence-directed for how evidence-seeking can be computationally directed --- ## Section 12: The Concept of Best Evidence {#sec-best-evidence} ### Core Argument Not all evidence is epistemically equal. The concept of "best evidence" captures the intuition that some sources, some forms of testimony, and some observational procedures provide stronger epistemic support than others. A computational epistemology system must implement a hierarchy of evidential quality, preferring stronger evidence where available. ### Key Claims 1. **Dimensions of evidential quality**: - **Proximity**: Evidence closer to the fact is stronger (eyewitness > hearsay) - **Reliability**: Evidence from reliable processes is stronger - **Independence**: Independent corroboration strengthens evidential support - **Completeness**: Evidence covering all relevant aspects is stronger - **Absence of defeaters**: Evidence not undermined by contrary considerations is stronger 2. **Hierarchy of source types** (in scholarly contexts): 1. Primary sources (original documents, direct observations) 2. Critical editions (scholarly reconstructions of primary sources) 3. Secondary sources (scholarly analysis of primary sources) 4. Tertiary sources (encyclopaedias, textbooks, summaries) 5. Popular accounts (journalism, non-specialist writing) 3. **The best evidence rule** (adapted from legal epistemology): Where multiple forms of evidence are available, preference should be given to the best available evidence. Weaker evidence should not be relied upon where stronger evidence is accessible. 4. **Computational implementation**: - Source classification (primary, secondary, tertiary) - Reliability scoring (based on source provenance and methodology) - Corroboration tracking (how many independent sources support the claim) - Defeater detection (are there countervailing considerations) ### Evidential Hierarchy Schema ``` EVIDENTIAL HIERARCHY (Scholarly Context) Strength Source Type Example ──────────────────────────────────────────────────── Highest Direct observation Researcher's own experiment ↓ Primary document Euler's manuscript of E57 ↓ Critical edition KGW edition of Kepler ↓ Peer-reviewed Journal article ↓ Secondary analysis Scholarly monograph ↓ Tertiary summary Encyclopaedia entry Lowest Unvetted report Blog post, AI-generated text ``` ### Key Citations - [cite:shapin-1994-social] — The social history of truth - [cite:daston-galison-2007-objectivity] — Epistemic virtues in science - [cite:grafton-1999-footnote] — The scholarly apparatus and evidence tracking - [cite:ginzburg-1989-clues] — Evidential paradigm in historical inquiry ### Notes for Development - Discuss how evidential hierarchies differ across disciplines - Consider the problem of evaluating AI-generated content (lowest tier by default) - Provide examples of how source quality affects credibility of claims ### Cross-References - See @sec-evidence-justification for what evidence is - See @sec-knowledge-bases for how evidential relations are stored --- ## Section 13: Evidence-Directed Search {#sec-evidence-directed} ### Core Argument The fundamental innovation of computational epistemology over RAG is the inversion of the search paradigm. Rather than retrieving text that *mentions* a topic (similarity-based retrieval), an epistemically adequate system identifies the proposition to be evaluated, determines what would count as evidence for or against it, and then searches for such evidence. Search is directed by the evidential needs of the proposition, not by textual similarity to a query sentence. ### Key Claims 1. **The inversion of retrieval**: - RAG: Query → Similar sentences → Response - Comp. Epist.: Proposition → Evidential requirements → Evidence search → Assessment 2. **Determining evidential requirements**: Given a proposition P, the system must determine: - What observations would confirm P? - What observations would disconfirm P? - What testimony would support P? - What documents might contain such evidence? 3. **Structured evidence search**: - Search is not for "similar" text but for text that *bears evidentially* on P - This requires understanding the content of P (not just its surface form) - It also requires a model of what kinds of sources contain relevant evidence 4. **The output: evidential assessment**: - Not a fluent paragraph but a structured assessment: - Evidence found for P - Evidence found against P - Evidential gaps (what would be relevant but is not available) - Confidence level (based on evidential weight) ### Evidence-Directed Pipeline ``` EVIDENCE-DIRECTED SEARCH PIPELINE 1. INPUT: Proposition P to be assessed Example: "Euler's tidal theory correctly predicts spring tide heights." 2. EVIDENTIAL ANALYSIS: - What would confirm P? → Comparison of Euler's predictions with observed spring tides - What would disconfirm P? → Systematic discrepancies between prediction and observation - Where might such evidence be found? → Astronomical observations from 18th century → Modern tidal data for comparison 3. DIRECTED SEARCH: - Search: historical tidal observations 1740-1800 - Search: modern tidal predictions using Euler's parameters - Search: scholarly assessments of Euler's tidal theory 4. EVIDENCE ASSEMBLY: - Positive evidence: [list with sources] - Negative evidence: [list with sources] - Gaps: [what remains unknown] 5. OUTPUT: Graded assessment - Confidence: MODERATE - Supporting evidence: 3 sources - Contrary evidence: 1 source (minor discrepancy) - Key gap: lack of systematic 18th-century observational data ``` ### Key Citations - [cite:laudan-1981-confutation] — Problem-solving and evidence evaluation - [cite:kitcher-1993-advancement] — The advancement of science - [cite:howson-urbach-2006-bayesian] — Scientific reasoning: the Bayesian approach ### Notes for Development - Contrast with keyword search and similarity retrieval - Discuss how evidential requirements can be computationally determined - Consider the role of domain knowledge in specifying evidence types ### Cross-References - See @sec-best-evidence for evaluating the quality of retrieved evidence - See @sec-system-architecture for the computational implementation --- # Part V: Toward a Computational System for Propositional Validity ## Section 14: Architecture of an Epistemic Assessment System {#sec-system-architecture} ### Core Argument The theoretical framework developed in Parts I–IV can be implemented as a two-phase computational system. The first phase performs argument reconstruction: extracting propositional content and argumentative structure from natural language text. The second phase performs epistemic assessment: evaluating the validity of reconstructed arguments and the evidential support for their premises. This section specifies the architecture of such a system. ### Key Claims 1. **Two-phase architecture**: - **Phase 1: Reconstruction** — From text to logical structure - Input: Natural language documents - Processing: Proposition extraction, argument identification, structure formalisation - Output: Schema-validated argument representations - **Phase 2: Assessment** — From structure to evaluation - Input: Formalised arguments + knowledge bases - Processing: Validity checking, evidence retrieval, source evaluation - Output: Graded epistemic assessments 2. **Components of the reconstruction phase**: - Sentence-to-proposition mapping (semantic interpretation) - Claim identification (what is being asserted) - Support relation detection (what reasons are offered) - Implicit premise generation (filling enthymematic gaps) - Formal structure output (XML/JSON argument schema) 3. **Components of the assessment phase**: - Logical validity checking (given the structure) - Premise truth assessment (evidence retrieval and evaluation) - Source quality scoring (reliability and proximity) - Confidence integration (combining multiple assessments) - Gap identification (what remains unevidenced) 4. **Integration with existing infrastructure**: - Builds on PDAI document processing (AI Scholar) - Uses agent-based architecture with schema-validated outputs - Interfaces with structured knowledge bases ### System Architecture Diagram ``` COMPUTATIONAL EPISTEMOLOGY SYSTEM ARCHITECTURE ┌─────────────────────────────────────────────────────────────────┐ │ SOURCE DOCUMENTS │ │ (PDAI format: img/, xml/, html/, ai/) │ └───────────────────────────┬─────────────────────────────────────┘ │ ▼ ┌─────────────────────────────────────────────────────────────────┐ │ PHASE 1: RECONSTRUCTION │ │ │ │ ┌──────────────────┐ ┌──────────────────┐ ┌──────────────┐ │ │ │ Proposition │ │ Argument │ │ Structure │ │ │ │ Extraction │──▶│ Identification │──▶│ Formaliser │ │ │ │ Agent │ │ Agent │ │ Agent │ │ │ └──────────────────┘ └──────────────────┘ └──────────────┘ │ │ │ │ │ ▼ │ │ ┌─────────────────────────────────┐ │ │ │ Validated Argument Structures │ │ │ │ (argument.dtd schema) │ │ │ └───────────────┬─────────────────┘ │ └──────────────────────────────────────────────┼──────────────────┘ │ ▼ ┌─────────────────────────────────────────────────────────────────┐ │ PHASE 2: ASSESSMENT │ │ │ │ ┌──────────────────┐ ┌──────────────────┐ ┌──────────────┐ │ │ │ Validity │ │ Evidence │ │ Confidence │ │ │ │ Checker │ │ Retrieval │ │ Integrator │ │ │ │ (logical) │ │ (directed) │ │ (Bayesian) │ │ │ └────────┬─────────┘ └────────┬─────────┘ └──────┬───────┘ │ │ │ │ │ │ │ └──────────────────────┼────────────────────┘ │ │ ▼ │ │ ┌─────────────────────────────┐ │ │ │ EPISTEMIC ASSESSMENT │ │ │ │ - Validity status │ │ │ │ - Premise confidence │ │ │ │ - Evidence quality │ │ │ │ - Identified gaps │ │ │ └─────────────────────────────┘ │ └─────────────────────────────────────────────────────────────────┘ ``` ### Key Citations - [cite:mccarthy-1980-circumscription] — Formalising common sense - [cite:wang-2024-agents] — Survey on LLM-based agents - [cite:wooldridge-1995-agents] — Intelligent agent theory ### Notes for Development - Connect to existing AI Scholar agent architecture - Discuss the role of human oversight at each stage - Consider failure modes and graceful degradation ### Cross-References - See @sec-argument-reconstruction for the reconstruction methodology - See @sec-evidence-directed for the evidence retrieval approach --- ## Section 15: Knowledge Bases as Repositories of Propositions {#sec-knowledge-bases} ### Core Argument A computational epistemology system requires knowledge bases fundamentally different from document repositories. Document repositories store sentences—linguistic objects with no guaranteed semantic content. A knowledge base for computational epistemology must store propositions, evidential relations, and source provenance. This section specifies the structure of such knowledge bases. ### Key Claims 1. **The critical difference**: - Document repository: stores sentences (text strings) - Propositional knowledge base: stores propositions (semantic contents) with metadata 2. **What a propositional knowledge base must represent**: - **Propositions**: The semantic contents of claims (not the sentences expressing them) - **Source links**: Where each proposition is asserted (document, page, context) - **Evidential relations**: What supports what, and how strongly - **Confidence levels**: The current epistemic status of each proposition - **Provenance chain**: How the proposition entered the knowledge base 3. **Schema requirements**: ```xml Euler's tidal theory predicts that spring tides are 2.5 times stronger than neap tides. Eulers Gezeitentheorie sagt voraus, dass Springfluten 2,5-mal stärker sind als Nippfluten. "Quantitas vis sollicitantis..." 0.92 ``` 4. **Difference from knowledge graphs**: Existing knowledge graphs (Wikidata, DBpedia) store entity-relation-entity triples. A propositional knowledge base stores propositions—complete truth-bearers—with evidential and source metadata. ### Key Citations - [cite:lenat-guha-1990-cyc] — Building large knowledge-based systems - [cite:vanderveken-1990-meaning] — Meaning and speech acts - [cite:tei-2023-guidelines] — TEI for text encoding (as contrast case) ### Notes for Development - Compare with existing knowledge representation systems - Discuss the challenge of extracting propositional content from natural language - Consider how same proposition expressed differently can be identified ### Cross-References - See @sec-terminology for the sentence/proposition distinction - See @sec-best-evidence for how source quality is represented --- ## Section 16: Schema Validation and Quality Assurance {#sec-schema-validation} ### Core Argument The reliability of a computational epistemology system depends on rigorous validation at every processing stage. Schema validation ensures that agent outputs conform to declared structures; quality assurance processes detect errors before they propagate. This section specifies the validation architecture. ### Key Claims 1. **DTD-based schema validation**: Every agent output must conform to a declared Document Type Definition: - `proposition.dtd` — for extracted propositions - `argument.dtd` — for reconstructed arguments - `assessment.dtd` — for epistemic evaluations 2. **Pipeline validation**: Before execution, the system validates schema compatibility across the entire processing pipeline. An agent producing `proposition.dtd` output can feed an agent expecting `proposition.dtd` input. 3. **Content validation**: Beyond structural conformance, the system checks: - Completeness: All required fields present - Consistency: No contradictory assertions within single outputs - Referential integrity: All references resolve to existing entities 4. **Human review integration**: Critical assessments should be flagged for human expert review: - High-stakes claims (ethical, safety-related) - Low-confidence assessments - Unusual source patterns ### Key Citations - [cite:tei-2023-guidelines] — Schema-based text encoding - [cite:w3c-xml-schema] — W3C XML Schema specification ### Notes for Development - Connect to existing AI Scholar DTD schema system - Provide examples of validation failure and recovery - Discuss trade-offs between strictness and flexibility ### Cross-References - See @sec-system-architecture for where validation fits in the pipeline - See @sec-argument-representation for argument schema details --- # Part VI: Implications for AI-Mediated Scholarly Inquiry ## Section 17: AI as Epistemic Assistant, Not Oracle {#sec-ai-assistant} ### Motivation Why insist on the distinction between assistant and oracle? Because **the conceptual clarity of computational epistemology depends on properly characterising the role of AI in knowledge practices**. The temptation to treat AI outputs as authoritative—as if the machine "knows"—represents a category confusion that vitiates epistemic responsibility. The framework of epistemic systems, developed in *Die Kunst wissenschaftlicher Entdeckungen* [@Grashoff1995-zj], provides the corrective: AI agents are mechanical actors within epistemic systems, executing goal-directed actions, but they are not the epistemic subjects who bear responsibility for knowledge claims. ### Core Argument The proper role of AI in knowledge practices is as an assistant to human epistemic agents, not as an oracle delivering truths. AI systems can dramatically accelerate document processing, candidate generation, and cross-referencing. They cannot—and should not be expected to—provide final epistemic judgements. The human scholar remains the knowledge-seeking agent; AI provides infrastructure for inquiry at scale. ### Key Claims 1. **What AI can provide**: - Rapid processing of large document collections - Candidate argument reconstructions (for human refinement) - Evidential gap identification (what remains unsupported) - Cross-referencing support (finding related passages and sources) - Structured outputs for further analysis 2. **What AI cannot provide**: - Truth (AI outputs are not truth-bearers) - Knowledge (AI is not a knowing subject in the relevant sense) - Final judgement (assessment requires human epistemic responsibility) - Genuine understanding (the meaning question remains contested) 3. **The division of epistemic labour**: - AI handles: volume, speed, cross-referencing, pattern detection - Humans handle: interpretation, judgement, responsibility, meaning 4. **Avoiding epistemic outsourcing**: The danger is not AI assistance but human abdication. If scholars treat AI outputs as authoritative without evaluation, they relinquish epistemic responsibility. 5. **AI agents as actors in epistemic systems**: Drawing on the framework of epistemic systems [@Grashoff1995-zj; @Grashoff1998-mb], we can characterise AI agents precisely: - **Agents** are goal-directed actors executing sequences of epistemic actions - **Sub-agents** implement the division of epistemic labour (OCR agent, translation agent, argument-extraction agent) - **Orchestration** corresponds to the structure of inquiry: which actions, in what sequence, toward what goal - **Outputs** are not knowledge but contributions to epistemic processes that humans evaluate 6. **The continuity thesis**: Contemporary agentic AI systems realise, in mechanical form, the structure of epistemic systems theorised before the technology existed. This is not analogy but identity of structure: the agent executes actions aimed at epistemic goals; the human evaluates whether those goals are achieved. ### The Agent as Mechanical Epistemic Actor ``` EPISTEMIC SYSTEM STRUCTURE (1995) → AGENTIC AI STRUCTURE (2025) Epistemic System: Agentic AI: ┌─────────────────────────┐ ┌─────────────────────────┐ │ Goal: Knowledge of X │ ≡ │ Goal: Answer query Q │ ├─────────────────────────┤ ├─────────────────────────┤ │ Actions: │ │ Actions: │ │ - Observation │ → │ - Retrieval │ │ - Experimentation │ → │ - Processing │ │ - Inference │ → │ - Reasoning │ │ - Argumentation │ → │ - Generation │ ├─────────────────────────┤ ├─────────────────────────┤ │ Evaluation: │ │ Evaluation: │ │ - Did we achieve │ ≡ │ - Is output correct? │ │ knowledge? │ │ - By human judgement │ └─────────────────────────┘ └─────────────────────────┘ The structure is identical; the implementation differs. Human epistemic systems involve conscious agents. AI epistemic systems involve mechanical actors. Both require normative assessment of outputs. ``` ### Key Citations - [@Grashoff1995-zj] — Epistemic systems: Habilitationsschrift - [@Grashoff2001-sn] — Theory of experiment and epistemic systems - [@Baumgartner2003-iq] — Causality and causal inference - [@Grashoff1998-mb] — Model construction methodology (SS 433) - [@Grashoff1998-nr] — Computer models of scientific discovery - [cite:floridi-2014-fourth] — The fourth revolution and information agents - [cite:humphreys-2009-extending] — Extending ourselves: computational science and cognitive extension - [cite:carter-kallestrup-2020-extended] — Extended knowledge - [cite:bratman-1987-intention] — Intention, plans, and practical reason ### Notes for Development - Discuss the analogy with calculators in mathematics: they assist but do not replace mathematical understanding - Consider the implications for scholarly training: what skills become more (not less) important - Provide examples of productive AI-human collaboration in scholarship - Elaborate on the historical development: from epistemic systems (1995) to agentic AI (2025) - Discuss the normative implications: if agents are mechanical actors, who bears epistemic responsibility? ### Cross-References - See @sec-community-arbiter for the role of the scholarly community - See @sec-system-architecture for how human oversight is integrated --- ## Section 18: Directing Search Toward Evidential Gaps {#sec-gap-directed} ### Core Argument One of the most valuable contributions of computational epistemology is the identification of evidential gaps: propositions that function as premises in reconstructed arguments but lack adequate evidential support. By making these gaps explicit, the system directs scholarly inquiry toward the questions that most urgently require investigation. ### Key Claims 1. **Gap identification procedure**: - Reconstruct argument structure (identify premises) - Assess evidential support for each premise - Flag premises with inadequate support as gaps - Prioritise gaps by their role in the argument (critical premises first) 2. **Types of evidential gap**: - **Missing evidence**: No evidence found in the knowledge base - **Weak evidence**: Evidence exists but is of low quality - **Contested evidence**: Evidence exists on both sides - **Outdated evidence**: Evidence exists but may be superseded 3. **The inversion of RAG (reprise)**: RAG asks "what is similar to my query?" A gap-directed system asks "what would I need to substantiate this premise?" 4. **Scholarly workflow integration**: Gaps become research questions: - "Is there archival evidence for P₃?" - "Have modern analyses confirmed P₅?" - "What sources might document P₇?" ### Key Citations - [cite:laudan-1981-confutation] — Problem-solving and research programmes - [cite:kuhn-1962-structure] — Anomalies and research directions - [cite:lakatos-1978-methodology] — Research programmes and heuristics ### Notes for Development - Provide examples of how gap identification guides archival research - Discuss the relationship between evidential gaps and research agendas - Consider how AI can suggest potential evidence sources for gaps ### Cross-References - See @sec-evidence-directed for evidence-directed search - See @sec-ai-assistant for the human role in addressing gaps --- ## Section 19: The Scholarly Community as Ultimate Arbiter {#sec-community-arbiter} ### Core Argument The ultimate authority in matters of scholarly knowledge resides not in any individual—human or artificial—but in the critical discourse of the scholarly community. Computational epistemology provides infrastructure for this discourse: reconstructed arguments can be publicly assessed; evidential claims can be scrutinised; competing interpretations can be systematically compared. The historical development from private manuscript to public print (cf. AI-Reporter) finds its continuation in AI-mediated infrastructures that enable scholarly assessment at unprecedented scale. ### Key Claims 1. **The social epistemology of scholarship**: Knowledge is not merely individual belief but collective achievement: - Public articulation of claims - Critical response and assessment - Iterative refinement through discourse - Convergence toward consensus (where evidence warrants) 2. **Computational epistemology as infrastructure**: The system provides: - Standardised representation of arguments (enabling comparison) - Explicit evidential relations (enabling scrutiny) - Source provenance (enabling verification) - Gap identification (enabling collaborative effort) 3. **Continuity with historical development**: - Copernicus on Werner: public critical assessment - Kepler on Galileo: community-oriented commentary - Neugebauer's Zentralblatt: systematic scholarly evaluation - Computational epistemology: infrastructure for AI-era discourse 4. **The persistence of human judgement**: AI provides scale and speed; the scholarly community provides judgement and meaning. Neither can substitute for the other. ### Key Citations - [cite:longino-2002-fate] — The fate of knowledge (social epistemology) - [cite:shapin-1994-social] — A social history of truth - [cite:daston-1991-republic] — The Republic of Letters ### Notes for Development - Connect to historical narrative from AI-Reporter article - Discuss the role of peer review and public commentary - Consider how AI infrastructure changes the dynamics of scholarly discourse ### Cross-References - See @sec-ai-assistant for the division of epistemic labour - See AI-Reporter article for historical precedents --- # Part VII: Conclusion — The Systematic of Computational Validity ## Section 20: Summary of the Foundational Framework {#sec-summary} ### Recapitulation of Core Theses 1. **The primacy of propositions**: Truth and falsity attach to propositions, not sentences. Any system purporting to deal with knowledge or validity must operate at the level of propositional content. [→ @sec-terminology] 2. **The failure of retrieval**: RAG systems operate on sentences via vector similarity. They cannot assess propositional content, logical relations, or evidential support. Retrieval is not justification. [→ @sec-rag-category-error] 3. **Validity requires structure**: Validity is a property of arguments (structured relations among propositions). Assessing validity requires identifying premises and conclusions, not merely finding similar text. [→ @sec-validity-soundness] 4. **Evidence must be sought, not merely found**: Epistemically adequate systems must determine what would count as evidence for a proposition and then search for such evidence. This inverts the RAG paradigm. [→ @sec-evidence-directed] 5. **Reconstruction precedes assessment**: Before arguments can be evaluated, they must be extracted from text and formalised. Argument reconstruction is both a scholarly and computational task. [→ @sec-argument-reconstruction] 6. **Knowledge bases store propositions**: Document repositories store sentences; a computational epistemology system requires knowledge bases that store propositions with evidential relations and source provenance. [→ @sec-knowledge-bases] 7. **AI assists; humans judge**: The proper role of AI is as epistemic infrastructure, not epistemic authority. The scholarly community remains the arbiter of knowledge claims. [→ @sec-ai-assistant, @sec-community-arbiter] --- ## Section 21: Toward Implementation — Connections and Next Steps {#sec-implementation} ### Core Argument The framework developed in this article is not merely theoretical; it provides the conceptual foundation for a realisable computational system. Implementation builds on existing infrastructure (AI Scholar, PDAI format) and requires the development of specialised agents for argument reconstruction, evidence retrieval, and epistemic assessment. ### Key Implementation Elements 1. **Integration with AI Scholar**: - PDAI format provides document substrate - Agent architecture provides processing pipeline - Schema validation provides quality assurance 2. **New agents required**: - Proposition extraction agent (sentence → proposition mapping) - Argument identification agent (claim and support detection) - Structure formalisation agent (output to argument.dtd schema) - Validity assessment agent (logical evaluation) - Evidence retrieval agent (directed search) - Confidence integration agent (Bayesian aggregation) 3. **Knowledge base development**: - Propositional storage schema - Evidential relation representation - Source provenance tracking - Confidence propagation mechanisms 4. **Evaluation methodology**: - Comparison with expert human reconstructions - Validity assessment accuracy on known arguments - Evidence retrieval precision and recall - Integration with scholarly workflow ### Future Directions - Cross-document argument networks (tracing ideas across correspondences) - Historical evolution of evidential support (how assessments change) - Integration with citation networks (formal scholarly assessment structures) - Multimodal evidence (diagrams, tables, images as evidential sources) --- # Acknowledgments [To be completed] --- # Appendix A: Terminological Glossary {#sec-glossary} | Term | Definition | |------|------------| | **Sentence** | A syntactically well-formed expression in a natural or formal language | | **Proposition** | The content or meaning expressed by a declarative sentence; a truth-bearer | | **Statement** | A proposition asserted by a speaker in a particular context | | **Truth-bearer** | An entity that can be true or false (propositions, not sentences) | | **Fact** | An obtaining state of affairs; what makes a true proposition true | | **Argument** | A structured set of propositions: premises offered as support for a conclusion | | **Premise** | A proposition offered as a reason in an argument | | **Conclusion** | The proposition for which reasons are offered in an argument | | **Validity** | The property of an argument such that if premises are true, conclusion must be true | | **Soundness** | Validity plus the truth of all premises | | **Cogency** | Soundness plus knowledge of the premises | | **Evidence** | That which provides rational support for a proposition's truth | | **Justification** | The epistemic grounding that distinguishes knowledge from mere true belief | | **Enthymeme** | An argument with one or more implicit (unstated) premises | | **Argument reconstruction** | The process of extracting explicit logical structure from natural language text | --- # Appendix B: Relation to AI Scholar and AI-Reporter {#sec-relation} This article forms part of a trilogy establishing the conceptual and technical foundations for AI-mediated scholarly infrastructure: 1. **AI-Reporter** (companion article): Traces the historical development of scientific communication from manuscript to print to AI-mediated publication. Establishes the pattern of public critical assessment as the foundation of scholarly knowledge. 2. **AI Scholar** (companion article): Develops the PDAI format and agent-based processing pipeline for transforming historical documents into structured, AI-processable knowledge bases. 3. **Computational Epistemology** (this article): Provides the epistemological framework for assessing propositional validity and evidential support within AI-mediated scholarly inquiry. Together, these articles establish: - The historical precedent for public scholarly assessment (AI-Reporter) - The technical infrastructure for document processing (AI Scholar) - The conceptual framework for epistemic evaluation (Computational Epistemology) ---