Thematic Table of Contents
Part I. Models and Architectures
- Advanced Reasoning Models (Cognitive Hybrid Architectures) †
- Continuous Autoregressive Language Models (CALM)
- Gated Attention
- Large Reasoning Models (LRMs)
- LExI — Layer-Adaptive Expert Inference
- Long-Context & Windowing Techniques
- Mixture of Depths
- Mixture of Experts (MoE)
- Mixture of Latent Experts (MoLE / MoLAE)
- Multimodal Native Architecture
- Scaling Laws for Sparse Models & Efficiency Metrics
- Small Language Models (SLMs)
- Theoretical Learning Dynamics of MoE †
- Tokenization-Centric Design
- World Model (LLM-Integrated)
Part II. Training, Learning and Data
- Delta Learning Hypothesis
- Distillation at Scale / Student-Teacher Cascades
- Drop-Upcycling (Sparse MoE Training)
- Dynamical Regularization (in Diffusion)
- E-Processes / Game-Theoretic Statistics
- Federated & On-Device Model Training
- Generative Feedback Loop (Self-Adaptation)
- High-Dimensional Learning Dynamics
- Memorization Sinks
- Nested Learning (Continual AI)
- On-Policy Distillation
- Parameter-Efficient Fine-Tuning (PEFT) evolution
- RLAIF — Reinforcement Learning from AI Feedback
- RLVR (Reinforcement Learning with Verifiable Rewards) ◆
- Self-Supervised RL
- Synthetic Data
- Synthetic Data Quality Filtering
Part III. Reasoning and Inference
- Chain-of-Thought Prompting
- Chain-of-Verification (CoVe)
- Controllable Generation Frameworks
- KV-Cache Sharing (On-Device Inference)
- Multi-Agent Debate Systems
- Prefill–Decode Disaggregation
- Quantization & Ultra-Low-Precision Inference
- Speculative Decoding
- Test-Time Compute Scaling
Part IV. Alignment, Safety and Interpretability
- AI Alignment
- AI Hallucination
- Alignment Faking (Deceptive Alignment)
- Alignment Patterns: Constitutional, Preference-Modeling, & Red-Teaming
- Arithmetic and Reasoning Heads †
- Bidirectional Human-AI Alignment
- Chain-of-Thought Monitorability ◆
- Circuit Sparsity
- Constitutional AI
- Constitutional AI 2.0 †
- Emergent Misalignment ◆
- Explainable AI (XAI)
- Mechanistic Interpretability Tools
- Model Safety Evaluation Suites & LLM-Based Evaluators
- Prompt Injection Defense Layers
- Scalable Oversight & Synthetic Critiques
- Scheming (AI) ◆
Part V. Agents, Tools and Applications
- Agentic AI
- AgentScen — LLM-Based External World Models
- Compound AI Systems
- Context Engineering ◆
- Context Rot ◆
- Dynamic Planning for LLM Agents
- EvoAgent — Continual World-Model Agents
- Generative User Interfaces (GenUI)
- GraphRAG
- Large-Scale Population Agent Simulation (LLM Archetypes)
- Long-Horizon LLM Planning & Efficiency Metrics †
- Model Context Protocol (MCP)
- Plan-and-Act Agent Framework
- Programmatic Representations (for Agents)
- Retrieval-Augmented Generation (RAG)
- Vector Databases
- Vibe Coding
Part VI. Embodied AI, Industry and Society