Machine Learning

LLM Research

Sketch-and-Walk: New Sparse Attention Method Speeds Up LLM Infere

Researchers propose a two-phase sparse attention mechanism that scouts relevant tokens before full computation, promising significant efficiency gains for large language model inference.

AI Research

AIRS-Bench: New Benchmark Suite Tests AI Research Agents

A new benchmark suite evaluates how well AI agents can perform frontier research tasks, measuring capabilities from literature review to hypothesis generation and experimental design.

transformers

Positional Encoding Methods: Why Token Order Matters in AI

Transformers process tokens in parallel, losing sequence information. Four positional encoding methods—sinusoidal, learned, RoPE, and ALiBi—solve this fundamental challenge differently.

Agentic AI

How to Test and Measure Agentic AI System Performance

A comprehensive guide to evaluating AI agents covering benchmarks, testing frameworks, and metrics for measuring autonomous system performance in real-world applications.

LLM evaluation

New Rubric Generation Method Improves LLM Judge Accuracy

Researchers propose rethinking how evaluation rubrics are generated for LLM judges and reward models, addressing critical challenges in assessing open-ended AI outputs.

LLM Research

New Method Internalizes LLM Reasoning Through Latent Actions

Researchers propose a novel approach to improve LLM reasoning by discovering and replaying latent actions, potentially reducing inference costs while maintaining reasoning quality.

AI Security

MultiKrum: Defending Distributed AI Training from Byzantine Attac

New research on MultiKrum explores optimal robustness definitions for Byzantine machine learning, critical for securing distributed AI training against adversarial participants.

AI Research

Research Questions Exponential AI Growth: A Competing Hypothesis

New arXiv research challenges the widely held belief that AI capabilities grow exponentially, presenting alternative mathematical models that could reshape how we predict and plan for AI advancement.

AI Agents

Seven-Dimensional Taxonomy Proposed for Healthcare AI Agents

New research proposes a comprehensive framework for empirically evaluating LLM-based agentic AI systems in healthcare, establishing seven key dimensions for systematic assessment.

LLM Agents

Agent-Omit: Teaching LLMs to Think More Efficiently

New research introduces Agent-Omit, a reinforcement learning framework that trains LLM agents to selectively omit unnecessary reasoning steps and observations, dramatically improving computational efficiency.

LLM Research

Knowledge Model Prompting Boosts LLM Planning Performance

New research introduces Knowledge Model Prompting, a technique that enhances LLM reasoning on complex planning tasks by structuring domain knowledge representation.

LLM Agents

AgentArk: Distilling Multi-Agent Systems Into Single LLMs

New research introduces AgentArk, a framework that transfers multi-agent intelligence into single LLM agents, potentially revolutionizing how complex AI systems are deployed efficiently.