neural architecture

LLMs as Architecture Designers: Moving Beyond Memorization

New research explores whether large language models can creatively design novel neural network architectures rather than simply recombining existing patterns from training data.

LLM research

Researchers Discover Hidden MoE Architecture Inside Dense LLMs

New research reveals that standard dense language models contain secret Mixture-of-Experts structures, challenging our understanding of neural network architectures and opening paths to more efficient AI.

LLM

LLMs as Neural Architects: Auto-Generating Image Captioning Model

New research demonstrates LLMs can design complete neural network architectures for image captioning under strict API constraints, opening new possibilities for automated AI system design.