Agents · Evaluation · TTS · Audio · Video

AI that speaks, sounds, and moves.

Model releases and improvements across AI agents, AI evaluation, text-to-speech, audio, and video. Explore local models, GitHub projects, and cloud services—with concise summaries and links to the original source.

New articles

Latest briefings first.

Track model capabilities, quality improvements, and agent workflows, evaluation methods, and new ways to create with voice, audio, and video.

View all
arXiv||1 min read

Persistent Planar Memory for Video World Models

Video world models that generate and explore environments at scale need a persistent 3D memory of what they have produced. - Plane primitives offer a natural candidate: a compact set of oriented planes captures the dominant structural elements (e.g., walls, floors, facades) of indoor and outdoor scenes, while requiring only 7 parameters per...

VideoComputer Vision
arXiv||1 min read

DLite: History-free Speculative Decoding for Agentic AI

Speculative decoding has become a mainstream technique for accelerating large language model (LLM) inference by using a lightweight draft model to generate candidate tokens that are subsequently... - However, agentic workloads introduce long and continuously evolving contexts and frequent multi-turn interactions.

AI AgentsNLP
arXiv||1 min read

Video Diffusion Avatars: Taming Video Diffusion Models into Controllable 3D Avatars

Video diffusion models (VDMs) trained on internet-scale data encode a rich prior on appearance, motion, and physics that is difficult to replicate with explicit 3D rendering and costly 3D data... - We introduce Video Diffusion Avatars (VDAs), a method that creates photo-realistic, multi-view consistent avatars from a single image by fine-tuning a VDM for precise control over camera viewpoint, facial expression,...

VideoComputer Vision
arXiv||1 min read

VocalGrad: Evaluating Acoustic Perception in Audio Language Models

Recent large audio language models (LALMs) have extended their capabilities beyond lexical speech understanding to tasks requiring paralinguistic and non-linguistic audio understanding, such as... - However, these models still struggle to reliably utilize acoustic information, particularly when it co-occurs with spoken linguistic content.

AudioNLP

Start here

Pick a source. Read the latest.

One quick entry point for each source, plus recent volume with archive fallback for quieter sources.

Browse by topic

Filter the homepage, or open a crawlable topic archive.

Follow the feed

Follow AI agents, evaluation, and media AI.

Use RSS for every new briefing, or share the current filtered view with your team.

Archive briefings

Keep digging without leaving the site.

Page 1 of 261
arXiv||1 min read

GLOBE: Evolving Structured Agentic Memory for E-commerce Product Optimization in Generative Search

Optimizing product listings for generative search requires language agents not only to rewrite effectively but also to continually self-improve by retaining successful strategies across diverse... - However, existing approaches often treat structured listings as free-form text, leaving effective strategies implicit in prompts, search trajectories, or rewritten outputs rather than accumulating them as a reusable...

AI AgentsNLP
arXiv||1 min read

Tool Recommendation for Multi-Step Agents: Finding Every Tool a Task Needs

A multi-step agent task fails when a single tool it needs is missing, yet the tools an agent may need are too many to list: the roughly 8,200 tools on the platform we study have definitions that... - We present Tool Recommendation, a deployed system that gives an agent all of them, hundreds of times more than a typical MCP server exposes, through a fixed interface of three tools.

AI AgentsMachine Learning
arXiv||1 min read

Persistent Planar Memory for Video World Models

Video world models that generate and explore environments at scale need a persistent 3D memory of what they have produced. - Plane primitives offer a natural candidate: a compact set of oriented planes captures the dominant structural elements (e.g., walls, floors, facades) of indoor and outdoor scenes, while requiring only 7 parameters per...

VideoComputer Vision
arXiv||1 min read

DLite: History-free Speculative Decoding for Agentic AI

Speculative decoding has become a mainstream technique for accelerating large language model (LLM) inference by using a lightweight draft model to generate candidate tokens that are subsequently... - However, agentic workloads introduce long and continuously evolving contexts and frequent multi-turn interactions.

AI AgentsNLP
arXiv||1 min read

Video Diffusion Avatars: Taming Video Diffusion Models into Controllable 3D Avatars

Video diffusion models (VDMs) trained on internet-scale data encode a rich prior on appearance, motion, and physics that is difficult to replicate with explicit 3D rendering and costly 3D data... - We introduce Video Diffusion Avatars (VDAs), a method that creates photo-realistic, multi-view consistent avatars from a single image by fine-tuning a VDM for precise control over camera viewpoint, facial expression,...

VideoComputer Vision
arXiv||1 min read

VocalGrad: Evaluating Acoustic Perception in Audio Language Models

Recent large audio language models (LALMs) have extended their capabilities beyond lexical speech understanding to tasks requiring paralinguistic and non-linguistic audio understanding, such as... - However, these models still struggle to reliably utilize acoustic information, particularly when it co-occurs with spoken linguistic content.

AudioNLP
arXiv||1 min read

GLOBE: Evolving Structured Agentic Memory for E-commerce Product Optimization in Generative Search

Optimizing product listings for generative search requires language agents not only to rewrite effectively but also to continually self-improve by retaining successful strategies across diverse... - However, existing approaches often treat structured listings as free-form text, leaving effective strategies implicit in prompts, search trajectories, or rewritten outputs rather than accumulating them as a reusable...

AI AgentsNLP