COMPREHEND: Ultra-Fine-Grained Benchmark Understanding by Entailment Hierarchy
Understanding what kind of prompts users typically ask and how well an LLM performs on these prompt categories
- 用途
- 分類
- 難易度
- Hard
- コスト
- High
「LLM」の検索結果
24 件Understanding what kind of prompts users typically ask and how well an LLM performs on these prompt categories
Recent work has improved computer-use agents (CUAs) by combining retrieved task-relevant tutorials and look-ah
Large language models (LLMs) can memorize and reproduce fragments of their training data, raising privacy and
Reinforcement learning with verifiable rewards (RLVR) can enable generalizable improvement for large language
LLM agents show strong potential in software engineering tasks such as competitive programming and code synthe
Zeroth-order (ZO) optimization enables memory-efficient large language model (LLM) fine-tuning, and recent met
Zeroth-order (ZO) optimization has emerged as a promising approach for memory-efficient large language model (
An experimental agent can succeed for the wrong reasons. Evaluations, however, often focus on the outcome, not
Users convey frustration in what they say and in how they say it, and voice-native models, which hear speech i
Previous research shows that vision-language (VL) models struggle to understand fine-grained image details and
Large language models are increasingly consulted for religious knowledge, including the recall of specific Had
Generating visualisations from natural language requests (text-to-vis) enables users to explore data more effi
AI assistants store values that a language model derived from a person's records under the person's own defini
Multimodal large language models (MLLMs) have shown strong potential in robotic surgery for question answering
Agentic workflows organize complex tasks into reusable procedures. However, invoking an LLM at every step incu
Query-conditioned sparse KV selection reduces long-context inference cost by attending to a subset of historic
Electroencephalography (EEG) provides a non-invasive means for neurological and mental health assessment, yet
Vision-language models can interpret instructions and plan manipulation tasks, yet struggle when acting direct
Time-series forecasters are ranked almost entirely by accuracy metrics, but a forecast's decision value, its e
Prediction models degrade when the deployment population differs from the one used to train them, and training
Phone scams impose substantial and growing costs on individuals and financial systems worldwide, yet existing
Scientific discovery does not follow a single fixed methodology: research methods vary across domains and evol
Black-box optimization (BBO) arises in many scientific and engineering problems where objective evaluations ar
Spiking neural networks (SNNs) offer low-energy sequence modeling through sparse, event-driven computation. Ho