行业信号NEW
昨天
AI 点评 · 多模态长上下文推理瓶颈突破，行业落地效率关键。
可信度 58交叉信源 1
话题
多模态
共 463 条相关资讯 · 来自历史归档
面向多模态推理的高效长上下文建模｜AICon深圳
行业信号NEW
昨天
Moonshot AI's PerceptionBench tests how well multimodal AI models can actually "see," separate from logical reasoning. No frontier model reaches 60 percent accuracy, and GPT-5.6 So…
行业信号
8/14 15:13
IT之家 8 月 14 日消息，今天（14 日）晚间，阿里“千问大模型”公众号宣布，Qwen3.8-27B 模型正式开源，所有开发者、科研机构和企业均可自由下载、部署和使用。 IT之家附体验地址： Hugging Face 魔搭社区 根据介绍，27B（270 亿参数）是 全球 AI 社区呼声最高 的模型尺寸，Qwen3.8-27B 是原生多模态稠密（Dens…
AI 点评 · 开源27B尺寸兼顾性能与部署成本，编程办公双场景越级表现，或成中小开发者首选。
设计 / 产品NEW
8/14 03:35
Near-native image understanding for DeepSeek Harness
可信度 74交叉信源 1
设计 / 产品
8/13 18:57
Eyes for text-only DeepSeek Harness agents: built-in free vision chain (no key) + pixel-level vision tools (Q&A, grounding, crop, pixel diff, colors, OCR, SVG t…
可信度 74交叉信源 1
论文 / 方法NEW
8/13 15:56
Liquid AI released LFM2.5-VL-3B, a 3.1B-parameter vision-language model built for on-device deployment. It averages 80.7 on ScreenSpot-v2 and lifts RefCOCO grounding from 57.1 to 8…
可信度 74交叉信源 1
论文 / 方法
8/12 20:00
Spatial intelligence is becoming a foundation for embodied agents, robotic planning, and multimodal assistants. To improve the spatial reasoning ability of VLM agents, existing work has mainly followe…
可信度 74交叉信源 1
论文 / 方法
8/12 20:00
Transforming multimodal sources into condensed and structured media outputs can be fundamentally conceptualized as a long-horizon agentic process centered on a model-harness system. While an ideal har…
可信度 74交叉信源 1
论文 / 方法一手源
8/12 17:54
Aerial vision-language navigation (VLN) requires an embodied agent to integrate visual evidence over time, plan future actions, and determine when it has reached a navigation goal under partial observ…
论文 / 方法一手源
8/12 17:04
Multimodal Large Language Models (MLLMs) have been growing the capability for scientific writing and collaboration. For example, OpenAI Prism is a free workspace for scientific writing and collaborati…
设计 / 产品
8/12 10:54
免训练、开箱即用！
论文 / 方法
8/11 20:00
Agentic systems powered by large language models (LLMs) have opened new opportunities for business ideation. Yet existing approaches remain confined to a text-only paradigm, despite the inherently mul…
论文 / 方法一手源
8/11 17:28
Existing Multimodal Large Language Models (MLLMs) predominantly rely on image-text pairs for modality alignment pretraining, mapping global image representations to long textual descriptions. However,…
Skill / 资源
8/11 05:44
In this comprehensive guide, we demonstrate how to implement a complete, programmable MiniMax-H3 multimodal generation pipeline. By leveraging ComfyUI as a headless backend, we wal…
论文 / 方法
8/10 20:00
Omni-modal dialogue models can understand multimodal inputs and synthesize spoken replies, yet their responses remain visually disembodied. We introduce Ex-Omni-2D, an omni-modal dialogue framework th…
论文 / 方法一手源
8/10 17:59
Multimodal Large Language Models (MLLMs) exhibit strong visual understanding, yet the internal features that cause these behaviors remain difficult to identify, audit, or control. While applicable to…
论文 / 方法一手源
8/10 16:00
Large Vision-Language Models (LVLMs) have demonstrated strong performance on multimodal benchmarks, yet it remains unclear whether they genuinely reason about relationships between images and text or…
AI 点评 · 看点多模态模型深层推理能力，直击“真懂”还是“假会”的评测盲区。
设计 / 产品
8/10 14:32
Introducing Muse Glimmer: open-weight 30B agentic multimodal model that runs on your device (Meta). Interactive local agent lab + guide. Apache 2.0 · on-device…
Skill / 资源
8/10 05:44
**Meta** re-enters the open-weight frontier with the release of **Muse Glimmer**, a **30B dense**, multimodal, agent-focused model under **Apache 2.0**, optimized for always-on loc…
Skill / 资源一手源
8/10 00:00
可信度 92交叉信源 2
设计 / 产品
8/9 11:01
OpenCode skill suite for MiniMax H3 directing, routing, multishot planning, prompt generation, and review.
可信度 74交叉信源 1
论文 / 方法
8/8 20:00
We present VectraYX-Vision-1B, a sub-2B vision-language model (VLM) for Spanish/LATAM cybersecurity imagery, coupling a frozen SigLIP-so400m encoder to a 1.04B Spanish/LATAM security decoder via an ML…
模型 / Agent
8/8 04:36
Mistral AI has released Shieldstral 1.0 3B, an open-weights, policy-adaptive multimodal safety classifier that frames content moderation as a single yes/no question instead of a fi…
Skill / 资源
8/7 21:13
In this tutorial, we build an advanced multimodal retrieval-augmented generation pipeline with NVIDIA NeMo Retriever. We begin by configuring a Python 3.12 environment, installing…
论文 / 方法
8/7 20:00
Vision-Language Models (VLMs) should answer from concrete image evidence rather than language priors, dataset shortcuts, or irrelevant visual context. Existing perception-aware post-training methods e…
论文 / 方法
8/7 20:00
Vision-language grounding connects language to visual content, yet most existing formulations reduce grounding to a unidirectional localization problem: given a prespecified text phrase or category na…
论文 / 方法
8/7 20:00
Multimodal expansion of large language models (LLMs) enables new perceptual capabilities but often compromises the language intelligence acquired during pretraining. In this work, we investigate this…
论文 / 方法一手源
8/7 17:21
Vision-language models (VLMs) are improving rapidly, but benchmark development lags behind, making weaknesses hard to identify. Building stress tests is costly: samples must satisfy controlled conditi…
论文 / 方法一手源
8/7 17:14
LLM inference accounts for over 90% of AI operational energy, scaling directly with input token count---a critical inefficiency for telecom network analytics and numerical time-series data analysis (N…
论文 / 方法
8/6 20:00
Vision-language models are increasingly serving as the reasoning core of embodied agents. Robot execution is inherently iterative: each action reshapes the scene and physical state, continually renewi…
论文 / 方法
8/6 20:00
While Vision-Language-Action (VLA) models have advanced embodied AI, their fundamentally reactive paradigm severely limits performance in partially observable and long-horizon tasks. When restricted t…
可信度 74交叉信源 1
论文 / 方法
8/6 20:00
Visual-token pruning can substantially reduce the inference cost of multimodal large language models (MLLMs), yet existing methods largely rely on fixed, handcrafted heuristics and costly expert trial…
可信度 74交叉信源 1
论文 / 方法
8/5 20:00
Latent diffusion modeling (LDM), a prominent paradigm, utilizes tokenizers to map input signal to compressed representation. This dependency positions tokenizer as an integral part of generation proce…
论文 / 方法
8/5 20:00
Unified multimodal retrieval aims to identify candidates that satisfy complex user intent expressed through heterogeneous inputs. Although Large Vision-Language Model (LVLM)-based retrievers are effic…
论文 / 方法
8/5 20:00
Multimodal large language models excel at passive perception but struggle with complex visual cognitive tasks requiring multi-step temporal reasoning. This degradation largely stems from the inherent…
论文 / 方法
8/5 20:00
Vision-Language-Action (VLA) models have become a powerful paradigm for robot manipulation, but training a single generalist policy for heterogeneous robot embodiments remains an open problem. Existin…
论文 / 方法
8/5 20:00
Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in emotional intelligence. However, prevailing research predominantly focuses on task-specific specialization, often…
论文 / 方法
8/5 20:00
Recent works train agents by constructing large-scale multimodal environment pools. However, we find that simply increasing the number of multimodal environments does not always benefit. We further an…
论文 / 方法
8/5 20:00
Deploying autonomous multimodal agents in continuous, real-world environments requires them to ingest unbounded audio-visual streams and maintain hour-scale memory. However, current evaluations predom…
论文 / 方法
8/5 20:00
The "thinking-with-images" paradigm equips multimodal LLMs with active visual operations such as crop-and-zoom. However, models using these operations often achieve only marginal or negative gains ove…
可信度 74交叉信源 1
论文 / 方法一手源
8/5 17:42
Data assimilation (DA) uses Bayesian inference to update the state of a numerical forecast model with observed data. In this study, we propose a fundamentally different, unified approach to atmospheri…
论文 / 方法
8/5 08:25
NVIDIA released Alpamayo 2 Super, a 34B vision-language-action model for autonomous driving, under OpenMDW-1.1 — a permissive license covering fine-tuning, derivatives and commerci…
设计 / 产品
8/5 06:51
MCP server that gives text-only LLM coding agents vision — analyze images via any multimodal model (mimo, Claude, Gemini, OpenAI-compatible). Works with Claude…
论文 / 方法
8/4 20:00
GUI agents must remember both useful experience from earlier tasks and unfinished progress in the current interaction. Latent memory offers a compact solution by compressing multimodal trajectories in…
论文 / 方法
8/4 20:00
Leveraging pre-trained vision-language models (VLMs) to construct vision-language-action (VLA) models has emerged as a promising paradigm for 3D robot manipulation. However, existing 3D VLA methods re…
论文 / 方法
8/4 20:00
Memory-augmented VLM agents act on persistent spatial knowledge, yet that knowledge silently goes stale as the environment changes. We ask what happens when an agent must reconcile a confident memory…
论文 / 方法
8/4 20:00
Text-to-image (T2I) models can produce visually compelling images, yet they remain limited on open-world tasks that require complex semantic understanding, multi-step reasoning, and the integration of…
论文 / 方法
8/4 20:00
Vision offers a critical axis for advancing foundation models, driving a shift towards natively unified multimodal pretraining. Despite this momentum, the design space and the fundamental mechanisms o…
论文 / 方法
8/4 20:00
On-Policy Self-Distillation (OPSD) has become a standard post-training approach for improving visual reasoning in multimodal large language models (MLLMs). Existing methods draw privileged information…
论文 / 方法
8/4 20:00
Vision-language-action (VLA) models often treat main-view and wrist-view observations as parallel visual inputs, overlooking their distinct roles in robot manipulation. Fine-grained manipulation, howe…
论文 / 方法一手源
8/4 17:59
Existing scaling strategies for Multimodal Large Language Models (MLLMs) typically expand either model parameters or sequential inference computation, incurring substantial memory or latency overhead.…
模型 / Agent一手源
8/4 12:00
Shieldstral introduces a 3B open-weights multimodal safety classifier that outperforms models up to 7x its size.
可信度 92交叉信源 2
模型 / Agent
8/4 06:32
文 | 李炤锋 编辑 | 张雨忻 “长链任务如果只通过代��层面的反馈，误差可能会不断累积，最终效果会非常差。”谈及原生多模态的意义，一位多模态研究员表示，“视觉是一种更准确的反馈，也更贴近用户意图。” 过去一年，Coding与Agent能力不断改写大模型的排名，也成为AI最快兑现商业价值的场景之一。与此同时，随着Agent开始接管更多长链任务，越来越多的通…
Skill / 资源
8/4 05:44
**Alibaba** launched **Qwen3.8-Max**, enhancing multimodal capabilities and agent ecosystem integration. **NVIDIA** introduced **Alpamayo 2 Super** for autonomous vehicle reasoning…
论文 / 方法
8/3 20:00
We introduce Video-DeepResearch (Video-DR), extending multimodal agents from static images to continuous video streams, a setting that demands dense spatiotemporal grounding coupled with open-web expl…
论文 / 方法
8/3 20:00
Multimodal large language models (MLLMs) make grounded predictions in real-world scenes by combining visual and textual cues, yet existing benchmarks rarely reveal how they arbitrate between these evi…
论文 / 方法
8/3 20:00
Flow-matching vision-language-action (VLA) models such as pi0 generate robot actions by integrating a learned denoising velocity field, and have been reported to resist adversarial perturbations that…
论文 / 方法
8/3 20:00
LLM agents are increasingly applied to open-ended everyday requests that span work, study, and life. These tasks are long-horizon, cross-environment, and multimodal, forcing the agent to preserve goal…
模型 / Agent
8/3 05:44
**Alibaba** launched **Qwen3.8-Max**, a **2.4T-parameter** open-weight model emphasizing autonomous coding, long-horizon execution, and multimodal feedback, with aggressive pricing…
可信度 78交叉信源 2
设计 / 产品
8/3 05:41
编程、专业工作、长程任务、多模态分析统统梭哈
论文 / 方法一手源
8/3 00:00
Preference alignment has become a crucial component in enhancing the performance of Large Language Models (LLMs), yet its impact in Multimodal Large Language Models (MLLMs) remains…
可信度 88交叉信源 1
论文 / 方法
8/2 20:00
Multimodal large language models (MLLMs) have advanced visual understanding and reasoning, yet their static parametric knowledge limits their ability to address knowledge-intensive and dynamically evo…
论文 / 方法
8/2 20:00
Sparse retrieval underpins modern search systems, from web search to retrieval-augmented generation. Existing work has introduced Learned Sparse Retrieval (LSR) to push beyond exact lexical matching t…
论文 / 方法
8/2 20:00
Recent Vision-Language-Action (VLA) models for autonomous driving (AD) increasingly utilize chain-of-thought (CoT) supervision to enhance the reasoning capabilities of their Vision-Language Model (VLM…
论文 / 方法
8/2 20:00
Chart question answering (CQA) requires multimodal large language models (MLLMs) to integrate visual comprehension with logical reasoning, yet current models struggle with accurate visual grounding an…
论文 / 方法
8/2 20:00
Scientific poster construction compresses a long multimodal paper into a readable, editable canvas. Existing systems hide request-level failures by scoring only completed outputs; direct image generat…
论文 / 方法
8/2 20:00
Captions serve as a primary supervision signal for both multimodal understanding and text-to-image generation. However, previous evaluations treat the caption quality as a single scalar objective, whi…
论文 / 方法
8/2 20:00
Recent advances in image generation have demonstrated the potential of unified multimodal models that integrate understanding, generation, and editing. However, unified 3D modeling remains constrained…
论文 / 方法
8/2 20:00
Robot learning is splitting into two bets: policies that bake competence into frozen weights (vision-language-action, or VLA, models), and agents that write and refine their own executable skills as c…
论文 / 方法
8/2 20:00
Multimodal representation learning is a cornerstone of modern AI. By encoding multimodal queries and targets into vectors, it powers industrial search and recommendation and underpins modern agents. R…
论文 / 方法
8/1 20:00
Multimodal clinical models are usually judged on accuracy with every modality present, but deployment removes modalities; an echocardiogram is often unavailable where an ECG is routine. Two questions…
论文 / 方法
8/1 20:00
Recent 3D vision-language models (3D VLMs) construct geometry aware tokens by projecting 2D visual features into world coordinates, enabling spatial reasoning for tasks such as 3D question answering.…
论文 / 方法
7/31 20:00
Vision-language MoE batches contain different numbers of image and text tokens. Image resolution, image count, tiling, and prompt length all change this token mix. We call the standard token-level Swi…
论文 / 方法
7/31 20:00
Multimodal Large Language Models (MLLMs) have achieved strong performance on a wide range of vision-language tasks, but often fail under imperfect or shifted contexts. A reliable MLLM should refuse tr…
模型 / Agent
7/31 18:25
Google Deepmind's Gemini Robotics 2 is its most advanced vision-language-action model yet, built to control everything from tabletop robots to full-body humanoids. Gemini Robotics…
AI 点评 · 多形态机器人统一操控，视觉语言行动模型再突破，通用机器人时代加速到来。
论文 / 方法一手源
7/31 17:55
Density modes provide a localized and interpretable summary of multimodal distributions, but their estimation under rigorous differential privacy constraints remains largely unexplored. We study diffe…
论文 / 方法一手源
7/31 16:57
Traditional static assessments rely on a subtractive, deficit-based grading model that often penalizes ambition and obscures diagnostic feedback. Conversely, traditional face-to-face oral examinations…
论文 / 方法一手源
7/31 16:48
Reinforcement learning (RL) post-training of Vision-Language-Action (VLA) models has shown strong promise for robotic manipulation. Among RL methods, critic-based approaches rely on a value estimator…
论文 / 方法一手源
7/31 16:33
Reading a social situation often depends on behavior, not words alone. We introduce FriendBench, a benchmark for inferring whether two people are already familiar or are meeting as strangers, from a 2…
行业信号
7/31 15:23
文｜王欣逸 编辑｜张雨忻 一句话介绍 国内唯一做多模态长记忆的公司——丘脑智能，推出原生多模态记忆基座，押注AI从通用走向个性化，最终走向主动智能。 主动智能，指的是AI能在足够了解用户的基础上，在合适的时间、以恰当的方式主动跟用户交互。要实现主动智能，Memory是必须要跨过的门槛。 融资情况 近日，丘脑智能已完成数千万元种子轮融资，投资方包括深圳一线基金…
AI 点评 · 多模态长记忆是主动智能关键门槛，资本押注稀缺赛道，看点十足。
设计 / 产品
7/31 08:28
尽显AGI黄金时代的奢华
论文 / 方法
7/30 20:00
Reinforcement learning (RL) post-training of Vision-Language-Action (VLA) models has shown strong promise for robotic manipulation. Among RL methods, critic-based approaches rely on a value estimator…
论文 / 方法一手源
7/30 17:43
Multimodal on-policy distillation (OPD) transfers fine-grained visual knowledge by supervising student-generated trajectories with a privileged-view teacher. Yet its next-token corrections are source-…
论文 / 方法一手源
7/30 17:40
While Multimodal Retrieval-Augmented Generation (MM-RAG) has shown promising results, it still struggles with complex multi-hop reasoning tasks. Existing methods primarily focus on independent instanc…
模型 / Agent
7/30 17:20
Google DeepMind has released Gemini Robotics 2, the intelligence layer for its next generation of robots. The release ships three models: a vision-language-action model for whole b…
AI 点评 · 三个实体AI模型同时发布，标志全身控制、灵巧操作与多机器人协作迈入新阶段。
论文 / 方法
7/29 20:00
Multimodal agents for visual question answering increasingly operate as multi-step trajectories that interleave perception, retrieval, and reasoning, yet evaluation still largely reduces to final-answ…
论文 / 方法
7/29 20:00
The fundamental goal of agentic visual reasoning is to improve the success rate of multimodal large language models (MLLMs) on complex tasks, rather than merely equipping them with a sophisticated yet…
论文 / 方法
7/29 20:00
Long visual context poses a challenge for vision-language models: performance degrades as the number of distractors grows, and processing all tokens at once is computationally infeasible under GPU mem…
论文 / 方法
7/29 20:00
Visual generation increasingly requires high-resolution images, long videos, and multimodal context, making the quadratic cost of full attention prohibitive. We introduce Chimera, a hybrid visual diff…
论文 / 方法
7/29 20:00
Vision-language models (VLMs) are increasingly used in embodied agents to interpret visual inputs, reason about spatial relationships, and make task-level decisions based on that reasoning. However, a…
论文 / 方法
7/29 20:00
Despite the impressive visuomotor capabilities enabled by Vision-Language-Action (VLA) models, their performance often degrades on challenging and out-of-domain tasks. Recent test-time steering and sc…
论文 / 方法
7/29 20:00
Multimodal on-policy distillation (OPD) transfers fine-grained visual knowledge by supervising student-generated trajectories with a privileged-view teacher. Yet its next-token corrections are source-…
论文 / 方法一手源
7/29 17:32
CT vision-language foundation models have demonstrated promising performance across downstream tasks, but are typically trained with whole-volume representations that dilute fine-grained anatomical si…
论文 / 方法一手源
7/29 17:09
Vision-language-action (VLA) models remain constrained by scarce action-labeled robot data, whereas action-free videos offer abundant observations of physical change. Latent action models can extract…
行业信号
7/29 10:00
论文 / 方法
7/28 20:00
Vision-language-action (VLA) models commonly adopt an LLM-centric V to L to A pathway, where visual observations are projected into the representation space of a large language model before being deco…
论文 / 方法
7/28 20:00
Evaluating whether a vision-language model (VLM) can act through a physical body is challenging. The outcome of an action couples the VLM's decision with motor control. When a task fails, it is hard t…
论文 / 方法
7/28 20:00
Multimodal large language models increasingly use sketches, annotations, tools, and intermediate images during reasoning, but it remains unclear whether they truly rely on these visual states. Existin…
论文 / 方法
7/28 20:00
Recent advances in AI agents have increasingly internalized native capabilities into their underlying foundation models, giving rise to multimodal foundation models and large reasoning models. However…
论文 / 方法
7/28 20:00
Scientific figure comprehension and reasoning using multimodal AI requires integrating visual perception with domain-specific reasoning to extract meaningful knowledge, often not presented in the text…
论文 / 方法一手源
7/28 17:50
We present VetClaw, an edge-cloud multimodal agentic system for early veterinary disease screening. VetClaw uses a camera module as an edge sensing device and sends captured images, together with opti…
论文 / 方法一手源
7/28 17:35
Graph foundation models (GFMs) have emerged as a promising paradigm for transferring knowledge across graph domains and tasks. Real-world graphs associate nodes with text, images, and other modalities…
论文 / 方法
7/27 20:00
Any-to-any models predict any modality from any combination of others within a single network, a formulation used in multimodal vision and vision-language models, and increasingly in scientific domain…
论文 / 方法
7/27 20:00
We introduce Shieldstral, a 3B-parameter policy-adaptive multimodal safety classifier that matches or outperforms models nearly 7times its size on text safety benchmarks and sets a new state of the ar…
论文 / 方法
7/27 20:00
Real-world tasks often require models to learn from task-specific context rather than relying only on pre-trained knowledge. While recent work has highlighted this capability as context learning, exis…
论文 / 方法
7/27 20:00
Multimodal Large Language Models (MLLMs) achieve strong performance by integrating visual inputs with the rich priors of pretrained language models. However, they often fail on vision-centric tasks, e…
论文 / 方法一手源
7/27 17:46
Entity-Relationship Diagrams (ERDs) are central to conceptual database design, yet they are typically available only as rendered images rather than machine-readable schemas, limiting AI-assisted datab…
AI 点评 · 评测视觉语言模型理解结构化ER图的能力，填补了AI辅助数据库设计的评估空白。
论文 / 方法
7/26 20:00
While data curation for Vision Language Models (VLMs) is increasingly active, public practice for constructing pretraining mixtures remains largely heuristic: practitioners stack datasets that pass qu…
论文 / 方法
7/26 20:00
Multimodal large language models (MLLMs) hold immense potential to revolutionize clinical practice, yet deploying them in the medical domain is fundamentally a vision-centric challenge: models must ab…
论文 / 方法
7/26 20:00
Multimodal foundation models learned to see and to speak by consuming the whole internet. Embodied agents admit no such shortcut, since they require data that couple observations with physical states…
论文 / 方法
7/26 20:00
Many recent robot policies pursue stronger control by using large pretrained vision-language models (VLMs) as the action backbone. We introduce WorldDiT, a unified diffusion transformer architecture t…
论文 / 方法
7/26 20:00
Standard vision-language models (VLMs) suffer from Moravec's paradox: they excel at complex offline visual reasoning but struggle with simple streaming perception tasks and process them inefficiently.…
论文 / 方法
7/26 20:00
We introduce PerceptionBench, a benchmark specifically designed to evaluate the atomic visual perception capabilities of Multimodal Large Language Models (MLLMs). Existing benchmarks often fail to iso…
模型 / Agent
7/26 17:50
Black Forest Labs (BFL) has released FLUX 3, a multimodal foundation model that learns from images, videos and audio inside a single architecture. It is also the first FLUX model t…
论文 / 方法
7/25 20:00
Creative AI is moving from single-step asset generation toward long-horizon multimodal production. Although recent generative models can synthesize high-quality images, videos, audio clips, UI element…
论文 / 方法
7/25 20:00
Driving style captures stable, driver-specific patterns in how a vehicle is driven. In naturalistic data, however, this signal is hard to isolate because drivers are observed in different vehicles, on…
论文 / 方法
7/25 20:00
Multimodal automated fact-checking (MAFC) verifies claims by retrieving and reasoning over external evidence. However, most existing static benchmarks risk contamination: they primarily consist of out…
设计 / 产品
7/25 03:21
单卡突破10000 video tokens/s，Vivix打通实时多模态生成全链路
论文 / 方法
7/24 20:00
Large Vision-Language Models (LVLMs) remain bottlenecked by massive computational footprints, precluding their deployment on resource-constrained edge devices. While efforts to compress LVLMs focus he…
设计 / 产品
7/24 14:42
跑出原生全模态新路径
设计 / 产品
7/24 10:16
IT之家 7 月 24 日消息，亚马逊官方今日宣布升级 Alexa+ AI 助手， Alexa+ 支持自然对话、信息记忆和任务执行 ，可帮助用户管理日程、总结邮件、生成播客、控制智能家居，并完成购物、餐厅预订、叫车等日常任务。 Alexa+ 已从单纯的语音助手升级为一个具备多模态能力（视觉识别、生成式 AI 创作）、超强记忆力，并打通了众多第三方现实服务接口…
AI 点评 · AI助手从对话升级到行动，打通现实服务，智能助手终于能真正“办事”了。
Skill / 资源
7/24 04:30
A HUGE win for BFL!
行业信号
7/24 00:00
今日热点导览 混元多模态理解负责人胡瀚离职创业，原团队或将聚焦世界模型 极氪回应“海外锁车”事件 客服回应滔搏暴力打折甩卖耐克库存：没有收到降价通知 哈兰德和亚马尔2.2亿欧元身价破纪录 张雪峰女儿再接手三家公司股份 TOP 3 大新闻 段永平：10年内大概率不会卖泡泡玛特 7月23���，段永平在社交媒体平台雪球上发表了他对近期投资操作的最新想法。雪球上有…
AI 点评 · 段永平罕见长线看好，泡泡玛特投资逻辑获大佬背书，市场风向标意义显著。
论文 / 方法
7/23 20:00
Although large language models (LLMs) exhibit remarkable reasoning capabilities, their reliance on text-only pre-training restricts the perception of the multimodal physical world. Native multimodal p…
论文 / 方法
7/23 20:00
Vision-language model (VLM) agents increasingly use tools to act on 3D scenes rather than only describe them. Existing 3D benchmarks score textual responses or single-object operations, leaving agent…
论文 / 方法
7/23 17:59
Despite rapid progress, most existing vision-language models (VLMs) built from 2D visual inputs often struggle when handling various 3D tasks that require fine-grained spatial understanding and reason…
AI 点评 · 将隐式与显式几何融合进视觉语言模型，突破2D局限，实现精细3D空间推理。
论文 / 方法
7/23 17:35
Unlike large language models (LLMs) that exhibit strong reasoning capabilities, vision-language models (VLMs) struggle with visual reasoning, even on geometry problems that admit equivalent text, diag…
AI 点评 · 多模态推理新突破，利用跨视角学习提升视觉语言模型几何问题解决能力。
行业信号
7/23 08:07
文 | 周鑫雨 编辑 | 张雨忻 《智能涌现》独家获悉，近期，腾讯混元多模态理解负责人胡瀚提出了离职。 此前，他曾担任微软亚洲研究院视觉计算组首席研究员。2025 年初加入腾讯后，负责视觉大模型的研究。在后续的调整中，他加入大语言模型部旗下的“Frontier”前沿技术研究组，负责多模态理解的相关研究，汇报给姚顺雨。 据了解，胡瀚还曾承担世界模型的研发工作。…
AI 点评 · 顶级多模态人才离职创业，折射出世界模型赛道竞争白热化。
论文 / 方法
7/22 16:37
We find that vision-language models are sensitive to a specific semantically irrelevant change: the order in which the image and question are presented. Across three models and three benchmarks, image…
论文 / 方法
7/22 16:30
Closing the gap between benchmark performance and reliable real-world operation remains a central challenge for Vision-Language-Action (VLA) humanoid robots, which must handle execution errors, distri…
论文 / 方法
7/21 20:00
Contextual entrainment is the tendency of a model to let auxiliary context in its input pull its output, independently of whether that context is relevant, true, or even meaningful. Recently, it has b…
AI 点评 · 聚焦多模态模型对无关上下文的敏感性，揭示推理漏洞，推动AI安全评估方法创新。
论文 / 方法
7/21 20:00
Reinforcement learning with verifiable rewards (RLVR) has substantially improved language-model reasoning, yet its extension to vision-language models remains constrained by the lack of training data…
AI 点评 · 用分类学引导多域视觉推理，突破强化学习的训练数据瓶颈，值得关注。
论文 / 方法
7/21 20:00
Practical robotic grasping in complex scenes requires both 3D spatial reasoning and alignment with task-specific requirements. Vision-language models (VLMs) offer a natural way to specify these requir…
AI 点评 · 用自然语言指令引导机器人抓取复杂场景中的物体，让多形态机器人理解语义和空间关系。
论文 / 方法
7/21 20:00
Embodied visual tracking (EVT) requires a mobile agent to continuously follow a specific target described in natural language using only onboard vision. While recent vision-language-action (VLA) polic…
AI 点评 · 将自然语言描述与移动追踪结合，突破传统视觉追踪限制，提升具身智能的实用性与交互性。
论文 / 方法
7/21 20:00
Most automatic speaker verification (ASV) systems operate on individual utterances, despite real-world interactions typically consisting of multiple utterances. As speech accumulates, increasingly ric…
Skill / 资源
7/21 14:22
Nativ: Run AI models locally on your Mac Prince Canuma is the developer behind the excellent MLX-VLM Python library for running vision-LLMs using MLX on a Mac. I'm really excited a…
AI 点评 · 本地运行AI模型，保护隐私且无需联网，苹果用户的新利器。
设计 / 产品
7/21 07:32
Enterprise multi-source RAG platform with multimodal embedding, hybrid vector/BM25 retrieval, MCP & RBAC support
论文 / 方法
7/20 20:00
Multimodal humor in memes, cartoons, and comics remains difficult for AI systems because intended meaning depends on non-literal mechanisms, shared cultural knowledge, and communicative intent rather…
AI 点评 · 多模态幽默AI研究难点与突破，揭示文化理解与意图识别的新挑战。
论文 / 方法
7/20 20:00
Efficient teamwork typically combines global coordination with parallel execution, a principle not yet fully reflected in unified Vision-Language Model (VLM)-based document parsers. Existing unified p…
论文 / 方法
7/20 20:00
Controllable image generation remains challenging for creative professionals, who often require precise regional control over materials, object identities, and spatial arrangements that cannot be reli…
论文 / 方法
7/20 17:58
Modern vision-language models (VLMs) have significantly improved image generation and editing capabilities, making pixel-level image tampering detection increasingly important yet challenging under cr…
论文 / 方法一手源
7/20 00:00
Long video summarization presents significant challenges for multimodal large language models (MLLMs), particularly in maintaining temporal fidelity over extended durations and pro…
论文 / 方法
7/19 20:00
Human-object centric video personalization (HOCVP) is a core task within subject-driven video generation. However, existing methods suffer from two key limitations. First, most approaches focusing on…
论文 / 方法
7/19 20:00
Real-time multimodal applications, including voice agents and interactive video generation, compose heterogeneous models into pipelines whose efficient deployment requires application-specific decisio…
论文 / 方法
7/19 20:00
Industrial Video Anomaly Detection (IVAD) aims to identify anomalous objects and events in an industrial process, which is crucial for modern manufacturing and quality control systems. Existing VLM-ba…
论文 / 方法
7/18 20:00
Video multimodal large language models (MLLMs) can describe what happens in a video, but rarely identify when the supporting evidence occurs. We study generalist video temporal grounding, in which one…
行业信号
7/18 08:54
论文 / 方法
7/17 20:00
Optical coherence tomography (OCT) imaging is essential for the diagnosis and treatment of retinal diseases. Although multimodal large language models (MLLMs) have demonstrated considerable potential…
论文 / 方法
7/17 17:11
Multimodal Scientific Claim Verification (MSCV) requires models to verify scientific claims using visually grounded evidence from papers, including figures, tables, charts, and textual context. Howeve…
行业信号
7/17 10:45
人工智能正在进入一个新的产业周期。 过去一年，大模型能力持续演进，生成式AI、多模态交互、智能体等技术方向快速推进；而具身智能也从早期的技术探索阶段，逐渐步入产业验证的深水区，机器人开始成为人工智能与现实世界的重要载体。 市场率先给出了回应。据36氪研究院测算，中国具身智能市场规模已从2018年的2133亿元增长至2025年的9150亿元，2026年有望突破…
行业信号
7/17 07:22
IT之家 7 月 17 日消息，腾讯 Robotics X 实验室、福田实验室联合腾讯混元打造的第二代具身 VLM 基座模型 Hy-Embodied-VLM-1.0 昨日正式发布。 官方表示，在覆盖 37 个评测任务的具身能力评测体系中，Hy-Embodied-VLM-1.0 在物理状态理解、动作 — 变化推理、时序与自适应推理三大维度分别取得 68.6、6…
AI 点评 · 参数规模锐减十倍，性能逼近上一代大模型，具身智能走向高效实用化。
行业信号
7/17 02:39
作者 | 乔钰杰 编辑 | 袁斯来 硬氪获悉，全身多模态融合触觉解决方案公司模感科技（MoSense）近日完成数千万元天使轮融资，投资方包括红杉中国、高瓴创投及智元机器人。本轮融资资金将主要用于加速研发、团队扩充、算力投入及量产测试体系建设。 模感科技成立于2026年5月，总部注册于上海，在深圳前海设有研发中心，聚焦机器人全身多模态触觉感知系统研发。公司正式…
AI 点评 · 红杉、高瓴、智元联手押注，机器人触觉赛道技术壁垒高、应用前景广。
论文 / 方法一手源
7/17 00:00
Vision-language models (VLMs) can follow complex textual instructions, yet they struggle to reason from purely visual context. In particular, current models fail to infer shared co…
论文 / 方法
7/16 20:00
We present S1-Omni, a unified multimodal reasoning model for scientific understanding, prediction, and generation. AI for Science (AI4S) has advanced significantly through domain-specific models, tool…
论文 / 方法
7/16 20:00
The post-training of Vision-Language-Action (VLA) models is essential due to the diversity of simulators, robot embodiments, and task objectives. Existing compute services, whether offered as direct a…
论文 / 方法
7/16 17:38
Healthcare multimodal AI must combine visual and textual evidence while remaining reliable and interpretable. Using MediaEval Medico 2025 as a retrospective GI endoscopy case study, we analyze design…
AI 点评 · 多模态医疗AI的可靠性设计突破，用胃肠镜案例揭示可解释性关键。
论文 / 方法
7/16 17:37
Political discourse has increasingly moved to short-video platforms, yet computational analysis of such content remains constrained by the scarcity of datasets that jointly preserve audiovisual inform…
AI 点评 · 多模态数据集填补短视频政治立场分析空白，推动社交媒体研究。
Skill / 资源
7/16 06:18
Thinky's first full LLM release is a banger and bonus: it's open weights!
论文 / 方法
7/15 20:00
Visually impaired individuals (VIIs) encounter significant daily challenges due to limited access to visual information. Although Multimodal Large Language Models (MLLMs) have achieved impressive resu…
AI 点评 · 首个专为盲人设计的视频评测集，推动AI辅助视觉障碍技术落地。
论文 / 方法
7/15 20:00
Skills are a useful abstraction for software agents, turning human and agent experience into reusable procedural knowledge. Yet existing skill libraries are mostly hand-written, text-centric, or deriv…
论文 / 方法
7/15 20:00
We present Xiaomi-Robotics-1, a foundational vision-language-action (VLA) model capable of (1) following diverse language instructions to perform a wide range of mobile manipulation tasks in unseen en…
论文 / 方法
7/15 16:13
Longitudinal tumor measurements, dropout information, and genetic covariates provide complementary information about treatment response, but integrating these data sources within a single population m…
论文 / 方法
7/14 20:00
Finetuning a pretrained vision-language model (VLM) on robot demonstrations via behavior cloning (BC) has become the standard recipe for vision-language-action (VLA) policies. However, BC finetuning p…
论文 / 方法
7/14 17:24
Math reasoning has achieved significant progress with the rapid advancement of Multimodal Large Language Models (MLLMs), however analytic geometry remains largely underexplored, primarily due to the s…
论文 / 方法
7/13 20:00
Autonomous UAV systems increasingly rely on multimodal large language models (MLLMs) to operate in complex real-world environments. Such embodied scenarios require not only understanding the surroundi…
论文 / 方法
7/13 20:00
We introduce Boogu-Image-0.1, an open-source unified multimodal understanding and generation model family, comprising Base, Turbo, Edit, and Edit-Turbo variants. It delivers competitive performance in…
论文 / 方法
7/13 20:00
Despite the success of Vision-Language Models (VLMs), misleading charts remain a significant challenge due to their deceptive visual structures and distorted data representations. We present ChartCyni…
论文 / 方法
7/13 20:00
Building assistants that can continually watch the world, remember what they see, and reason over their accumulated experience is a long-standing goal, and recently multimodal agents equipped with lon…
论文 / 方法
7/13 20:00
Vision-language models (VLMs) process large numbers of visual tokens, resulting in substantial inference latency and memory overhead. This has motivated extensive research on visual token compression.…
论文 / 方法
7/13 17:27
This paper presents a cascaded Low-Rank Adaptation (LoRA)-based multimodal fusion framework for action and activity recognition in healthcare-oriented training environments. The proposed architecture…
行业信号
7/13 11:15
AI 点评 · 统一多模态框架性能大幅提升，端到端优化思路值得关注。
行业信号
7/13 08:34
36氪从多位产业人士处获悉，字节跳动正探索进入自动驾驶领域。这一项目目前由Seed旗下周畅的世界模型团队负责。据了解，Seed旗下不仅有周畅的多模态模型、世界模型等团队，还有大语言模型方向。 而自动驾驶与世界模型的技术路线有交叠之处。 另有消息人士告诉36氪，业务方向上，字节有意布局的自动驾驶场景有无人物流，这一业务隶属于字节旗下的火山引擎汽车行业线。 部分…
行业信号
7/13 02:39
一个从未见过监控画面的多模态模型，却比在监控数据上练了多年的小模型“老将”更懂监控。这不是科幻电影，这是2023年Om AI联汇的一场“无心插柳”，也是CEO兼首席科学家赵天成博士更加坚信“多模态训练方式能为物理开放世界带来泛化性”的关键节点。彼时，AI行业正在追求以大语言模型为核心的生成式AI。 三年后，这个多模态模型演变成了VLX——全球首个面向物理AI…
AI 点评 · 押注物理AI原生流式架构，多模态泛化性突破传统小模型局限。
论文 / 方法
7/12 20:00
We introduce Self-Verified Reasoner (SVR-R1), a multi-turn RL framework that turns a model's own verification into a learning signal for multimodal reasoning. For each query, the model proposes an ans…
论文 / 方法
7/12 20:00
Vision-language-action (VLA) models predict robot actions from visual observations and language instructions. These actions are defined in the robot's own 3D coordinate frame, yet most VLAs observe th…
设计 / 产品
7/12 15:12
IT之家 7 月 12 日消息，Meta 于 7 月 9 日正式发布适用于 AI 智能体的多模态推理模型 Muse Spark 1.1 版本，重点提升了模型在智能体任务中的规划、协同与执行能力，并增强了工具调用、代码开发、应用操作能力。 Meta 表示，Muse Spark 1.1 强化了多智能体协作机制，由主智能体负责收集信息、制定计划，再将任务拆分并分配…
AI 点评 · 多智能体协作机制是AI落地的关键突破，Meta这次强化了任务拆解与分工能力。
论文 / 方法
7/11 11:24
Recent VLM and VLA systems have improved robotic perception and action prediction, yet long-horizon embodied agents still require a general runtime layer for reasoning, memory, tool use, verification,…
论文 / 方法
7/10 20:00
Vision language models (VLMs) have achieved strong performance on visual document understanding benchmarks such as DocVQA, ChartQA, and MMLongBench-Doc. However, real-world documents combine multiple…
论文 / 方法
7/10 17:53
Vision language models (VLMs) have made remarkable progress in visual reasoning during the last decade. Most evaluations have used simple scenes (MS-COCO) that do not showcase complex human interactio…
AI 点评 · 十年视觉语言模型进化揭示：精度提升中，视觉认知错误揭示了人类与AI感知的深层差异。
论文 / 方法
7/10 17:22
We present our submission to the QANTA 2026 shared challenge at the ICML 2026 Workshop on Efficient Multimodal Question Answering (EMM-QA). Quanta evaluates multimodal quizbowl systems that answer pyr…
AI 点评 · 置信度校准与增量推理结合，为多模态问答提供高效新思路，技术方案值得关注。
论文 / 方法
7/10 16:42
Precision industrial contact manipulation requires reliable robot policies under pose perturbations and contact-force constraints. Vision-language-action models offer broad generalization but often in…
AI 点评 · 用强化学习微调动作块，提升机器人接触操作的鲁棒性和泛化能力。
行业信号
7/10 10:00
AI 点评 · 聚焦多模态推理效率，vLLM的实践为AI应用降本增效提供关键参考。
论文 / 方法
7/9 17:46
Recent advances in Vision-Language Models, Large Language Models, and Multimodal Large Language Models have improved autonomous driving tasks such as scene understanding, decision making, trajectory p…
论文 / 方法
7/8 20:00
The rapid development of large language models and multimodal large language models has accelerated the emergence of proactive agents capable of operating everyday tools and assisting users in real-wo…
论文 / 方法
7/8 20:00
Modern AI models achieve strong performance on many established benchmarks, yet they still fail on tasks that humans find almost trivial, such as manipulating a string or drawing a dog with five legs.…
论文 / 方法
7/8 17:26
Medicine is inherently multimodal, requiring clinicians to synthesize information across diverse data streams. Yet the development of multimodal foundation models is constrained by limited access to l…
论文 / 方法
7/7 20:00
Mainstream Vision-Language-Action (VLA) models predict actions primarily from the current observation under a Markovian assumption, thus struggling with long-horizon, temporally dependent tasks. Exist…
论文 / 方法
7/7 20:00
Medicine is inherently multimodal, requiring clinicians to synthesize information across diverse data streams. Yet the development of multimodal foundation models is constrained by limited access to l…
论文 / 方法
7/7 17:38
- Objective: Multimodal deep learning models in oncology are currently limited by monolithic designs that rigidly couple data ingestion, clinical routing, and artificial intelligence (AI) inference. T…
论文 / 方法
7/7 17:27
Vision-language models (VLMs) struggle to generalize in interactive physical reasoning, particularly under unseen tasks and environments. Two key failure modes are prominent: hallucinated chain-of-tho…
设计 / 产品
7/7 08:38
Cognitive-structured Multimodal Agent (CMA-Harness): a memory-centric agent for long-horizon multimodal understanding, generation, and editing — externalizing v…
设计 / 产品
7/7 05:03
从文字说明书到多模态经验库
行业信号
7/7 01:05
文｜胡香赟 编辑｜海若镜 36氪获悉，AI虚拟细胞（AIVC）企业华源智因近期已完成千万级人民币种子轮融资。本轮融资由水木创投领投，募集资金将主要用于多模态测序底层技术迭代，进一步拓展与头部三甲医院的合作，以及团队扩充等。此外，华源智因团队已计划启动新一轮融资。 华源智因创始团队由资深医药产业从业者、计算生物学研发人员组成，并邀请到深圳国家基因库等单位专家组…
论文 / 方法
7/6 20:00
Embodied navigation aims to build agents that interpret multimodal goals, reason in 3D space, and reach target destinations reliably in the real world. However, progress remains constrained by the lac…
论文 / 方法
7/6 20:00
We formulate computer vision as unified multimodal generation, where heterogeneous visual tasks are expressed in the native text and image generation spaces of a unified multimodal model, without task…
论文 / 方法
7/6 20:00
Vision-Language-Action (VLA) models are typically trained by imitation learning on large-scale robot demonstration datasets, but more data does not necessarily yield better policies due to redundancy,…
论文 / 方法
7/6 20:00
Vision-language models (VLMs) have made interactive digital museums increasingly feasible by connecting 3D digitization with natural-language artifact exploration. However, in cultural heritage domain…
论文 / 方法
7/6 17:59
Real-world robot deployment rarely maintains the training-stage camera setup, where cameras often experience repositioning or remounting depending on actual scenarios. Existing view-robust Vision-Lang…
论文 / 方法
7/6 17:55
While recent Vision-Language-Action (VLA) models show promise toward generalist manipulation policies, they struggle with long-horizon tasks due to their Markovian nature-relying solely on current obs…
设计 / 产品
7/6 02:52
MODUS: Decoder-only Any-to-Any Modeling of Diverse Modalities [ICML 2026]
论文 / 方法
7/5 20:00
Multi-vector vision-language retrieval preserves fine-grained visual evidence through maximum-similarity late interaction, but dense image-side tokens make storage and scoring expensive. Existing toke…
论文 / 方法
7/5 20:00
We present HunyuanOCR-1.5, a lightweight end-to-end OCR-specialized vision-language model. HunyuanOCR unifies document parsing, text spotting, information extraction, text-image translation, and multi…
论文 / 方法
7/5 20:00
Agentic video understanding equips models with long-term memory to autonomously process and respond to continuous, long-horizon multimodal streams. However, advanced video agents often rely on ``detec…
设计 / 产品
7/5 05:38
Search knowledge by what documents mean and how they look — not one or the other.
论文 / 方法
7/4 20:00
We present the AI Wizards submission to EXIST 2026 for multimodal sexism identification in memes. The task is composed of three, increasingly harder subtasks. We model them hierarchically as condition…
论文 / 方法
7/4 20:00
Recent advances in multimodal foundation models and agent systems have driven GUI agents from single-platform task execution toward cross-platform interaction. However, building multi-platform GUI age…
设计 / 产品
7/4 08:20
🚁 Can Vision-Language Models Think from the Sky? UAVReason for Aerial Reasoning and Generation
论文 / 方法
7/3 20:00
Vision-Language-Action (VLA) models acquire broad embodied capabilities through large-scale pretraining, yet their generalization remains far more fragile than that of LLMs and VLMs. The prevailing re…
论文 / 方法
7/3 20:00
Multimodal large language models (MLLMs) generate responses autoregressively, integrating visual and linguistic information in an evolving context. Prior work on interpretability has focused on indivi…
论文 / 方法
7/2 20:00
We introduce MentalThink, a visual-symbolic reasoning paradigm that equips Multimodal LLMs (MLLMs) with an executable mechanism for "mental" visualization. The core of MentalThink is a think-with-SVG…
论文 / 方法
7/2 17:55
Models trained via Contrastive Language-Image Pretraining (CLIP) serve as the foundational vision encoders for most modern Large Vision Language Models (LVLMs). Despite their widespread adoption, CLIP…
论文 / 方法
7/2 17:53
Large vision-language models can reason over multimodal inputs by generating textual chains of thought (CoT). A key capability exhibited in CoT reasoning is self-reflection: revisiting earlier decisio…
论文 / 方法
7/1 20:00
Vision-Language-Action (VLA) models are fundamentally bottlenecked by the scarcity of expert demonstrations -- triplets of observations, instructions, and actions that are costly to collect at scale.…
论文 / 方法
7/1 20:00
Vision-Language Models (VLMs) have demonstrated immense promise in Spatio-Temporal Video Grounding (STVG). However, current evaluation protocols are largely confined to zero-shot assessments on genera…
论文 / 方法
7/1 20:00
Vision-Language-Action (VLA) foundation models have recently achieved strong progress in embodied intelligence. To reduce policy-call frequency while preserving temporal coherence, most generative pol…
论文 / 方法
7/1 20:00
Embodied AI models now span vision-language-action (VLA) models and world-action models (WAMs), but practical deployment remains fragmented across model-specific Python stacks, backend assumptions, an…
论文 / 方法
7/1 20:00
We introduce Rank-Then-Act (RTA), a framework for learning control policies from expert video demonstrations without environment rewards. RTA trains a Vision-Language Model (VLM) offline as a progress…
论文 / 方法
7/1 20:00
We introduce Gemma 4, a new generation of open-weight, natively multimodal language models in the Gemma model family. Designed to advance compute efficiency and reasoning, the Gemma 4 model suite feat…
论文 / 方法
7/1 17:51
Current work on robot furniture assembly mostly focuses on toy-scale settings or single-arm manipulation. We introduce FurnitureVLA, the first systematic study of real-scale bimanual furniture assembl…
设计 / 产品
7/1 03:46
物理世界AI的下一步
模型 / Agent
6/30 23:29
谷歌在近期举行的I/O开发者大会上宣布了一系列面向开发者的AI创作工具升级，旨在通过最新的Gemini模型家族，降低多媒体内容的生成门槛并提升效率。在视频和多模态创作领域，谷歌发布了全新的Gemini Omni模型。该模型能够理解并处理文本、图像、音频和视频输入，并生成连贯的视频内容。其最突出的特点是支持对话式编辑，用户只需用自然语言描述修改需求，如更换角色…
AI 点评 · 多模态对话式编辑降低视频创作门槛，自然语言交互革新内容生产流程。
论文 / 方法
6/30 20:00
Multimodal Large Language Models (MLLMs) are often constrained by a language-space bottleneck, forcing complex visual reasoning into discrete tokens which can lose perceptual nuance. A promising alter…
论文 / 方法
6/30 20:00
Fine-grained visual reasoning remains challenging for vision-language models, especially when small but critical visual cues are buried in high-resolution images. Existing approaches rely on repeated…
论文 / 方法
6/30 20:00
Vision-Language-Action (VLA) models often fail to perform the same learned tasks under environmental shifts, such as changes in camera pose and shifts to a different but similar robot (e.g., from Pand…
论文 / 方法
6/30 20:00
As grounded QA systems are increasingly deployed in AI assistants, accurately attributing generated answers to evidence is critical for user trust and model safety. While unimodal attributions have be…
论文 / 方法
6/30 20:00
Touch supplies the physical grounding needed to perceive intrinsic material properties, such as friction and compliance, that vision alone often cannot resolve. Recent efforts for equipping multimodal…
设计 / 产品
6/30 19:38
One embedding space for text, image, video, audio, thermal, and IMU. Open weights, self-hostable.
论文 / 方法
6/30 17:47
Multimodal graph foundation models aim to learn reusable knowledge from graphs enriched with text, images, attributes, and relational topology, thereby supporting diverse graph-centric and modality-ce…
论文 / 方法
6/30 17:46
Uncertainty estimation has been a long-standing challenge in AI models; it amounts to "knowing what you don't know," and metacognition is notoriously difficult even for humans (cf. the Dunning-Kruger…
行业信号
6/30 15:27
IT之家 6 月 30 日消息，华为中国宣布，2026 年 6 月 29 日，全球首个商用多模态文旅大模型 ——“博观文旅大模型”在西安规模应用。截至今年 3 月， “博观”支撑开发的 AI 伴游智能体已覆盖超 400 万用户 。其打造的非遗数字 IP，衍生产品销售超 200 万。 IT之家查询获悉，陕文投与华为等于 2025 年 9 月联合开发的“博观文旅…
设计 / 产品
6/30 05:53
能聊、能唱跳、能陪你玩游戏
论文 / 方法
6/29 20:00
Graphical user interface (GUI) agents build on vision-language models to complete user tasks end-to-end in real applications through interface actions such as tapping, swiping, text entry, and navigat…
论文 / 方法
6/29 20:00
Traditional robot programming is challenging: it requires orchestrating multimodal perception, managing physical contact dynamics, and handling diverse configurations and execution failures. We introd…
论文 / 方法
6/29 20:00
Recent multimodal large language models have shown great promise in clinical image reasoning, but existing post-training pipelines remain predominantly outcome-centric, relying on final answer correct…
论文 / 方法
6/29 20:00
In collaborative dialogue, shared perception does not guarantee shared interpretation. Mutual understanding must be established through interaction. We investigate whether vision-language models (VLMs…
论文 / 方法
6/29 20:00
Hierarchical Vision-Language-Action (VLA) models decouple high-level planning from low-level control to improve generalization in robot manipulation. Recent work in this paradigm uses 2D end-effector…
设计 / 产品
6/29 08:49
让AI真正“读懂”企业
论文 / 方法
6/28 20:00
The advancement of generative AI models capable of producing text and image marks a critical step forward in the realm of multimodal intelligence, particularly for tasks involving the interleaving of…
论文 / 方法
6/28 20:00
Agentic multimodal models perform diverse operations on an image via code and reason over the returned view, an effective paradigm for fine-grained visual question answering. However, code operations…
论文 / 方法
6/28 20:00
The materials science literature encodes decades of experimental knowledge in figures, yet this visual record remains locked away and inaccessible to AI at scale. The core difficulty is structural: mo…
论文 / 方法
6/28 20:00
We introduce Orca, an initial instantiation of a general world foundation model. Orca learns a unified world latent space from multimodal world signals and exposes it through multimodal readout interf…
论文 / 方法
6/28 20:00
JD.com, one of the world's largest e-commerce platforms, serves over 700 million active users and millions of merchants, with a catalog of tens of billions of SKUs. At this scale, high-quality, struct…
论文 / 方法
6/27 20:00
Video understanding is a fundamental capability for multimodal intelligence, and recent Multimodal Large Language Models (MLLMs) have achieved remarkable performance on Video Question Answering (Video…
论文 / 方法
6/27 20:00
Vision-language dataset distillation (VLDD) compresses a large image-text paired dataset into a small set of synthetic pairs that can efficiently train contrastive vision-language models under strict…
设计 / 产品
6/27 12:19
VLM- R1之后再次出手！全球首个端侧流式多模态来了！
AI 点评 · 端侧跑通多模态大模型，将AI应用成本与门槛大幅降低，是产业落地的关键突破。
设计 / 产品
6/27 06:12
Give non-multimodal Claude Code main models the ability to see pasted screenshots — a ~200-line UserPromptSubmit hook.
行业信号
6/26 23:30
过去几年，智能驾驶行业的竞争重心经历了几次明显变化。 最早比的是硬件：激光雷达要不要上、摄像头装几个、算力做到多少 TOPS；随后进入大模型时代，竞争开始转向端到端、VLA（Vision-Language-Action）、World Model（世界模型）等路线。 到了今天，越来越多公司发现，仅仅拥有更大的模型已经不足以形成代际优势，真正决定上限的，开始变成…
AI 点评 · 解析理想追赶特斯拉FSD V14的技术短板，揭示智驾竞争从模型规模转向系统整合的新趋势。
论文 / 方法
6/26 17:16
Vision-language models must reconcile visual evidence with memorized world knowledge when the two conflict. How they resolve this conflict shapes the reliability of multimodal systems, yet prior work…
设计 / 产品
6/26 12:23
[ICML 2026] Unison: Benchmarking Unified Multimodal Models via Synergistic Understanding and Generation
论文 / 方法
6/25 20:00
Knowledge-based Visual Question Answering (KB-VQA) requires models to combine image understanding with external knowledge. Most prior methods use a fixed retrieve-then-generate pipeline with a pre-sel…
论文 / 方法
6/25 20:00
Vision-Language-Action (VLA) models enable instruction-driven robotic manipulation, but they inherit oversized language backbones from pretrained VLMs whose capacity far exceeds what is needed for sho…
论文 / 方法
6/25 20:00
Adapting a foundation vision-language encoder to a specialized retrieval task creates a fundamental tradeoff: gains on the target distribution come at the cost of the foundation model's broad generali…
论文 / 方法
6/25 20:00
Recent interest in multimodal large language models (MLLMs) raises a central question: can they reason over dynamic visual evidence rather than merely recognize objects or events in individual frames?…
论文 / 方法
6/25 20:00
We introduce PerceptionRubrics, a rubric-based evaluation framework that addresses the gap between saturated benchmark scores and real-world brittleness. Shifting evaluation from holistic semantic mat…
论文 / 方法
6/25 20:00
Building performant Vision-Language Models (VLMs) requires carefully curating large-scale training datasets, yet the community lacks systematic benchmarks for evaluating such curation strategies. We i…
论文 / 方法
6/25 17:44
Multimodal web agents can assist humans in operating repetitive GUI tasks, where effective task planning is essential for decomposing complex tasks into executable actions. While small open source MLL…
设计 / 产品
6/25 07:42
作者｜黄楠 编辑｜袁斯来 6月24日，通用具身智能企业RoboScience机器科学通用具身大模型发布，首次完整披露自研Visics大模型的技术架构VLOA（Vision-Language-Object-Action），并展示了模型在家具拼装、灵巧抓取、动态流水线等多项真实场景的应用。 大语言模型有标准的文本Token，自动驾驶有统一的视觉或点云表征，这些基…
论文 / 方法
6/24 20:00
Modern Vision-Language-Action (VLA) models often fail to generalize to novel setups, such as altered camera viewpoints or robot morphologies, because they are typically conditioned only on current obs…
论文 / 方法
6/24 20:00
A unified representation for text and vision is a natural pursuit, as it enables simpler multimodal modeling and more efficient training. However, representing images as discrete signals in the same w…
论文 / 方法
6/24 17:59
Most Vision-Language-Action (VLA) models build on a Vision-Language Model (VLM) backbone by attaching an action module and optimizing the full policy jointly. This design inherits strong visual and li…
论文 / 方法
6/24 17:53
Standard benchmarks for multimodal large language models (MLLMs) score each item on one canonical ordering and miss whether order-irrelevant shuffling changes the answer, a baseline reliability proper…
论文 / 方法
6/24 17:15
Vision-language models (VLMs) have achieved strong performance on OCR-based benchmarks and increasingly focused on text-rich understanding, but their robustness under controlled visual degradation rem…
论文 / 方法
6/24 17:00
Multimodal Large Language Models (MLLMs) demonstrate strong performance on standard visual question answering benchmarks, yet their scalability under controlled structural complexity remains poorly un…
论文 / 方法
6/23 20:00
Fine-grained visual reasoning requires multimodal large language models (MLLMs) to identify task-relevant visual evidence and ground their reasoning in local image regions. Existing agentic methods ty…
设计 / 产品
6/23 07:11
DataClaw: Agentic Tailoring Multimodal Data from Raw Streams — coming soon (code, weights, dataset & DataClaw-val upon acceptance).
设计 / 产品
6/23 07:11
DataClaw: Agentic Tailoring Multimodal Data from Raw Streams — coming soon (code, weights, dataset & DataClaw-val upon acceptance).
论文 / 方法
6/22 20:00
Vision-language-action (VLA) models can learn manipulation skills from demonstrations, but their capabilities are bounded by the skills in the training data. We present InSight, a framework that unloc…
论文 / 方法
6/22 20:00
Multimodal driving planning faces a long-standing tension between two paradigms: scoring-based methods benefit from dense reward supervision but are confined to a fixed action vocabulary, while anchor…
论文 / 方法
6/22 20:00
Multimodal misinformation detection is increasingly important because viral posts now combine long multilingual narratives, several images, mixed provenance, and subtle text--image framing errors. Exi…
论文 / 方法
6/22 17:58
Following the paradigm shift initiated by OpenAI o3, interleaved reasoning with code to enhance multimodal large language models (MLLMs) has become a pivotal research frontier. The existing literature…
论文 / 方法
6/22 17:31
Personalized content systems depend on available UGC and struggle when suitable content is absent, delayed, or costly to create. Although multimodal generators can synthesize content on demand, how to…
Skill / 资源
6/22 16:32
In this post, we walk through the problem space, our architecture on Amazon Bedrock and Amazon OpenSearch Serverless, the evaluation methodology we built on OpenStreetMap ground tr…
AI 点评 · 多模态AI将航拍图像转化为可搜索数据，实现地理空间信息的规模化智能检索。
行业信号
6/22 10:00
论文 / 方法
6/21 20:00
Scaling reinforcement learning for visual mathematical reasoning requires more than generating harder questions: as data volume grows, the reward labels themselves must remain reliable. Yet existing d…
论文 / 方法
6/21 20:00
ABACUS is a unified vision-language model that handles object counting, crowd counting, referring-expression counting, and count-faithful image generation without any benchmark-specific training requi…
论文 / 方法
6/21 20:00
Vision-language models (VLMs) are increasingly deployed in consumer, medical, financial, and enterprise applications. This broad deployment expands the safety surface: risks can arise from multimodal…
论文 / 方法
6/21 20:00
Representation alignment has emerged as an effective approach to improve Multimodal Large Language Models (MLLMs) by regularizing their internal representations toward those of an external vision enco…
论文 / 方法
6/20 20:00
Vision-Language-Action (VLA) models provide a unified paradigm for robotic manipulation, yet their real-world deployment is often bottlenecked by execution efficiency. While existing efforts predomina…
论文 / 方法
6/20 20:00
Chain-of-Thought (CoT) has become a standard method for improving reasoning capabilities in large language models (LLMs) by eliciting step-by-step thinking, but its effectiveness in multimodal tasks r…
论文 / 方法
6/19 20:00
We present BioMatrix, the first multimodal foundation model that natively integrates sequences, structures, and natural language for both molecules and proteins within a single decoder-only architectu…
设计 / 产品
6/19 12:22
Vision-Language Models on AMD GPUs — LLaVA, MiniGPT-4, Idefics on ROCm 🚀
论文 / 方法
6/18 20:00
Massive unstructured multimodal streams suffer from high "data entropy," impeding both efficient human knowledge acquisition and high-quality AI post-training. Existing passive annotation paradigms, h…
论文 / 方法
6/18 17:39
Multimodal large language models (MLLMs) are increasingly deployed in personally and societally consequential settings, yet the visual cues that shape how these models judge people remain poorly under…
论文 / 方法
6/18 17:38
Multimodal foundation models have advanced rapidly thanks to large optical benchmarks, but comparable resources for synthetic aperture radar (SAR) remain limited. Existing SAR--optical datasets largel…
论文 / 方法
6/17 20:00
Multimodal large language models (MLLMs) are increasingly deployed in personally and societally consequential settings, yet the visual cues that shape how these models judge people remain poorly under…
论文 / 方法
6/17 20:00
Memory remains a critical bottleneck for long-horizon robotic manipulation, as standard Vision-Language-Action (VLA) policies often fail when task-relevant cues become occluded or unobservable over ti…
论文 / 方法
6/17 17:20
Embodied Vision-Language-Action (VLA) models are typically obtained by fine-tuning powerful pretrained VLMs on robotics data, yet it is unclear how much commonsense and factual knowledge they retain a…
设计 / 产品
6/17 05:11
[ECCV 2026] Official Pytorch implementation for See & Sniff: Learning Visuo-Olfactory Representations
模型 / Agent
6/16 23:13
IT之家 6 月 17 日消息，谷歌于当地时间周二正式推送了 Android 17 正式版，同时发布了智能手表操作系统 Wear OS 7。本次新版系统将率先搭载于谷歌自家 Pixel 系列设备，同步上线 Pixel 专属功能更新包，新增多项 AI 相关功能，包括对最新人工智能模型的支持，如音乐生成模型 Lyria 3、多模态大模型 Gemini Omni，…
AI 点评 · AI深度融入系统底层，Android 17标志移动平台正式进入AI原生时代，看点在于其生态影响力。
模型 / Agent
6/16 22:30
NVIDIA XR AI is now available in public beta, giving developers a framework for building multimodal AI agents for AR glasses and XR devices.
AI 点评 · 英伟达XR AI公测，为AR眼镜开发多模态AI代理，推动无手交互新范式。
论文 / 方法
6/16 20:00
On-policy self-distillation (OPSD) trains a model on its own rollouts and uses a frozen copy to provide dense token-level targets conditioned on a reference target. This works well for LLM reasoning,…
论文 / 方法
6/16 20:00
Deploying multimodal foundation models as closed-loop policies increasingly requires conditioning actions on observations that are no longer visible. However, existing benchmarks either expose the ful…
论文 / 方法
6/16 20:00
Multimodal large language models (MLLMs) have achieved remarkable progress in visual understanding tasks. However, most existing MLLMs rely on autoregressive generation, which limits their efficiency…
论文 / 方法
6/16 20:00
Foundation models in language and multimodality achieve strong generalization by aligning heterogeneous data under a unified formulation and training at scale. In this report, we investigate whether t…
论文 / 方法
6/16 20:00
Vision-Language-Action (VLA) models can generalize across diverse manipulation tasks, but their imitation-learning-based policies remain brittle in precise physical interactions due to compounding exe…
论文 / 方法
6/16 20:00
Embodied Vision-Language-Action (VLA) models are typically obtained by fine-tuning powerful pretrained VLMs on robotics data, yet it is unclear how much commonsense and factual knowledge they retain a…
行业信号
6/16 09:44
行业信号
6/15 22:59
IT之家 6 月 16 日消息，招商银行宣布推出一款“运通工程师信用卡”，强调相应信用卡拥有“专属 AI 权益”。 IT之家参考官方介绍获悉，新用户办卡首次参与活动达标后，至高可享每月 18 亿 Token M3 用量，可直接用于文档、图像、音视频等多模态模型调用，以及 MaxClaw 龙虾部署等 AI 高频场景。具体来看，相应信用卡“AI 权益体系”提供三…
AI 点评 · 银行信用卡与AI算力打包，精准切中工程师群体的高频需求，开创了金融+AI的跨界权益新玩法。
论文 / 方法
6/15 20:00
Unified Multimodal Modeling aims to integrate visual understanding and generation within a single system. However, existing approaches typically rely on two disparate visual tokenizers, which splits t…
论文 / 方法
6/15 20:00
Spatial VLMs have made substantial progress in geometric perception, yet complex spatial reasoning requiring multi-step inference over depth, distance, and scene relations remains challenging. Moreove…
论文 / 方法
6/15 20:00
Graphical user interface (GUI) grounding requires vision-language models (VLMs) to identify small target elements in high-resolution screenshots and predict precise screen coordinates. On-policy self-…
论文 / 方法
6/15 20:00
Language models trained on large-scale vision-language data have demonstrated strong potential for embodied agents. Harnessing models through embodied tools use offers a promising alternative to end-t…
论文 / 方法
6/15 20:00
Generalist vision-language-action systems need object-centric 3D evidence and reusable manipulation experience to plan reliable robot trajectories. GeneralVLA provides a hierarchical interface for con…
论文 / 方法
6/15 20:00
While Large Language Models (LLMs) have substantially advanced text-to-code synthesis, many real programming tasks specify intent through visual artifacts such as screenshots, charts, vector drawings,…
论文 / 方法
6/15 17:59
Large language models (LLMs) often fail when answering requires identifying a small but decisive piece of evidence within a long or complex context, such as a single line in a tool trace or a subtle d…
论文 / 方法
6/15 17:49
Remote sensing vision-language models have advanced Earth observation understanding, but most existing work remains centered on RGB imagery, leaving the complementary information in infrared data unde…
论文 / 方法
6/15 17:45
Human interventions provide crucial corrective signals for post-training Vision-Language-Action (VLA) models. However, enabling seamless humanoid interventions is a formidable systems challenge due to…
设计 / 产品
6/15 09:15
The fastest way to put Volcengine Ark in your terminal and your AI agent — go from prompt to generated media, multimodal answer, or deployed endpoint in a sin…
论文 / 方法
6/14 20:00
Generalist robot policies must follow user instructions while reasoning about how objects, cameras, and robot actions interact in the 3D physical world. Recent vision-language-action models (VLAs) and…
论文 / 方法
6/14 20:00
Vision language models are serving as general-purpose interfaces for complex multimodal tasks. However, deployment still faces three gaps: VLMs typically incur high latency and cost when processing de…
论文 / 方法
6/14 20:00
Unified Multimodal Models (UMMs) have emerged as a critical direction for general-purpose multimodal intelligence, integrating understanding and generation into a single framework. However, existing U…
论文 / 方法
6/14 20:00
Vision-Language-Action (VLA) models benefit from large-scale and diverse embodied data, yet scaling robot trajectory collection is costly and labor-intensive. Recent advances show that large-scale ego…
论文 / 方法
6/14 20:00
Large language models (LLMs) often fail when answering requires identifying a small but decisive piece of evidence within a long or complex context, such as a single line in a tool trace or a subtle d…
论文 / 方法
6/14 20:00
Visual thinking should not only sound right; it should show its evidence. While recent vision-language models (VLMs) can produce natural-language reasoning traces, these traces often leave the support…
论文 / 方法
6/14 20:00
Scientific reasoning models for biology combine language models with foundation models trained on multimodal biological data, including DNA, RNA, and proteins. These models are built through post-trai…
设计 / 产品
6/14 13:26
World's fastest and most compact embedded vector database: exact by default, multimodal, local-first, and GPU-accelerated
论文 / 方法
6/14 11:45
Frontier scientific reasoning remains a major challenge for large language models (LLMs), where even the strongest commercial systems fall short of expert-level performance. A closer look at model beh…
论文 / 方法
6/14 08:06
Vision-Language-Action models (VLAs) leverage large-scale vision-language pretraining for semantic robot control, but often lack explicit foresight into how robot actions change the scene. World-Actio…
论文 / 方法
6/13 20:00
Extending a vision-language-action (VLA) policy to a new task typically requires task-specific teleoperated demonstrations and per-task fine-tuning, making adaptation costly in both data collection an…
行业信号
6/13 09:00
设计 / 产品
6/13 06:50
Multimodal foundation model predicting transcriptome-wide virtual spatial transcriptomics from histology.
论文 / 方法
6/12 20:00
Multimodal large language models (MLLMs) have demonstrated impressive capabilities in many visual tasks, but they often struggle with factual grounding when confronted with complex, open-world scenari…
论文 / 方法
6/12 20:00
Generating realistic humanoid motion from scene images and text involves both low-frequency pose semantics and high-frequency physical dynamics. However, many existing methods tokenize motion with a s…
论文 / 方法
6/12 20:00
Robotic systems perceive the world through multiple input modalities -- including visual camera streams and natural language instructions -- and must select appropriate actions based on these signals.…
论文 / 方法
6/12 17:59
How a vision-language model internally solves the task of describing an image is far from obvious. We find that the model develops a specific mechanism for this: a small set of attention heads in its…
论文 / 方法
6/12 17:54
Reinforcement learning with verifiable rewards (RLVR) has successfully elicited the reasoning capabilities of large language models, motivating its extension to multimodal scenarios. Existing methods…
论文 / 方法
6/11 20:00
Large language models (LLMs) are widely used in text-to-image (T2I) systems, but they are typically limited to text encoding, while denoising is handled by newly trained generative backbones. The emer…
论文 / 方法
6/11 20:00
In this report, we present Hy-Embodied-0.5-VLA, abbreviated as HyVLA-0.5, an end-to-end system that spans the full robot learning stack: data collection, model design, continued pre-training and super…
论文 / 方法
6/11 20:00
Building trustworthy medical multimodal large language models (MLLMs) is critical for reliable clinical decision support. Existing medical hallucination benchmarks mainly focus on data collection, but…
模型 / Agent
6/10 20:10
IT之家 6 月 11 日消息，小米 MiMo 官方今日凌晨正式发布并开源 MiMo Code V0.1.0 —— 一款运行在终端里的探索性 AI 编程助手。 据介绍， MiMo Code 基于开源项目 OpenCode 二次开发，发布并开源，采用 MIT 协议 。它还内置限时免费多模态模型 MiMo-V2.5，同时支持接入 DeepSeek、Kimi 和…
AI 点评 · 小米开源AI编程助手，降低开发者门槛，推动生态共建，MIT协议利于广泛商用。
论文 / 方法
6/10 20:00
Multimodal Large Language Models (MLLMs) have shown promising reasoning capabilities in general domains, yet their performance remains limited in specialized settings such as healthcare, especially in…
论文 / 方法
6/10 20:00
Holistic visual tokenizers are fundamental to unified multimodal models (UMMs) as they map diverse visual inputs into a unified representation space. In this paper, we present HYDRA-X, the first UMM t…
论文 / 方法
6/10 20:00
Scientific laboratories increasingly rely on AI systems to reason about experiments, but the physical act of doing science remains largely outside their reach. AI can help read literature, generate hy…
论文 / 方法
6/10 20:00
Spatial reasoning, the ability to determine where objects are, how they relate, and how they move in 3D, remains a fundamental challenge for vision-language models (VLMs). Tool-augmented agents attemp…
论文 / 方法
6/10 20:00
Vision-language models (VLMs) are typically trained as passive answerers, while their ability to actively ask diverse, non-trivial, visual-centric and grounded questions remains underexplored. Existin…
论文 / 方法
6/10 17:58
Vision-Language Models (VLMs) are increasingly deployed as high-level planners for embodied agents, with an emerging strategy of scaling test-time compute to improve capability. However, we observe th…
论文 / 方法
6/10 17:31
We study multimodal learning under missing modalities, with particular motivation from bioscience applications in which heterogeneous modalities are often only partially available when decisions need…
论文 / 方法
6/9 20:00
Vision-language models (VLMs) project images into hundreds to thousands of visual tokens, making decoder inference expensive in both attention computation and KV-cache memory. Existing visual-token re…
论文 / 方法
6/9 20:00
Recent progress in foundation models has shifted toward agentic behavior involving multi-step reasoning and tool use. However, open-source efforts largely focus on text-dominant settings, leaving long…
论文 / 方法
6/9 20:00
Vision-Language-Action (VLA) models inherit semantic grounding from large-scale pretraining and perform competently across in-distribution manipulation tasks. This grounding, however, is built on stat…
论文 / 方法
6/9 20:00
Multimodal image fusion aims to integrate complementary information from different modalities into a fused image that preserves rich local details while maintaining globally consistent appearance. Exi…
论文 / 方法
6/9 20:00
Vision-Language-Action (VLA) models that couple pretrained Vision-Language Models (VLMs) with continuous action experts have achieved strong manipulation performance, yet generalization to out-of-dist…
论文 / 方法
6/9 20:00
Many moments in the real world do not wait for a user to ask. A fire starts on a security monitor, an expression flickers across a video call, or a product a viewer wants flashes by in a livestream. Y…
论文 / 方法
6/9 17:59
Cross-modal alignment (CA) and cross-modal prediction (CP) are the dominant paradigms for multimodal representation learning, yet there is no systematic understanding of when each succeeds, when each…
论文 / 方法
6/9 17:51
Data tells stories that shape society; the data journalist's job is to turn raw information into stories non-experts can trust. A high-quality news feature takes a newsroom team weeks: hunting for con…
模型 / Agent一手源
6/9 14:10
可信度 88交叉信源 1
设计 / 产品
6/9 11:20
Agentic, long-horizon visual generation: a fuzzy story → a cross-model-audited image-based movie. Brings ARIS's research-wiki + multi-agent debate to multimodal…
设计 / 产品
6/9 07:08
[EMNLP 2025] M-LongDoc: A Benchmark For Multimodal Super-Long Document Understanding And A Retrieval-Aware Tuning Framework
论文 / 方法
6/9 04:36
External memory effectively grounds large language models (LLMs) and vision-language models (VLMs)-based question answering (QA) in relevant multimodal evidence. However, existing memory paradigms rep…
论文 / 方法
6/8 20:00
We introduce Kwai Keye-VL-2.0-30B-A3B, an open-source Mixture-of-Experts (MoE) multimodal foundation model designed to advance long-video understanding and agentic intelligence. To address the challen…
论文 / 方法
6/8 20:00
This paper introduces ARM, a discrete representation-based AutoRegressive Model that unifies image understanding, generation, and editing within a next-token prediction framework. ARM is built on thre…
论文 / 方法
6/8 20:00
Multimodal large language models can write code to produce complex programs as well as use programs to do 3D modeling, which opens up a new avenue for 3D generation powered by their priors, world know…
论文 / 方法
6/8 20:00
Data tells stories that shape society; the data journalist's job is to turn raw information into stories non-experts can trust. A high-quality news feature takes a newsroom team weeks: hunting for con…
论文 / 方法
6/8 17:31
Nearby neurons in cortex share similar response profiles, producing systematic spatial organization across sensory and cognitive systems. Recent topographic models reproduce aspects of this structure…
AI 点评 · 利用深度多模态模型揭示大脑功能分区，为理解脑认知机制和AI神经架构提供新视角。
论文 / 方法
6/8 10:58
Chain-of-Thought (CoT) improves the performance of Large Language Models (LLMs) and has been extended to Multimodal Large Language Models (MLLMs). More recent work further moves from text-based multim…
论文 / 方法
6/7 20:00
Vision-language model (VLM) agents are increasingly deployed in interactive game environments. Yet game benchmarks for VLM agents typically report a single first-attempt score per (agent, game) pair,…
论文 / 方法
6/7 20:00
Spatial reasoning is a foundational capability for multimodal large language models (MLLMs) to perceive and operate within the physical world. However, existing benchmarks predominantly rely on passiv…
论文 / 方法
6/7 20:00
Multimodal large language models (MLLMs) commonly inherit the deep, symmetric Transformer backbone designed for unimodal text modeling, and apply the same computation uniformly to image and language t…
论文 / 方法
6/7 20:00
Multimodal Foundation Models (MFMs) have made substantial progress, yet remain fragile in spatial reasoning over the physical world. A key bottleneck lies in their inability to transform local egocent…
设计 / 产品
6/6 22:06
[CVPR 2026] Flow Matching for Multimodal Distributions
论文 / 方法
6/5 20:00
Multimodal Large Language Models (MLLMs) have demonstrated remarkable success in visual understanding, yet their performance degrades significantly under real-world visual corruptions. While existing…
论文 / 方法
6/5 20:00
Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a leading paradigm for enhancing visual reasoning in Multimodal Large Language Models (MLLMs). However, existing RLVR methods optim…
论文 / 方法
6/5 17:59
Current Vision-Language Models struggle with hours-long videos because processing full-length visual sequences induces prohibitive token explosion and attention dilution. To overcome this, we introduc…
AI 点评 · 分层记忆架构破解长视频理解瓶颈，用图记忆与智能检索分离感知推理，显著降低计算成本。
行业信号
6/5 10:53
研究表明，睡眠中的记忆重激活参与调控睡眠动态，为理解“记忆-睡眠”双向作用机制提供了新的实验证据。
论文 / 方法
6/4 20:00
Despite advances in 3D scene understanding, existing 3D Large Multimodal Models operate in offline settings, requiring complete scene observations or predefined video clips. In this paper, we present…
论文 / 方法
6/4 20:00
Video understanding is being rapidly transformed by multimodal large language models (MLLMs), as research moves from short clips to long, multimodal, and knowledge-intensive video scenarios. These sce…
论文 / 方法
6/4 20:00
Discrete Vision-Language-Action (VLA) models typically formulate action generation as next-token prediction over discretized action spaces, conditioning each token autoregressively on prior context. W…
论文 / 方法
6/4 20:00
Vision-Language-Action (VLA) models are emerging as a promising paradigm for robotic manipulation, enabling general-purpose policies trained from large corpora of demonstrations and action labels. How…
论文 / 方法
6/4 20:00
Current Vision-Language Models struggle with hours-long videos because processing full-length visual sequences induces prohibitive token explosion and attention dilution. To overcome this, we introduc…
论文 / 方法
6/4 20:00
Deep research agents have attracted increasing attention for their ability to collect large-scale online information to acquire target knowledge, with recent efforts shifting from purely text-based in…
Skill / 资源
6/4 18:57
AI 点评 · 为企业提供可定制的多模态安全方案，填补全球AI内容合规缺口。
论文 / 方法
6/4 17:59
Robot manipulation alternates between low-risk transit phases that call for fast execution and high-risk contact stages that demand slow, precise motion. Yet existing Vision-Language-Action models (VL…
行业信号
6/4 03:06
甩开视觉内卷
论文 / 方法
6/3 20:00
Multimodal Large Language Models (MLLMs) excel at 2D semantic understanding but lack intrinsic 3D awareness, resulting in representations that fail to maintain geometric and spatial consistency across…
论文 / 方法
6/3 20:00
Vision-Language-Action (VLA) models leverage the rich world knowledge of pretrained vision-language models (VLMs) to enable instruction-following robotic manipulation. However, the structural mismatch…
论文 / 方法
6/3 20:00
Developing unified video generation and editing models capable of interpreting interleaved multimodal inputs is a promising yet challenging frontier field. Existing unified frameworks predominantly re…
论文 / 方法
6/3 20:00
While Vision-Language Models (VLMs) have shown strong visual reasoning capabilities, their spatial reasoning abilities remain largely constrained to the observed images and text-oriented chain-of-thou…
论文 / 方法
6/3 20:00
In real-world applications, models are expected to perform reliably across diverse settings. Yet, many existing multimodal benchmarks expand task types without capturing the visual diversity needed to…
论文 / 方法
6/3 20:00
Despite the rapid progress of Vision-Language Models (VLMs), the field lacks benchmarks that rigorously diagnose their true reasoning abilities and chart meaningful progress toward human-like multimod…
论文 / 方法
6/3 20:00
Generalist robot intelligence is often framed as a policy-scaling problem: collect more robot demonstrations, train larger Vision-Language-Action (VLA) models, and expect broader generalisation. In th…
论文 / 方法
6/3 20:00
Latent visual reasoning (LVR) inserts supervised latent tokens between perception and answer generation in vision-language models (VLMs). The field uses alignment between these latents and their visua…
论文 / 方法
6/3 20:00
Training vision-language web agents with multi-step RL is compute-intensive, with two dominant forms of inefficiency: idle GPUs in synchronous RL, and trajectories that use more steps and tokens than…
论文 / 方法
6/3 20:00
Many modern vision-language models (VLMs) build on autoregressive decoding of discrete tokens. While text-based output interfaces enable scalable pretraining and strong zero-shot generalization across…
设计 / 产品
6/3 14:37
Transparent proxy for Claude Code that auto-routes image-bearing requests to a multimodal model — so a non-multimodal primary model never crashes your long-runn…
行业信号
6/3 04:00
The new ChartNet training dataset could improve the accuracy of vision-language models that help analyze business trends or interpret scientific figures.
设计 / 产品
6/3 03:29
Multimodal document QA: vision + retrieval over PDFs (LLaVA + LlamaIndex)
论文 / 方法
6/2 20:00
Learning representations of CAD models is a largely open problem. While 3D representation learning has flourished around point clouds and meshes, the native format of CAD - boundary representations BR…
论文 / 方法
6/2 20:00
Processing video in vision-language models is expensive: each frame occupies hundreds of tokens, and inference cost scales with every frame and every repeated query. We introduce Video2LoRA, a method…
论文 / 方法
6/2 20:00
Vision language models (VLMs) excel at many tasks but still struggle with spatial reasoning when critical information is not directly observable. Many such problems require imaginative perception: inf…
论文 / 方法
6/2 17:59
Vision language models (VLMs) excel at many tasks but still struggle with spatial reasoning when critical information is not directly observable. Many such problems require imaginative perception: inf…
论文 / 方法
6/2 17:42
As AI systems increasingly assist humans in physical tasks, ensuring safety becomes paramount -- physical actions carry immediate and irreversible consequences that digital errors do not. We introduce…
论文 / 方法
6/2 13:25
Vision-language models (VLMs) have been explored for visual programming, where they generate code to solve visual tasks. However, most prior work focuses on visual programming for productivity; it rem…
论文 / 方法
6/2 13:09
When asked what a meme or sarcastic post means, Large Vision Language Models (LVLMs) tend to describe what the image shows rather than what the author is trying to communicate. Standard instruction tu…
论文 / 方法
6/2 13:07
World models and multimodal large language models (MLLMs) provide complementary capabilities for predicting future outcomes from static visual observations. World models can generate concrete visual r…
行业信号
6/2 10:22
字节跳动多模态负责人周畅管理范围再次扩大，原由李航负责的SeedRobotics团队已向周畅汇报月余，李航现以顾问身份负责学术合作方向。字节也正在招聘具身智能技术负责人，负责机器人业务整体规划，职级定位为L8，对标阿里P10-P11，将向周畅汇报。该岗位候选人主要来自头部具身智能创业公司技术负责人。（晚点 LatePost）
AI 点评 · 架构调整显示字节加速整合资源，具身智能成战略核心，技术负责人招聘透露行业人才争夺升级。
设计 / 产品
6/2 03:15
Qwen3.7-Plus已上线阿里云百炼
AI 点评 · 通杀多模态与桌面软件，AI智能体能力再上台阶，开发者生态迎来新变量。
设计 / 产品
6/1 22:38
IT之家 6 月 2 日消息，阿里千问大模型今天（6 月 2 日）发布博文，宣布推出 Qwen3.7-Plus 模型， 定位为多模态交互混合智能体。 Qwen3.7-Plus 是 Qwen3.7 的多模态升级版，核心定位是视觉与语言统一的智能体基座。 它保留文本、编码、工具使用和生产力工作流能力，同时强化视觉理解、视觉推理和跨模态任务处理。 模型已通过阿里云…
AI 点评 · 多模态与智能体融合，或加速AI从“对话”迈向“行动”的关键一步。
论文 / 方法
6/1 20:00
Understanding a video requires more than recognizing isolated moments, as humans continuously track entities, states, and events over time. This capacity for visual state tracking is fundamental to vi…
论文 / 方法
6/1 20:00
Multimodal agents in robotics, AR, and autonomous driving must reason about places and layouts from continuous egocentric streams, often using evidence outside the current view. Existing benchmarks ei…
论文 / 方法
6/1 20:00
Selection is a core operation in interactive image editing. To be practical, a user should be able to specify and disambiguate the desired selection region through either text or click-based interacti…
论文 / 方法
6/1 20:00
With the increasing development of Vision-Language Models, it becomes imperative that their predictions are readily explainable to relevant stakeholders. However, the field of explainability has not k…
论文 / 方法
6/1 17:59
Recent multimodal large language models have demonstrated strong reasoning ability, yet their reliability as automated evaluators remains limited by a critical weakness: when visual evidence conflicts…
AI 点评 · 用感知扰动与奖励建模，巧妙解决多模态大模型评判时的视觉偏见问题。
论文 / 方法
6/1 17:59
Multimodal Large Language Models (MLLMs) achieve strong performance through instruction tuning, but real-world deployment requires them to continually acquire new vision-language capabilities, making…
AI 点评 · 用原型引导自适应扩展与几何整合，攻克多模态持续学习中灾难性遗忘难题。
论文 / 方法
6/1 17:56
Video is temporally redundant: adjacent frames usually share most objects, background, and layout. Yet existing video multimodal large language models (video MLLMs) usually encode each sampled frame a…
AI 点评 · 提出视频时序冗余新视角，用预测编码压缩帧，有望大幅降低视频多模态模型算力成本。
行业信号
6/1 17:55
AI 点评 · Qwen3.7-Plus融合多模态与智能体能力，或开启AI应用新范式。
论文 / 方法
6/1 17:32
Video multimodal large language models (MLLMs) have made rapid progress on general and long-form video understanding, yet their ability to preserve brief answer-critical visual evidence remains undere…
AI 点评 · 聚焦视频大模型对瞬间视觉事件的判断精度，填补了时序保真度评估空白。
论文 / 方法
6/1 05:50
Abundant procedural knowledge on the Web holds great potential for helping agents solve long-horizon tasks. However, such knowledge is often multimodal, heterogeneous, noisy, and implicitly assumes hu…
模型 / Agent
6/1 03:36
MiniMax M3 今日正式发布。 MiniMax M3 在编程和智能体等专业任务上达到了前沿的能力。它使用了全新注意力架构 MSA （MiniMax Sparse Attention），最高支持 1M 超长上下文。它也是一个原生多模态模型，支持图片和视频的输入，并能操作电脑桌面。 在衡量 Coding 能力的 SWE-Bench Pro 上，MiniMa…
论文 / 方法
5/31 20:00
Inverse graphics is a longstanding and highly underconstrained problem that seeks to reconstruct images as editable 3D scenes which can be rendered, relit, and manipulated. In this work, we investigat…
AI 点评 · 视觉语言模型实现逆向图形从推理到可编辑3D场景，突破传统重建限制。
论文 / 方法
5/31 20:00
Vision-language-action (VLA) models are built on the premise that semantic understanding from pretrained language or vision-language backbones should guide robot action prediction. Yet robot fine-tuni…
AI 点评 · 评估VLA模型语义理解能力的关键基准，揭示机器人动作预测的深层缺陷。
论文 / 方法
5/31 20:00
Instruction tuning aligns large language models, including multimodal ones, with diverse user intents, but scaling to heterogeneous mixtures is hindered by gradient interference and bandwidth-heavy sy…
论文 / 方法
5/31 20:00
Existing autonomous driving datasets have enabled major progress, but fall short in sensor fidelity, map completeness, or geographic diversity. We present KITScenes Multimodal, a European dataset buil…
论文 / 方法
5/31 20:00
Video is temporally redundant: adjacent frames usually share most objects, background, and layout. Yet existing video multimodal large language models (video MLLMs) usually encode each sampled frame a…
论文 / 方法
5/30 20:00
Understanding chart and table images is essential for applying vision-language models (VLMs) to real-world document understanding. While English benchmarks have advanced rapidly, non-English counterpa…
AI 点评 · 日本首个政府白皮书图表问答基准，填补非英语视觉语言模型评估空白，推动多语言文档理解发展。
论文 / 方法
5/29 20:00
Vision-Language Models (VLMs) have shown strong visual understanding and are increasingly deployed in embodied AI systems, where reliable perception under real conditions is essential. However, existi…
AI 点评 · 评测视觉语言模型在物理场景下的抗压能力，填补机器人感知鲁棒性空白。
论文 / 方法
5/29 20:00
Unified multimodal models (UMMs) have emerged as a promising paradigm for general-purpose multimodal intelligence. As they are deployed in real-world applications, effectively updating internal knowle…
论文 / 方法
5/29 17:48
Transformer-based architectures have advanced sequence modeling in language and vision, yet general-purpose representation learning for heterogeneous multivariate time series remains underexplored. We…
AI 点评 · 多模态联合嵌入让传感器数据“开口说话”，突破时间序列通用表征瓶颈。
论文 / 方法
5/29 17:20
Alignment teaches vision-language models (VLMs) to avoid expressing demographic biases, and when gender is clearly visible they largely succeed. Far less is known about ambiguous inputs (a worker in f…
AI 点评 · 揭示视觉语言模型在模糊情境下仍会抑制女性表征，暴露了AI公平性研究的深层盲区。
模型 / Agent
5/29 11:18
AI 点评 · 小模型大突破，3B参数跑赢未知场景，低成本推理潜力巨大。
设计 / 产品
5/29 07:25
The end of web parsing. The beginning of scalable pixel-native search.
AI 点评 · 将网页解析转向像素级原生搜索，为多模态检索开辟全新路径。
论文 / 方法
5/28 20:00
Long-term memory is essential for multimodal agents to build coherent experience, accumulate world knowledge, and achieve continual learning. However, constructing effective memory goes beyond memory…
AI 点评 · 聚焦多模态智能体的长期记忆构建，突破传统记忆局限，实现持续学习与知识积累。
论文 / 方法
5/28 20:00
Video vision-language models (VLMs) are increasingly used in long-horizon and streaming settings, yet most video encoders still rely on spatiotemporal self-attention, causing compute and latency to gr…
AI 点评 · 突破视频模型计算瓶颈，实现线性缩放，为长视频实时理解铺平道路。
论文 / 方法
5/28 20:00
Unified multimodal models (UMMs) aim to handle perception and generation in a single model. Yet existing UMMs still rely on a frozen, separately pretrained VAE for image generation, imposing a structu…
AI 点评 · 打破多模态模型依赖预训练VAE的瓶颈，实现真正统一感知与生成，是迈向高效AI的关键一步。
论文 / 方法
5/28 20:00
Vision-Language-Action (VLA) models enable robots to follow natural language instructions and generalize across diverse tasks, but they remain vulnerable to execution failures that compromise reliabil…
AI 点评 · 提出轨迹捉迷藏方法，主动发现VLA模型运行时的隐藏故障信号，提升机器人可靠性。
论文 / 方法
5/28 20:00
While visually grounded Chain-of-Thought (CoT) has emerged as a promising paradigm to enhance fine-grained perception in multimodal large language models (MLLMs), its efficacy during the inference pha…
AI 点评 · 用强化学习让AI内化视觉推理能力，突破多模态模型推理阶段的瓶颈。
论文 / 方法
5/28 20:00
Humans easily determine which color belongs to which shape in multi-object scenes, an ability known as concept binding. Vision-language embedding models such as CLIP struggle with binding: they recogn…
论文 / 方法
5/28 20:00
Multimodal large language models (MLLMs) have shown strong capabilities in perception, reasoning, and action generation. However, their ability to sustain exploration in dynamic open worlds remains un…
AI 点评 · 首个用《我的世界》评估多模态大模型开放世界探索能力的基准，填补了该领域测试空白。
论文 / 方法
5/28 20:00
While current multimodal models are proficient at open-ended visual editing, executing precise single-answer edits remains an important obstacle. To probe this challenge, we introduce PaintBench, a dy…
论文 / 方法
5/28 20:00
Humans can effortlessly perceive spatial layouts, form cognitive representations, reason about spatial relations, and translate such reasoning into actions in everyday 3D environments. Although recent…
论文 / 方法
5/28 20:00
Multimodal Large Language Models (MLLMs) have demonstrated significant achievements in general visual question answering (VQA) tasks. However, they remain brittle on mechanical engineering drawings, w…
设计 / 产品
5/28 01:46
Official Model Studio CLI（阿里云百炼 CLI）built for AI Agent frameworks, exposing models, search, multimodal, and workflow capabilities as structured tool calls.
论文 / 方法
5/27 20:00
Vision Language Models (VLMs) enable a unified model to solve various vision tasks through prompting. They have shown promising performance in semantic understanding. However, 3D understanding still l…
AI 点评 · 打破视觉语言模型对3D理解的局限，开启原生3D学习新范式。
论文 / 方法
5/27 20:00
Vision-language models (VLMs) achieve strong performance on spatial reasoning benchmarks, yet it remains unclear whether this reflects structured 3D understanding or reliance on statistical shortcuts…
AI 点评 · 研究揭示视觉语言模型空间推理的盲点，质疑其是否真正具备三维理解能力，对AI可靠性提出关键挑战。
论文 / 方法
5/27 20:00
Recent advances in Vision-Language Models (VLMs) have achieved impressive performance across many tasks, yet prior studies report unsatisfactory performance when applying large language or multimodal…
AI 点评 · 轻量模型攻克时序异常检测，突破大模型效率瓶颈，实用价值显著。
论文 / 方法
5/27 20:00
Spatial reasoning is a fundamental capability for vision-language models (VLMs) deployed in real-world environments. However, visual observations are inherently limited representations of a 3D world:…
AI 点评 · 指出VLMs在空间问答中的盲区与自信误判，揭示视觉语言模型认知边界的关键缺陷。
论文 / 方法
5/27 20:00
Recent work has begun to equip vision-language-action (VLA) policies with explicit intermediate reasoning. In embodied control, however, textual chain-of-thought is a poor fit: irrelevant or weakly te…
论文 / 方法
5/27 20:00
Large Vision-Language Models (LVLMs) map visual inputs into dense token sequences, imposing a quadratic computational bottleneck for inference. Elastic visual-token compression addresses this by train…
AI 点评 · 高效压缩视觉令牌，缓解推理计算瓶颈，加速视觉语言模型落地。
论文 / 方法
5/27 20:00
We present Stable-Layers, a reinforcement learning framework that eliminates the need for paired supervision by fine-tuning a pretrained layer decomposition model using only feedback from a vision-lan…
论文 / 方法
5/27 20:00
Music recommendation systems typically treat songs as opaque tokens, relying on collaborative interaction histories which overlooks semantic or acoustic content. Prior work has explored LLM-augmented,…
论文 / 方法
5/26 20:00
Spatial intelligence requires visual representations that capture both semantic objects and geometric structure in the physical world. To support this, two major pre-training schemes are now widely us…
AI 点评 · 对比视觉语言与视频生成模型，揭示哪种预训练范式更利于空间智能发展。
论文 / 方法
5/25 20:00
Recent advances in multimodal web agents often rely on increased inference-time computation, including rollout search, verifier passes, offline skill discovery, and specialist model stacks. This raise…
设计 / 产品
5/23 17:13
Gamepad-Guided Multimodal Demonstration Capture for UR5 Manipulation
论文 / 方法
5/22 20:00
Physical AI systems increasingly map multimodal observations, language instructions, and learned world representations into physically consequential actions. Robotics foundation models, vision-languag…
AI 点评 · 聚焦物理AI安全盲区，系统梳理运行时动作授权机制，为自主系统风险防控提供关键学术支撑。
论文 / 方法
5/21 20:00
Vision-Language Models (VLMs) are increasingly deployed in embodied environments, where they need produce numerical outputs such as action magnitudes and spatial coordinates. Although these numbers ap…
设计 / 产品
5/21 11:14
Reverse-engineered Doubao (豆包) API → OpenAI-compatible REST service. Free multimodal chat, image/video/music generation, and file hosting for AI agents.
AI 点评 · 逆向工程将豆包API转为OpenAI兼容接口，免费提供多模态功能，大幅降低AI开发门槛。
论文 / 方法
5/20 20:00
We introduce EMMA, a physics-informed multimodal framework that recovers all identifiable dynamical parameters of a system directly from raw video, audio, and image-based time-series observations. Unl…
论文 / 方法
5/19 20:00
The emergence of Large Vision-Language Models (LVLMs) has significantly advanced video understanding capabilities. However, existing benchmarks focus predominantly on coarse-grained tasks such as acti…
设计 / 产品
5/19 03:58
[ICML 2026] Alleviating Prompt Forgetting in Multimodal Diffusion Transformers
AI 点评 · 用强化学习缓解多模态扩散模型的提示遗忘，为提升AI生成质量开辟新路径。
论文 / 方法
5/15 20:00
This paper addresses the challenge of integrating 3D meshes as a native modality within Multimodal Large Language Models (MLLMs). Diffusion-based large reconstruction models decouple semantic understa…
AI 点评 · 统一3D理解与生成，Mixture-of-Transformers架构突破模态融合瓶颈，推动多模态大
设计 / 产品
5/13 07:17
Local-first multimodal epistemic memory for scene-level video, audio, and text intelligence.
设计 / 产品
5/7 13:28
A question-conditioned, reasoning-aware image editor designed to serve as a decoupled visual reasoning assistant for Multimodal Large Language Models (MLLMs).
AI 点评 · 将推理能力融入图像编辑，为多模态大模型提供解耦式视觉助手，拓展了AI交互边界。
设计 / 产品
5/3 13:37
A full-modal personal knowledge base built on the Karpathy LLM Wiki concept.
设计 / 产品
5/3 11:04
🔍 OpenSearch-VL provides a fully open recipe for training strong multimodal deep search agents through high-quality data curation, diverse visual/search tools,…
模型 / Agent
4/28 15:58
AI 点评 · 英伟达新模型统一处理文档、音频、视频，突破长上下文多模态智能，将驱动下一代AI Agent应用。
模型 / Agent一手源
6/26 14:00
QWEN CHAT DISCORD Introduction The evolution of multimodal large models is continually pushing the boundaries of what we believe technology can achieve. From the initial QwenVL to…
可信度 88交叉信源 1
Skill / 资源
6/4 14:00
"In projecting language back as the model for thought, we lose sight of the tacit embodied understanding that undergirds our intelligence." –Terry Winograd The recent successes of…
AI 点评 · 挑战语言中心主义，揭示具身认知对通用智能的核心价值，重塑AI发展路径。
可信度 74交叉信源 1
论文 / 方法
4/8 10:30
PLAID is a multimodal generative model that simultaneously generates protein 1D sequence and 3D structure, by learning the latent space of protein folding models. The awarding of t…
AI 点评 · 将蛋白质折叠模型与潜扩散结合，实现序列与结构同步生成，为AI药物设计开辟新路径。
模型 / Agent一手源
4/5 07:00
The Llama 4 herd: The beginning of a new era of natively multimodal AI innovation AI at Meta
模型 / Agent一手源
4/5 07:00
The Llama 4 herd: The beginning of a new era of natively multimodal AI innovation ai.meta.com
模型 / Agent一手源
3/26 16:00
QWEN CHAT HUGGING FACE MODELSCOPE DASHSCOPE GITHUB PAPER DEMO DISCORD We release Qwen2.5-Omni, the new flagship end-to-end multimodal model in the Qwen series. Designed for compreh…
可信度 88交叉信源 1
模型 / Agent一手源
1/26 11:08
QWEN CHAT GITHUB HUGGING FACE MODELSCOPE DISCORD We release Qwen2.5-VL, the new flagship vision-language model of Qwen and also a significant leap from the previous Qwen2-VL. To tr…
可信度 88交叉信源 1
模型 / Agent一手源
12/12 08:00
Multimodal generative AI systems AI at Meta