免费国产自久久久久三四区久久_久久99性xxx老妇胖精品_欧美女女_老司机深夜福利网站_91影视免费版在线看_91九色porny首页最多播放

position: EnglishChannel  > AI ripples> Chinese AI Model Emu3 Handles Text, Image, Video Seamlessly

Chinese AI Model Emu3 Handles Text, Image, Video Seamlessly

Source: Science and Technology Daily | 2024-12-17 15:44:35 | Author: Gong Qian

On October 21, the Beijing Academy of Artificial Intelligence (BAAI), a Chinese non-profit organization engaged in AI R&D, released Emu3, a multimodal AI model that seamlessly integrates text, image, and video modalities into a single, unified framework.

The BAAI research team said Emu3 is expected to be used in scenario applications such as robot brains, autonomous driving, multimodal dialogue and inference.

Emu3, based solely on next-token prediction, proves that next-token prediction can be a powerful paradigm for multimodal models.

The existing multimodal AI models are mostly designed for specific tasks. Each has its corresponding architecture and methods. For instance, in the field of video generation, many developers use the diffusion in time (DiT) architecture, as referenced by Sora. Other models such as Stable Diffusion are used for text-to-image synthesis, Sora for text-to-video conversion, and GPT-4V for image-to-text generation.

In contrast to these models, which have a combination of isolated skills rather than an inherently unified ability, Emu3, eliminates the need for diffusion or compositional approaches. By tokenizing images, text, and videos into a discrete space, BAAI has developed a single transformer from scratch.

Emu3 outperforms several well-established task-specific models in both generation and perception tasks, surpassing flagship models such as SDXL and LLaVA.

In September, BAAI open-sourced the key technologies and models of Emu3 including the chat model and generation model after supervised fine-tuning.

Emu3 has been receiving rave reviews from overseas developers. "For researchers, a new opportunity has emerged to explore multimodality through a unified architecture, eliminating the need to combine complex diffusion models with large language models. This approach is akin to the transformative impact of transformers in vision-related tasks," AI consultant Muhammad Umair said on social media platform Meta.

While next-token prediction is considered a promising path towards artificial general intelligence, it struggled to excel in multimodal tasks, which were dominated by diffusion models such as Stable Diffusion and compositional approaches like CLIP combined with large language models.

Raphael Mansuy, co-founder of QuantaLogic, an AI agent platform, thinks that Em3 has significant implications for Al development. Mansuy wrote on X that Em3's success suggests several key insights: Next-token prediction as a viable path to general multimodal Al; potential for simplified and more scalable model architectures; challenge to the dominance of diffusion and compositional approaches.

Editor:GONG Qian

Top News

Forging a Resilient Economy with Sci-tech Power

Tiangong Ultra, developed by the Beijing Humanoid Robot Innovation Center, won the world's first half-marathon for humanoid robots in Beijing on April 19, demonstrating the prospects of China's humanoid robot industry and the epitome of the country's strategic emerging industries and future industries. These industries are surging ahead, facilitating the construction of a resilient economy with sci-tech force.

抱歉,您使用的瀏覽器版本過低或開啟了瀏覽器兼容模式,這會影響您正常瀏覽本網頁

您可以進行以下操作:

1.將瀏覽器切換回極速模式

2.點擊下面圖標升級或更換您的瀏覽器

3.暫不升級,繼續瀏覽

繼續瀏覽
主站蜘蛛池模板: 大伊香蕉精品视频在线 | 啊轻点内射在线视频 | 2021少妇久久久久久久久久 | 免费无码国产国模线观看 | 久久久一 | 国产日韩欧美不卡在线观看 | 2024国产精品自拍 | 日日狠狠久久8888偷偷色 | 伊人久久婷婷综合五月97色 | 毛片区 | 一级毛片在线免费观看视频 | 东方800av| 18video性欧美19sex | 免费一二三区 | 99日韩精品视频 | 无码精品每日更新精品久久久 | 2018天天干夜夜操 | 一区二区三区四区在线播放 | BBBBB女女女女女BBBBB国产 | 国产精品午夜一区二区欲梦 | 久久婷婷丁香五月综合五 | 色柚视频网站ww色 | beautyleg论坛| 久久99蜜桃综合影院免费观看 | 亚洲国产的精品太乱码一区二区 | 在线观看福利小视频 | 国产精品久久国产精品久久 | 国产精品亚洲第一区二区三区 | 亚洲网在线观看 | 精品毛片一区二区三区 | 国产免费黄片和v片 | 成人做爰视频 | 日日鲁鲁夜夜狼狼视频 | 成人日韩一区在线 | 亚洲女孩中文字幕免费视频 | 久久久久青草线蕉亚洲 | 亚州少妇无套内射激情视频 | 欧美a级淫片 | 色一欲一性一乱—区二区三区 | 久久国产成人免费视频 | 日韩亚洲av综合 |