Nvidia has released Nemotron 3 Nano Omni, a 30-billion-parameter multimodal model that integrates text, vision, and speech ...

Microsoft Corp. today expanded its Phi line of open-source language models with two new algorithms optimized for multimodal processing and hardware efficiency. The first addition is the text-only ...

AnyGPT is an innovative multimodal large language model (LLM) is capable of understanding and generating content across various data types, including speech, text, images, and music. This model is ...

An upcoming May 14 panel will expand on SXSW 2024 discussions about multimodal AI in storytelling, focusing on practical workflows that integrate text, audio, and video generation. Experts see ...

French AI startup Mistral has dropped its first multimodal model, Pixtral 12B, capable of processing both images and text. The 12-billion-parameter model, built on Mistral’s existing text-based model ...

Microsoft has introduced a new AI model that, it says, can process speech, vision, and text locally on-device using less compute capacity than previous models. Innovation in generative artificial ...

So, as announced by Microsoft, GPT-4 is "multimodal" – capable of processing other media as well as just text. But while Microsoft speaks of potential video and audio use cases, OpenAI has limited GPT ...