Products Agents→Official→RunPod Blog
RunPod has introduced a new Faster-Whisper serverless endpoint that delivers 2-4x faster transcription speeds compared to the original Whisper API, at a significantly lower cost. The service is aimed at improving efficiency and affordability for speech transcription tasks.
Why it matters: This development makes high-speed, cost-effective speech transcription more accessible for developers and enterprises relying on audio processing.
Jul 11, 2026
Products Agents→Official→Together AI Blog
Together AI has introduced Voice Finder, a tool that enables developers to search, filter, and audition over 600 voices using natural-language prompts or uploaded audio samples. The tool supports multiple Together AI TTS models and is designed to simplify the process of selecting synthetic voices for applications.
Why it matters: This tool streamlines the process of finding the right synthetic voice, reducing development time for voice-enabled apps.
Jul 11, 2026
Open Source→Official→RunPod Blog
RunPod published a step-by-step guide for high-speed video upscaling using VSGAN and TensorRT. The guide details model conversion, engine building, and efficient upscaling on RunPod infrastructure.
Why it matters: This guide helps developers leverage TensorRT acceleration for faster video upscaling, improving efficiency in AI-powered video processing workflows.
Jul 11, 2026
Models→Official→RunPod Blog
Stable Diffusion 3.5 has been released, offering a significant improvement in image quality, including photorealistic outputs from minimal prompts. The update addresses previous flaws and enhances ease of use.
Why it matters: This release marks a notable advancement in AI image generation, making high-quality photorealism more accessible with simpler prompts.
Jul 11, 2026
Infrastructure→Official→Lambda Blog
Lambda has unboxed one of NVIDIA's first co-packaged optics switches, the Quantum-X InfiniBand Photonics Q3450-LD. The company notes that at 800G and GB300 NVL72 scale, the back-end fabric accounts for 86% of networking power in a three-layer cluster, and highlights the potential of co-packaged optics (CPO) to address power and reliability challenges in large-scale AI clusters.
Why it matters: Co-packaged optics could help reduce networking power and improve reliability in large GPU clusters as workloads generate more east-west traffic.
Jul 11, 2026
Open Source→Official→RunPod Blog
RunPod has released a step-by-step guide for deploying Meta's open-source Llama 3.1 405B model using Ollama on its platform. The guide aims to simplify the deployment process for users interested in running large language models.
Why it matters: This guide makes it easier for users to deploy one of the largest open-source language models, expanding access to advanced AI tools.
Jul 11, 2026
Products Agents→Official→RunPod Blog
RunPod has introduced Overdrive, a new optimization tool designed to improve the efficiency of AI inference workloads. The tool aims to help users get more performance out of their existing model deployments.
Why it matters: This tool could reduce inference costs and latency for developers running AI models on RunPod's infrastructure.
Jul 11, 2026
Models→Official→Together AI Blog
Together AI introduces Parcae, a stable looped language model that matches the quality of a Transformer twice its size, with a 770M model achieving 1.3B-level performance. The company also presents the first scaling laws for looping, showing that increasing recurrence is a compute-efficient way to improve performance.
Why it matters: This approach could enable more efficient AI models that deliver higher performance with fewer parameters, potentially reducing computational costs and energy consumption.
Jul 11, 2026
Models→Official→Together AI Blog
Together AI has released the Wan 2.7 video model suite, featuring four models designed for video generation, continuation, reference-driven workflows, and editing. The rollout begins with text-to-video capabilities.
Why it matters: This release broadens the range of accessible video AI tools for developers, supporting multiple workflows on a single platform.
Jul 11, 2026
Products Agents→Official→Together AI Blog
Together AI has integrated Deepgram's production-grade speech-to-text and text-to-speech models into its Dedicated Model Inference platform. This allows developers to build real-time voice agents using Deepgram's Nova-2 and other voice models on Together AI's infrastructure.
Why it matters: The integration streamlines the development of real-time voice AI agents by combining advanced speech models with scalable inference infrastructure.
Jul 11, 2026
Research→Official→Together AI Blog
Together AI's kernel research team develops high-performance GPU kernels such as FlashAttention and ThunderKittens to bridge the gap between hardware and production AI. The team focuses on optimizing low-level operations to improve efficiency and speed for AI workloads.
Why it matters: This work directly impacts the performance and cost of running large-scale AI models by making GPU utilization more efficient.
Jul 11, 2026
Open Source→Official→Together AI Blog
Together AI has introduced Aurora, an open-source reinforcement learning framework that transforms speculative decoding into a self-improving system. Aurora learns from every request it serves and achieves a 1.25x speedup over a well-trained static speculator.
Why it matters: Aurora enables LLM inference to continuously improve without manual retuning, potentially reducing latency and cost in production.
Jul 11, 2026
Products Agents→Official→GitHub / AI
GitHub has announced Squad, a feature that enables coordinated AI agents to operate directly within repositories using GitHub Copilot. The design emphasizes inspectable, predictable, and collaborative multi-agent workflows, representing a move toward repository-native orchestration for AI agents.
Why it matters: Squad brings multi-agent AI workflows directly into the development environment, making them more transparent and collaborative, which could change how teams automate and manage complex coding tasks.
Jul 11, 2026
Products Agents→Official→Together AI Blog
Together AI has announced a new platform for building real-time voice agents, featuring co-located speech-to-text, large language model, and text-to-speech infrastructure. The system achieves end-to-end latency under 500ms and natively supports Deepgram and Cartesia.
Why it matters: This enables developers to build responsive voice agents with low latency, improving user experience in conversational AI applications.
Jul 11, 2026
Models→Official→Together AI Blog
Together AI has expanded its fine-tuning service to include support for tool calling, reasoning, and vision-language models. The update also enables training of models with over 100 billion parameters, offers up to 6× higher throughput, and provides job cost and ETA estimates.
Why it matters: This update broadens the capabilities of Together AI's fine-tuning platform, enabling developers to customize advanced models for complex tasks involving function calling, reasoning, and multimodal inputs.
Jul 11, 2026
Models→Official→Together AI Blog
Together AI has announced Mamba-3, a state space model (SSM) designed for efficient inference. According to the company, Mamba-3 is faster than Transformers at decode, stronger than its predecessor Mamba-2, and is available as open-source.
Why it matters: Mamba-3 highlights ongoing advancements in state space models as potential alternatives to Transformers for language model inference.
Jul 11, 2026
Products Agents→Official→Together AI Blog
Together AI announced new launches in inference, agents, voice AI, and open models at NVIDIA GTC 2026. The company also hosted technical sessions led by its research and engineering leaders.
Why it matters: These launches expand Together AI's platform with new capabilities, highlighting ongoing innovation in the AI infrastructure sector.
Jul 11, 2026
Research→Official→Together AI Blog
Together AI has announced FlashAttention-4, a new kernel design that addresses asymmetric hardware scaling by introducing pipelining for maximum overlap, 2-CTA MMA modes to reduce shared memory traffic, and a hardware-software hybrid approach to softmax exponentials. The technique aims to keep pace with GPU throughput outpacing memory bandwidth.
Why it matters: FlashAttention-4 could significantly improve the efficiency of attention mechanisms in large language models, enabling faster training and inference as hardware continues to evolve.
Jul 11, 2026
Models→Official→Together AI Blog
At the AI Native Conf, Together AI announced FlashAttention-4, ThunderAgent, and together.compile, highlighting advancements in kernels, reinforcement learning, and inference optimization. The company stated that these research developments are being deployed directly to production on its AI Native Cloud.
Why it matters: These announcements demonstrate ongoing innovation in AI infrastructure, with Together AI moving new research into production environments.
Jul 11, 2026
Infrastructure→Official→Together AI Blog
Together AI introduced Cache-aware Prefill–Decode Disaggregation (CPD), a new inference architecture that separates warm and cold workloads. The approach delivers up to 40% higher throughput and significantly reduces time-to-first-token for long-context LLM serving.
Why it matters: This technique addresses a key bottleneck in serving long prompts, enabling faster responses for applications like document analysis and code generation.
Jul 11, 2026