Researchers from NTU, SJTU, and UTokyo propose UMM-Reflection, enabling unified multimodal models to self-correct generated images through native reflection and reinforcement learning, achieving 64.9% repair success (up from 20.6%) and GenEval 0.84 (from 0.72) without external verifiers at inference.
A new paper from Tsinghua and Zhipu AI introduces Knowledge Transfer Probing (KTP) to test if unified multimodal models can use knowledge learned from image generation for text QA, revealing a significant gap; interleaved image-text alignment training and visual chain-of-thought reasoning substantially improve text QA accuracy across BAGEL, SenseNova-U1, and GLM-Omni, though a gap persists.
SenseNova-U1.5 introduces an 8B MoT unified multimodal architecture that natively integrates understanding, generation, and editing via spatial joint reconstruction and a staged training strategy, achieving state-of-the-art results on Qwen-Image-Bench, GenEval, CVTG-2K, ImgEdit, and OpenING while maintaining strong language understanding.
TransVAE merges early‑stage CNN local feature extraction with deep‑layer Transformer global reasoning, uses RoPE‑only positional encoding and ConvFFN to enable resolution‑agnostic scaling, and demonstrates stable improvements in reconstruction quality, latent alignment, and downstream generation across model sizes from 44 M to 2.3 B parameters.
A mysterious image‑generation model called mona‑lisa‑1 appeared on the Arena platform, prompting users to compare it with GPT Image 2, uncovering improved texture and reduced "plastic" skin but also lingering noise, outdated knowledge, and occasional text artifacts.
Self‑Swap Guidance (SSG) introduces a lightweight, text‑free, noise‑free diffusion model guidance that swaps the most dissimilar token pairs in spatial and channel dimensions during inference, creating structural perturbations that improve image quality and robustness, outperforming existing unconditional guidance methods across multiple benchmarks.
The paper introduces Parallel Rollout Approximation (PRA), a pixel‑space autoregressive image generation approach that eliminates visual tokenizers, reduces high‑dimensional prediction difficulty with a low‑dimensional intermediate state, and uses parallel rollout approximation to mitigate training‑inference mismatch, achieving FID 2.58 with 135 M parameters—outperforming a 1.9 B‑parameter baseline—and demonstrating strong visual representation learning.
The article details how GenericAgent autonomously reads messages from 31 WeChat groups, extracts and cleans 79 posts, uses a large language model to summarize topics, reverse‑engineers an undocumented image API, and generates a stylized daily report poster without any human intervention.
GenEvolve introduces a self‑evolving image‑generation agent that orchestrates search, reference retrieval, and knowledge‑query tools into a prompt‑reference program, training via teacher‑student SFT and visual‑experience self‑distillation to achieve higher KScore on open‑source and strong generators.
GenEvolve, an open-source self-evolving image-generation agent, orchestrates search, image retrieval, and knowledge tools into a prompt-reference program, handling knowledge-anchored and quality-anchored tasks; experiments show it outperforms baseline generators on both standard and strong renderers, with open data and code released.
The ICML 2026 spotlight paper argues that universal aesthetic alignment in image‑generation models narrows artistic expression, presents six interrelated concerns, and demonstrates through extensive prompts and benchmark tests that reward models and aligned generators stubbornly favor homogenized, overly positive imagery while failing to honor anti‑aesthetic or negative‑emotion requests.
The author walks through integrating Agnes AI's free text, image, and video models with Claude Code via CC Switch, details each setup step, runs real‑world tasks such as codebase analysis, webpage generation, diagram creation, and short‑video production, and evaluates the models' capabilities and limitations.
Vision Banana shows that large‑scale image‑generation models can be instruction‑tuned to perform zero‑shot visual‑understanding tasks such as semantic segmentation, instance segmentation, depth and normal estimation, achieving or surpassing specialist SOTA results while preserving their original generative capabilities.
A recent investigation shows that when given a deceptive prompt asking it to "restore" a non‑existent photo, ChatGPT produces surreal, sometimes disturbing images, revealing a jailbreak‑style vulnerability and highlighting safety‑check trade‑offs.
This guide explains how to unlock GPT‑Image‑2’s four advanced capabilities—multi‑round iteration, natural‑language local editing, multi‑image generation, and reference‑image mode—by showing concrete prompts, code snippets, best‑practice formulas, performance data, and common pitfalls to avoid.
This article provides ready‑to‑copy AI prompt templates for four common visual scenarios—social‑media cover images, e‑commerce product main images, marketing posters, and logos—detailing dimensions, style guidelines, and specific element descriptions so you can generate appropriate graphics instantly.
The article breaks down five practical GPT‑Image‑2 prompts for e‑commerce graphics, explains the underlying four‑step structure—scenario, protagonist, material, typography and constraints—and provides reusable templates that turn raw style words into commercially viable visual assets.
Microsoft’s Lens team shows that a 3.8 B‑parameter image‑generation model can match or surpass 6 B‑plus models while consuming only about 19 % of the GPU compute, thanks to aggressive model compression, dense captioning, mixed‑resolution training, optimized VAE and language encoders, and targeted RL fine‑tuning.
The article examines JD’s Oxygen Vision AI solution for cross‑border e‑commerce, detailing how automated product‑image set generation tackles high costs, slow turnaround, multilingual and platform compliance challenges, delivers up to 90% time and cost reductions, and outlines future multimodal, personalization, and ecosystem expansions.
Flow‑OPD introduces on‑policy distillation into flow‑matching diffusion models, using a multi‑teacher online rollout framework and manifold‑anchor regularization to resolve the seesaw effect of single and mixed rewards, achieving superior multi‑task performance and surpassing specialist models in image generation.
Lance, ByteDance’s newly open‑sourced 3‑billion‑parameter multimodal model, runs on a single 40 GB GPU, tops HuggingFace trend charts, and achieves leading scores on DPG Bench, GenEval, and video generation benchmarks while surpassing several state‑of‑the‑art single‑modal models.
The RAEv2 framework replaces traditional VAEs by summing multiple layers of pretrained vision encoders, combines RAE with REPA for complementary semantic and spatial gains, and leverages free guidance, achieving up to ten‑fold faster convergence, higher image quality, and lower compute on ImageNet‑256 diffusion training.
The article details how JD’s Oxygen Vision leverages AI to overhaul cross‑border product visual creation, cutting SKU image‑generation cost and time by over 90%, automating multi‑platform compliance, multilingual localization, and high‑quality output through a three‑step workflow.
This article introduces two open‑source projects—beautiful‑html‑templates, which lets an AI generate complete HTML slide decks from plain instructions, and ian‑handdrawn‑ppt, which converts articles or outlines into a series of Chinese hand‑drawn style technical illustration images—detailing their features, usage steps, target users, and limitations.
Luma released the Uni‑1.1 image‑generation API, which ranks third on the Arena blind‑test leaderboard, offers sub‑half‑price per image, and demonstrates production‑grade capabilities such as multi‑reference fusion, multi‑turn editing, and a decoder‑only transformer that jointly models text and image tokens.
Open Generative AI is an open‑source, MIT‑licensed desktop suite that bundles over 200 cutting‑edge image, video, and lip‑sync models into four dedicated studios, offering unrestricted generation without content filters, subscription fees, or closed ecosystems, and provides online, desktop, and self‑hosted deployment options.
MacTok introduces semantic masking and dual‑space alignment to prevent posterior collapse in continuous image tokenizers, enabling high‑quality generation with just 64‑128 tokens and achieving strong gFID scores on ImageNet at 256×256 and 512×512 resolutions.
DeepMind’s Vision Banana model demonstrates that large‑scale image‑generation pre‑training can produce powerful, universal visual representations, achieving state‑of‑the‑art results on segmentation, depth, and normal estimation without task‑specific heads, thereby supporting the hypothesis that generation and understanding are fundamentally linked.
The article provides a comprehensive technical analysis of OpenAI's ChatGPT Images 2.0 (gpt‑image‑2), detailing its strategic launch, new autoregressive architecture, integrated reasoning and web‑search capabilities, multi‑image consistency, pricing model, competitive landscape, limitations, and future impact on visual AI workflows.
From the rapid rise of prompt‑engineering in 2025‑2026, this article reviews seven standout open‑source GitHub repositories—covering Nano Banana Pro, GPT‑Image‑2, multi‑model prompts, and video generation—detailing their stars, content structure, multilingual support, and ideal use cases for creators.
OpenAI’s newly released ChatGPT Images 2.0 transforms image generation into a full‑featured visual design system, delivering 2K resolution, multilingual text rendering, complex layout handling, and up to eight concurrent images, while also exposing current physical limits such as intricate spatial puzzles.
OpenAI's newly released ChatGPT Images 2.0 (GPT‑Image‑2) lets users generate photorealistic screenshots, posters, and even homework from ultra‑short prompts, outperforms the previous Nano Banana model, supports 2K resolution, multi‑language input, and is already available via API with pricing details.
MNN‑Sana‑Edit‑V2, a collaborative effort between Taobao’s Meta team and Hangzhou University, combines a frozen Qwen3‑0.6B LLM, Learnable Query, Connector, Linear DiT and Deep Compression Autoencoder with 4/8‑bit quantization to run fully on mobile devices, delivering 512×512 comic‑style conversions in about 15 seconds—2.5× faster than cloud alternatives—while providing open‑source code, detailed training stages, and extensive performance benchmarks.
OpenAI’s new gpt-image-2 model improves dense Chinese text rendering, follows detailed prompts more reliably, and offers precise edit capabilities, making it suitable for real‑world business graphics such as posters, banners, and dashboards, and the article shows how to integrate it with Spring AI in Java.
A rapid roundup of today’s AI news shows the industry moving beyond marginal model gains toward lower cost and latency, agents entering task and browser workflows, redesign of the design‑code gap, 3D/web expansion, and open‑source tools reaching smaller teams.
AdaGen replaces handcrafted static schedules in multi‑step image generators with a universal, learnable policy network trained via reinforcement learning, using an MDP formulation, adversarial rewards and action smoothing, achieving consistent quality and efficiency gains across diffusion, autoregressive, mask and flow models while adding negligible overhead.
TC‑Padé uses a Padé‑based residual prediction framework, step‑aware strategies, and a trajectory‑stability indicator to accelerate diffusion sampling to as few as 20 steps while preserving visual fidelity, achieving up to 2.88× speed‑up on image generation and 1.72× on video generation.
The TDM‑R1 framework introduces a two‑stage reinforcement learning pipeline that lets 4‑step diffusion models achieve a GenEval score of 92%, surpassing 80‑step baselines and GPT‑4o while also fixing instruction compliance, text rendering, and compositional generation issues.
A leaked GPT-Image-2 model, tested under codenames like maskingtape-alpha, shows dramatically improved text rendering, world‑knowledge understanding and image editing that many claim surpasses Google’s Nano Banana Pro, prompting a perceived paradigm shift in multimodal AI generation.
The article presents the GEMS (Agent‑Native Multimodal Generation with Memory and Skills) framework, detailing its multi‑agent loop, hierarchical memory compression, on‑demand skill modules, and extensive benchmark results that show a lightweight 6B model surpassing larger proprietary systems on complex image‑generation tasks.
This article introduces C²FG, a training‑free, plug‑and‑play time‑adaptive exponential control function that replaces the fixed classifier‑free guidance scale, theoretically justifies its superiority with score discrepancy bounds, and demonstrates significant FID and IS improvements across multiple diffusion architectures on ImageNet.
This article reviews three AI‑powered illustration platforms—Banana Painter, NotebookLM, and JiMeng AI—detailing their free and paid plans, usage methods, visual styles, strengths and weaknesses, and provides a side‑by‑side comparison table to help creators choose the most suitable tool for scientific comic production.
The paper introduces reAR, a plug‑and‑play regularization framework that aligns generator and tokenizer representations in visual autoregressive models, dramatically improving image quality and matching large diffusion models while using far fewer parameters, and validates the approach with extensive experiments, ablations, and scalability analysis.
By dissecting a popular AI‑generated image series, the article reveals how a carefully ordered prompt—detailing character, action, setting, lighting, lens effects, and emotion—creates a reusable template that transforms simple tags into vivid, collectible visual narratives.
InternVL-U, a 4‑billion‑parameter unified multimodal model released as open source, combines a 2B MLLM backbone with a 1.7B visual generation head and, through a reasoning‑centric data pipeline and Chain‑of‑Thought guidance, achieves superior understanding, generation, and editing performance that surpasses much larger 14‑20B models on multiple benchmarks.
The article explains how Google Flow’s NanoBanana 2 provides a low‑cost, beginner‑friendly workflow for AI portrait generation, emphasizes the shift from vague descriptions to photographic‑language prompts, showcases four distinct style prompts, and offers practical tips for refining results.
Mind-Brush introduces a ‘think‑research‑create’ agentic framework that unifies intent analysis, multimodal evidence retrieval, and knowledge‑driven reasoning to transform text‑to‑image generation from static decoding into an active cognitive workflow, achieving large accuracy gains on the new Mind‑Bench benchmark and surpassing existing SOTA models.
The article reviews Uni‑1, a decoder‑only transformer that unifies visual understanding and generation, details its architecture, benchmark superiority on RISEBench and ODinW‑13, showcases diverse visual examples where it outperforms GPT Image 1.5 and Nano Banana Pro, and highlights the small elite team behind the breakthrough.
The article examines the quirky food‑based naming trend in the AI community, breaks down Nano Banana 2’s architecture and speed‑up techniques, evaluates its dramatically improved Chinese rendering, compares its aggressive pricing with rivals, and offers practical integration advice for developers.
AI model architectureChinese renderingGoogle Gemini
Google’s Nano Banana 2 (Gemini 3.1 Flash Image) upgrades image generation with real‑time web knowledge, clearer text rendering, consistent character/object handling, and broad product integration, positioning the model as a fast, configurable rendering engine rather than a niche creative tool.
The new Latent Forcing technique from Fei‑Fei Li’s team reorders the diffusion trajectory, first generating a latent structural sketch and then refining pixel details, which restores efficiency of latent‑space models while preserving 100 % pixel fidelity, achieving state‑of‑the‑art FID scores on ImageNet‑256.
Alibaba's Tongyi releases the Z-Image base model, a non‑distilled diffusion transformer that supports full classifier‑free guidance, negative prompts, higher diversity, and fine‑tuning, contrasting with the faster Turbo variant and providing detailed usage instructions and community resources.
This guide walks through configuring Alibaba Cloud credentials, implementing a FastAPI backend with email function calling, Alibaba OpenSearch, image generation via DashScope, speech recognition, and a responsive HTML/CSS/JavaScript front‑end that supports text chat, image recognition, image synthesis, and voice interaction.
Cursor 2.4 launches with Subagents that enable parallel, specialized AI assistants, improving context handling and speed, plus a Google‑powered image generator for UI mockups, an AI‑enhanced blame feature for code attribution, proactive clarification questions, and numerous performance upgrades such as a ten‑fold faster built‑in browser and 40× faster hooks.
This guide explains how to use advanced AI models such as Gemini, Midjourney, and Stable Diffusion to expand brief, informal user descriptions into comprehensive, high‑quality English prompts that include visual style, subject details, environment, lighting, and camera parameters for image or video generation.
The article showcases a series of AI‑generated ultra‑realistic commercial visuals, breaks down the exact prompt language behind each, and explains the design insights that turn imaginative concepts into high‑impact advertising imagery for products like Nano Banana Pro.
Black Forest Labs released Flux.2 Max, the top‑performing model in the Flux.2 series featuring real‑time context generation, superior texture handling, and strong instruction following, ranking second on the Artificial Analysis leaderboard, with detailed examples, API usage, and pricing information provided.
The article reviews three recent AI breakthroughs—GLM‑4.6V’s multimodal large‑model with 128K context and native function calling, AutoGLM 2.0’s open‑source mobile‑operating AI agent, and RealGen’s detector‑rewarded image generator that achieves a 50.15% realism win rate—highlighting how they expand toolkits for designers and developers.
This article presents a novel paradigm—Latent Reward Model (LRM) and Latent Preference Optimization (LPO)—that repurposes diffusion models as noise‑aware latent reward models for step‑level preference optimization, addressing the shortcomings of pixel‑level reward models, introducing multi‑preference consistent filtering, and demonstrating significant performance and efficiency gains on benchmarks such as PickScore and T2I‑CompBench++.
Flow‑GRPO introduces online reinforcement learning into flow‑matching models by converting deterministic ODE sampling to stochastic SDE sampling and reducing denoising steps, raising SD‑3.5‑Medium's GenEval accuracy from 63% to 95%—surpassing GPT‑4o—and demonstrating strong gains in complex composition, text rendering, and human‑preference alignment across multiple generative tasks.
CoTyle introduces a novel open‑source framework that generates unique image styles from a numeric style code, eliminating the need for reference images, lengthy prompts, or LoRA modules, and demonstrates superior style consistency compared to existing solutions like Midjourney.
This article explains the over‑optimization problem in GRPO‑based flow models, analyzes why importance‑ratio clipping fails, and introduces GRPO‑Guard with RatioNorm and cross‑step gradient balancing, showing through extensive experiments that it stabilizes training and improves image quality across multiple diffusion backbones and tasks.
Introducing Ming‑Flash‑Omni‑Preview, a 103‑billion‑parameter open‑source multimodal model built on a sparse MoE architecture that delivers state‑of‑the‑art performance in controllable image generation, streaming video understanding, and context‑aware speech recognition, surpassing prior models on GenEval and GEdit benchmarks.
Image GenerationSpeech Recognitionlarge language model
This article details Alibaba’s Taobao Star fashion AIGC model, explaining its data pipeline, captioning strategy, multi‑stage training, and impressive virtual try‑on results for users and merchants, while showcasing model‑based and model‑free generation and pose‑transfer capabilities.
A recent MIT‑Toyota study shows that the locality observed in image diffusion models emerges from the statistical structure of training data rather than from architectural biases, and a simple linear denoiser can replicate this behavior, reshaping how we think about model design.
InfGen introduces a resolution‑agnostic generation paradigm that replaces the VAE decoder in diffusion models, allowing any‑size image synthesis with up to ten‑fold speed gains, achieving 4K outputs in under 7 seconds while improving visual quality.
This article details how JD.com’s AI‑driven virtual fitting solution, integrated with an A/B testing platform, transformed fashion e‑commerce by generating realistic model images and videos, cutting production costs to zero, accelerating design cycles, and increasing conversion rates by over 80% during major sales events.
Google’s Imagen 4 family—Ultra, Standard, and Fast—introduces unprecedented realism, reliable text rendering, multilingual prompts, and higher instruction fidelity, while the article explains each model’s trade‑offs and offers concrete prompt‑engineering techniques to help creators harness this next‑generation AI image generator.
Lumina-mGPT 2.0 is a decoder‑only, zero‑shot trained autoregressive image model that rivals diffusion systems like DALL·E 3 in quality while offering unified multimodal tokenization, flexible multi‑task generation, and several inference‑speed tricks, yet it still faces licensing, scaling and sampling‑time challenges.
AI model analysisImage GenerationInference Optimization
This article reviews a recent study that demonstrates how a highly compressed one‑dimensional tokenizer, using only 32 discrete tokens and gradient‑based test‑time optimization, can generate high‑quality images without training a separate generative model, and explores its methodology, findings, applications, and limitations.
JD Retail’s “JingDianDian” AI virtual try‑on platform leverages a 12‑billion‑parameter Flux‑Fill diffusion model and multimodal pose estimation to automatically create realistic model images and videos, integrates with the JingMai A/B testing system, and delivers up to an 80% boost in conversion while cutting production costs and time dramatically.
Orthus, a new unified multimodal model presented at ICML 2025, leverages an autoregressive Transformer backbone with separate language and diffusion heads to enable lossless image‑text interleaved generation, outperforming existing models on both understanding and generation benchmarks while remaining computationally efficient.
AI researchImage Generationautoregressive transformer
This article details JD Retail Technology’s AI‑driven virtual try‑on system that combines a 12B Flux‑Fill diffusion model with a high‑quality virtual model library and integrates with the JingMai A/B testing platform, cutting production costs to zero, slashing cycle time to half a day, and increasing order conversion rates by over 80% during the 618 shopping festival.
HarmoniCa, a new feature‑caching framework co‑designed by HKUST, Beihang University, and SenseTime, tackles diffusion model inference bottlenecks by aligning training and inference through Step‑Wise Denoising Training and an Image Error Proxy Objective, achieving up to 2× speedup while preserving image quality.
The USP framework introduces masked latent modeling within a VAE space to pre‑train ViT encoders, enabling seamless weight transfer to both image classification, segmentation, and diffusion‑based generation tasks, dramatically speeding up DiT and SiT models while preserving strong visual representations.
The USP framework introduces masked latent modeling within a VAE space to pretrain ViT encoders, enabling seamless weight transfer to both image classification and diffusion‑based generation tasks, dramatically accelerating training while preserving strong performance across multiple benchmarks.
This article details how JD.com’s AI-powered virtual try‑on system, integrated with the Jingmai A/B testing platform, transformed fashion e‑commerce by generating realistic model images and videos, reducing production costs to near zero, cutting design cycles from weeks to hours, and increasing conversion rates by over 80% during major sales events.
The EvoSearch method introduced by HKUST and Kuaishou’s KuaLing team leverages test‑time scaling to dramatically improve diffusion‑based image and video generation without training, using evolutionary search along the denoising trajectory, achieving state‑of‑the‑art results on SD2.1, Flux‑1‑dev and other models.
EvoSearch, a test‑time evolutionary search method, dramatically improves image and video generation by increasing inference compute without extra training, outperforming existing scaling techniques on diffusion and flow models while maintaining robustness and diversity across multiple benchmarks.
The article introduces DiSA, a training‑free diffusion step annealing technique that dramatically speeds up autoregressive image generation by reducing diffusion steps in later generation phases while preserving high visual quality, and validates the method across several state‑of‑the‑art AR‑Diffusion models.
DreamO, a collaborative effort by ByteDance and Peking University, introduces a unified 400M‑parameter framework built on Flux‑1.0‑dev that enables simultaneous control of identity, style, appearance, and virtual try‑on, offering open‑source, low‑cost, and fast image customization comparable to commercial large models.
This article explains the fundamental principles of diffusion models, using physics and machine‑learning analogies to describe forward and reverse diffusion, the role of Gaussian noise, iteration trade‑offs, U‑Net architecture, and shared‑weight training for image generation.
This article surveys the latest AI breakthroughs, covering ChatGPT‑4o's native image generation, Runway's Gen‑4 video model, Midjourney V7, AnimeGamer's infinite anime simulation, JiMeng 3.0 poster creator, ComfyUI‑Copilot workflow assistant, DomoAI's voice‑image digital humans, Ready AI web builder, DeepSeek‑V3, and Alibaba's ultra‑realistic 3D digital human model.
OpenAI has opened the GPT‑Image‑1 API, a multimodal model that supports both image generation and editing, offers configurable quality, size, and format options, provides JavaScript code samples, outlines token‑based pricing, and is already being integrated by platforms such as Adobe, Canva, and HeyGen.
FlexIP introduces a dual‑adapter architecture and a dynamic weight‑gating mechanism that decouple identity preservation from personalized editing, allowing continuous control over image generation and outperforming prior SOTA methods in both fidelity and flexibility.
This article reviews the breakthrough image‑generation capabilities of GPT‑4o, showcases diverse examples, and offers a detailed speculation on its underlying autoregressive architecture, tokenization methods, VQ‑VAE/GAN advances, and training strategies that could explain its performance.
Ele.me created a domain-specific AIGC image model built from scratch on its own data using the DiT backbone, a three-stage training pipeline (transformer pre-training, prompt alignment, aesthetic fine-tuning), custom T5‑E‑CLIP text and visual encoders, ControlNet for layout control, and evaluated via FID, CLIP scores and a human rubric, enabling automated dish-image generation and UI asset creation for its vertical business.
This article outlines the rapid growth of AIGC technologies, describes key image‑generation and language models, demonstrates step‑by‑step design workflows, explores user‑experience research enhancements, and envisions future business uses while offering practical tips for mastering AI‑generated content.
This tutorial shows how to use Alibaba Cloud's Baileian platform to create a workflow that generates a Xiaohongshu‑style article together with matching images by leveraging a custom large‑model plugin, Python script nodes, and image‑generation tools, complete with step‑by‑step configuration and code examples.
OpenAI’s GPT‑4o image generation, launched only for paid users, quickly hit performance bottlenecks and sparked a flood of viral content, prompting technical analysis of its multimodal capabilities, speed issues, copyright concerns, and the broader impact on the AI industry.
This article presents a thorough assessment of GPT‑4o’s new image generation features, detailing multiple test scenarios—from simple portrait creation and style transfer to UI design, product rendering, and educational illustrations—comparing its output with Claude‑3.7‑Sonnet, highlighting strengths in realism and weaknesses in Chinese text handling.
The AI SDK 4.2 release introduces powerful new features such as step‑by‑step reasoning support, a Model Context Protocol (MCP) client for tool integration, useChat message components, multimodal image generation, standardized URL sources, OpenAI Responses API support, Svelte 5 compatibility, and numerous middleware and provider enhancements, all illustrated with practical JavaScript/TypeScript examples.
The 2024 advertising team introduced a suite of AI‑driven techniques—including a trustworthy feedback network, a large‑scale human‑annotated dataset, multimodal large language model representations, and online ranking architecture upgrades—to dramatically improve the quality, coverage, and personalization of generated ad creatives.
2024 saw the advertising team achieve major breakthroughs in AI-generated ad creatives by introducing a multimodal reliable feedback network to improve image usability, releasing a large human-annotated dataset, and leveraging multimodal large language models for richer representation and more effective online/offline creative selection.
The paper introduces UNIFIEDREWARD, the first unified reward model for multimodal understanding and generation that supports pairwise ranking and pointwise scoring, builds a 236K human‑preference dataset across image and video tasks, and uses DPO to align VLMs and diffusion models, achieving significant performance gains on both image and video benchmarks.
Direct Preference OptimizationImage GenerationUnified Reward
The paper presents FAR, a frequency‑aware autoregressive framework that predicts image tokens from low‑frequency to high‑frequency components using a continuous tokenizer, and demonstrates its efficiency and quality on ImageNet and text‑to‑image benchmarks compared with existing AR and VAR methods.
FlexVAR replaces residual prediction with direct ground‑truth prediction in visual autoregressive modeling, enabling generation of arbitrary resolutions and aspect ratios, supporting image‑to‑image tasks such as inpainting and upscaling, and offering adjustable inference steps that trade speed for quality while achieving state‑of‑the‑art FID scores.
The paper introduces a novel attention‑distillation loss and a guided‑sampling scheme that together enable diffusion models to faithfully transfer visual features from reference images, dramatically speeding synthesis and surpassing prior plug‑and‑play attention methods across style transfer, text‑to‑image generation, and texture synthesis tasks.