UI2Code | BestHub

JD Tech Talk

Nov 8, 2024 · Artificial Intelligence

Exploring UI Design‑to‑Code Automation: Practices from Meituan, Xianyu, Microsoft and Large‑Model Flutter Generation

This article surveys recent advances in automatically converting UI design drafts into code, reviewing solutions from Meituan, Xianyu, Microsoft, a range of design‑to‑code tools, Flutter‑specific generators, JD's Ling platform, and practical experiments with large language models for Flutter code generation.

Artificial IntelligenceFlutterLarge Models

0 likes · 7 min read

Exploring UI Design‑to‑Code Automation: Practices from Meituan, Xianyu, Microsoft and Large‑Model Flutter Generation

Xianyu Technology

Dec 11, 2019 · Artificial Intelligence

Improving Small Object Detection for UI2CODE via Data Augmentation and Model Optimization

The study enhances UI2CODE’s ability to detect tiny UI components by augmenting training data with copied small objects, upgrading the detector from Faster RCNN to FPN and Cascade FPN, and refining box positions with smoothing and projection, achieving superior small‑object mAP/mAR and enabling broader UI parsing applications.

FPNUI2Codecomputer vision

0 likes · 9 min read

Improving Small Object Detection for UI2CODE via Data Augmentation and Model Optimization

Xianyu Technology

Jun 5, 2019 · Mobile Development

UI2CODE Page Framework: Evolution and Architecture

The UI2CODE Page Framework evolves a unified, MVP‑based architecture—comprising Pages, Cards, and Reactions—that leverages AI‑driven code generation and Redux messaging to enable high‑cohesion, low‑coupling components, dramatically cut development time, and plans further AI integration for fully automatic page creation.

AI code generationFlutterPage Framework

0 likes · 8 min read

UI2CODE Page Framework: Evolution and Architecture

Xianyu Technology

Feb 21, 2019 · Artificial Intelligence

UI2CODE: AI‑Powered Automatic UI‑to‑Flutter Code Generation

UI2CODE, an AI‑powered tool from Xianyu’s tech team, automatically transforms UI screenshots into editable Flutter code by extracting visual elements with machine‑vision, classifying them via deep‑learning, generating a domain‑specific language through a recursive neural network, and mapping this DSL onto syntax‑tree templates to achieve pixel‑level precision, full accuracy, and maintainable output.

FlutterMachine VisionUI2Code

0 likes · 8 min read

UI2CODE: AI‑Powered Automatic UI‑to‑Flutter Code Generation

Xianyu Technology

Jan 2, 2019 · Artificial Intelligence

Xianyu's Flutter and AI-Powered UI-to-Code Innovation: Technical Deep Dive

Xianyu’s 2018 technical breakthroughs combine Flutter/Dart for tri‑platform development, a TensorFlow‑driven UI2Code system that converts screenshots into runnable Flutter code, and the SWAK framework that isolates business logic from middleware, boosting productivity, simplifying legacy code, and showcasing playful engineering anecdotes.

Cross-Platform DevelopmentFlutterSWAK

0 likes · 6 min read

Xianyu's Flutter and AI-Powered UI-to-Code Innovation: Technical Deep Dive

iQIYI Technical Product Team

Dec 28, 2018 · Artificial Intelligence

AI‑Driven Visual Automation Testing Frameworks: Challenges, Opportunities, and the Aion Solution

The article examines shortcomings of traditional visual automation frameworks—weak cross‑platform support, ID dependence, and fragile screenshot matching—and shows how Aion’s hybrid approach, merging image‑processing segmentation with deep‑learning classification and OCR, delivers a more stable, cross‑platform, “visible‑to‑obtain” testing solution while acknowledging remaining accuracy challenges.

AI testingImage RecognitionOCR

0 likes · 11 min read

AI‑Driven Visual Automation Testing Frameworks: Challenges, Opportunities, and the Aion Solution

Xianyu Technology

Dec 18, 2018 · Frontend Development

UI Semantic Parsing: From Image to Code with AI

The UI semantic parsing system uses NLP and YOLO‑based image recognition combined with rule‑based reasoning to automatically translate design images into readable Vue code, assigning semantic classes to elements, inferring layout hierarchies, and enabling data binding, thus bridging the gap between designers and front‑end developers.

AI code generationNLP analysisUI semantic parsing

0 likes · 9 min read

UI Semantic Parsing: From Image to Code with AI

Xianyu Technology

Sep 25, 2018 · Artificial Intelligence

TensorFlow Lite Applications and UI2Code at Xianyu (Idle Fish)

Xianyu leverages a custom TensorFlow Lite framework to power AI‑driven features such as dynamic video‑cover selection, video fingerprinting, and furniture recognition for smart rentals, while its UI2Code tool transforms screenshots into pixel‑perfect production UI code, emphasizing extensibility, security, and online model updates.

TensorFlowTensorFlow LiteUI2Code

0 likes · 7 min read

TensorFlow Lite Applications and UI2Code at Xianyu (Idle Fish)