Tagged articles
22 articles
Page 1 of 1
Old Zhang's AI Learning
Old Zhang's AI Learning
Mar 8, 2026 · Artificial Intelligence

Twinkle – A Lightweight, Fully Chinese Large‑Model Training Framework from ModelScope

Twinkle is a lightweight client‑server training framework open‑sourced by ModelScope that abstracts away Ray clusters, data and model parallelism, offers three run modes (torchrun, Ray, HTTP), multi‑tenant LoRA training, dual back‑ends (Transformers and Megatron), and a serverless Training‑as‑a‑Service gateway for enterprise and individual developers.

LoRAModelScopeTaaS
0 likes · 14 min read
Twinkle – A Lightweight, Fully Chinese Large‑Model Training Framework from ModelScope
Fun with Large Models
Fun with Large Models
Jan 14, 2026 · Artificial Intelligence

Understanding Large Language Model Files: Structure, Tokens, and Inference with Qwen3

This article walks through the complete workflow of loading and running the open‑source Qwen3‑8B model, explaining each core file (weights, config, generation config, tokenizer), how the model tokenizes input, applies chat templates, generates responses, and decodes output, all illustrated with code and diagrams.

InferenceModelScopePython
0 likes · 16 min read
Understanding Large Language Model Files: Structure, Tokens, and Inference with Qwen3
Eric Tech Circle
Eric Tech Circle
Sep 10, 2025 · Artificial Intelligence

Deploy High‑Performance Local LLMs with vLLM: A Step‑by‑Step Guide

This article walks through installing and configuring vLLM for local large language model inference, compares it with Ollama and LM Studio, details environment setup, model download, testing scripts, and shows how to expose an OpenAI‑compatible API for production use.

Inference OptimizationModelScopeOpenAI API
0 likes · 11 min read
Deploy High‑Performance Local LLMs with vLLM: A Step‑by‑Step Guide
Alibaba Cloud Native
Alibaba Cloud Native
Dec 19, 2024 · Artificial Intelligence

Deploy Open-Source LLMs on Alibaba Cloud Function Compute in 10 Minutes

This guide explains how to quickly launch an open‑source large language model from ModelScope on Alibaba Cloud Function Compute, covering the required cloud services, step‑by‑step deployment, reserved‑instance configuration, and how to invoke the model via the provided domain.

AIAlibaba CloudDeployment
0 likes · 7 min read
Deploy Open-Source LLMs on Alibaba Cloud Function Compute in 10 Minutes
Open Source Tech Hub
Open Source Tech Hub
Mar 12, 2024 · Artificial Intelligence

Step-by-Step Guide to Install ModelScope and Perform NLP Inference in Python & PHP

This guide walks you through setting up a Conda Python environment, installing PyTorch and the ModelScope library, running NLP pipelines for tasks like word segmentation and text classification, and calling ModelScope models from PHP using the PHPY extension, complete with code examples and troubleshooting tips.

AI inferenceModelScopeNLP
0 likes · 14 min read
Step-by-Step Guide to Install ModelScope and Perform NLP Inference in Python & PHP
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Jan 21, 2024 · Artificial Intelligence

Understanding Pretraining and Fine‑Tuning of Large Language Models: Methods, Resources, and Practical Applications

This article explains the concepts of pretraining and fine‑tuning for large language models, compares full‑parameter, LoRA and QLoRA approaches, discusses resource consumption, introduces the ModelScope SWIFT framework with code examples, and shows how fine‑tuning can improve data‑visualisation tasks while reducing token usage.

Data visualizationLLMLoRA
0 likes · 24 min read
Understanding Pretraining and Fine‑Tuning of Large Language Models: Methods, Resources, and Practical Applications
Open Source Tech Hub
Open Source Tech Hub
Jan 20, 2024 · Artificial Intelligence

How to Set Up ModelScope with Anaconda and Run OCR Inference via PHP

This guide walks through installing Anaconda, creating a Python 3.10 conda environment, adding PyTorch and ModelScope libraries, installing domain-specific dependencies, verifying NLP pipelines, and using PHPY to call ModelScope's OCR model from PHP, complete with code snippets and troubleshooting tips.

AI inferenceAnacondaModelScope
0 likes · 10 min read
How to Set Up ModelScope with Anaconda and Run OCR Inference via PHP
Alibaba Cloud Native
Alibaba Cloud Native
Jan 6, 2024 · Cloud Computing

Deploy ModelScope Models to Alibaba Cloud Function Compute in 5 Minutes

This guide walks readers through using ModelScope’s SwingDeploy service to locate, configure, and instantly deploy open‑source AI models to Alibaba Cloud Function Compute, explaining the resources created, how to invoke the model via HTTP triggers, and how to optimize performance with provisioned instances, logging, and concurrency settings.

AI model servingAlibaba CloudFunction Compute
0 likes · 15 min read
Deploy ModelScope Models to Alibaba Cloud Function Compute in 5 Minutes
DataFunSummit
DataFunSummit
Nov 20, 2023 · Artificial Intelligence

ModelScope Agents: Open‑Source LLM Agent Framework and Practical Guide

This article introduces ModelScope Agents, an open‑source LLM‑based agent framework that addresses limitations of GPT Store, outlines its features, provides installation and usage instructions, showcases a RPG game example, and invites the community to contribute to its roadmap.

AIAgent FrameworkLLM
0 likes · 7 min read
ModelScope Agents: Open‑Source LLM Agent Framework and Practical Guide
DataFunSummit
DataFunSummit
Nov 13, 2023 · Artificial Intelligence

SWIFT: A Scalable Light‑Weight Training and Inference Framework for Efficient Model Fine‑Tuning

SWIFT is an open‑source, PyTorch‑based framework that integrates multiple efficient fine‑tuning methods such as LoRA, QLoRA, Adapter, and the proprietary ResTuning, enabling developers to fine‑tune large language and multimodal models on consumer‑grade GPUs with significantly reduced memory and compute requirements.

Fine-tuningLoRAModelScope
0 likes · 13 min read
SWIFT: A Scalable Light‑Weight Training and Inference Framework for Efficient Model Fine‑Tuning
DataFunTalk
DataFunTalk
Sep 23, 2023 · Artificial Intelligence

Paraformer: An Industrial Non‑Autoregressive End‑to‑End Speech Recognition Model and Its Deployment on ModelScope

This article introduces the Paraformer non‑autoregressive end‑to‑end speech recognition model released by Alibaba DAMO Academy, details its architecture, training strategies, large‑scale performance, and provides step‑by‑step guidance for using and fine‑tuning the model on the ModelScope platform with the FunASR toolkit.

ASRModelScopeParaformer
0 likes · 13 min read
Paraformer: An Industrial Non‑Autoregressive End‑to‑End Speech Recognition Model and Its Deployment on ModelScope
DataFunSummit
DataFunSummit
Aug 24, 2023 · Artificial Intelligence

Panoramic Indoor Layout Estimation with Vision Transformer (PanoViT)

This article introduces the PanoViT model, a vision‑transformer‑based approach for indoor layout estimation from panoramic images, covering its research background, architectural components, experimental results on public datasets, and step‑by‑step usage within ModelScope.

3D reconstructionComputer VisionDeep Learning
0 likes · 8 min read
Panoramic Indoor Layout Estimation with Vision Transformer (PanoViT)
DataFunSummit
DataFunSummit
Jul 17, 2023 · Artificial Intelligence

Introduction to ModelScope Community's Fundamental NLP Models and Their Applications

This article introduces the ModelScope community's suite of foundational NLP models—including tokenization, POS tagging, NER, and text representation—detailing their architectures, performance, application scenarios, while also highlighting research contributions such as the ACE framework and retrieval‑enhanced techniques.

ModelScopeNLPartificial intelligence
0 likes · 21 min read
Introduction to ModelScope Community's Fundamental NLP Models and Their Applications
DataFunSummit
DataFunSummit
Apr 17, 2023 · Artificial Intelligence

Large‑Scale Table Pretraining Model SPACE‑T: Background, Architecture, and Applications

The article presents Alibaba DAMO Academy's large‑scale table pretraining model SPACE‑T, explaining the background and trends of TableQA and Text‑to‑SQL, detailing the model’s design and training data, showcasing its deployment on ModelScope and Alibaba Cloud, and outlining future directions and practical impact.

AIModelScopeSPACE-T
0 likes · 11 min read
Large‑Scale Table Pretraining Model SPACE‑T: Background, Architecture, and Applications
DataFunSummit
DataFunSummit
Apr 13, 2023 · Artificial Intelligence

ModelScope CV Model Overview: Visual Detection and Keypoint Applications

This article presents a comprehensive overview of ModelScope's computer‑vision models, detailing visual detection and keypoint solutions—including VitDet, YOLOX, res2net, HRNet, and 3D pose models—their architectures, performance highlights, real‑world applications, and future development plans.

AI modelsModelScopekeypoint detection
0 likes · 11 min read
ModelScope CV Model Overview: Visual Detection and Keypoint Applications
DataFunSummit
DataFunSummit
Apr 7, 2023 · Artificial Intelligence

Comprehensive Overview of OCR: Types, Models, Pre‑training Techniques, and DIY Pipelines on ModelScope

This article provides a detailed introduction to OCR technology, covering its fundamental concepts, major categories (document, scene, and handwritten OCR), typical processing pipelines, a suite of open‑source models on ModelScope—including detection, recognition, and table OCR—and recent multimodal pre‑training methods such as VLDoc and VLPT.

ModelScopeOCRTable OCR
0 likes · 15 min read
Comprehensive Overview of OCR: Types, Models, Pre‑training Techniques, and DIY Pipelines on ModelScope
DataFunSummit
DataFunSummit
Apr 1, 2023 · Artificial Intelligence

Overview of Understanding and Editing Vision Models in the ModelScope Community

This article introduces ModelScope's community‑released visual models, detailing the categorization of understanding versus editing models, the two‑stage coarse‑to‑fine segmentation pipeline for matting, and four editing applications—style transfer, portrait beautification, skin enhancement, and anime‑style conversion—while also previewing upcoming sky‑replacement and video‑matting models.

AIModelScopeStyle Transfer
0 likes · 9 min read
Overview of Understanding and Editing Vision Models in the ModelScope Community