Skip to content
Tagged articles

PyTorch

229 articles · Page 3 of 3
Python Programming Learning Circle
Python Programming Learning Circle
Aug 23, 2021 · Artificial Intelligence

Efficient PyTorch Training Pipeline: Tips, Profiling, and Multi‑GPU Strategies

This article presents practical strategies for building high‑performance PyTorch training pipelines, covering bottleneck identification, efficient data loading, RAM‑based datasets, profiling tools, multi‑GPU training with DataParallel and DistributedDataParallel, custom loss implementation, and hardware‑vs‑software trade‑offs to accelerate deep‑learning workloads.

Custom LossDataLoaderPyTorch
0 likes · 13 min read
Efficient PyTorch Training Pipeline: Tips, Profiling, and Multi‑GPU Strategies
Python Programming Learning Circle
Python Programming Learning Circle
Jul 23, 2021 · Artificial Intelligence

Understanding PyTorch's Backward Propagation Engine (BP Engine)

This article explains how PyTorch's BP Engine dynamically builds the computation graph for back‑propagation, detailing its C++ class structure, thread management, task queues, and key functions such as start_threads, compute_dependencies, execute, and evaluate_function, with illustrative code examples.

BackpropagationC++Engine
0 likes · 17 min read
Understanding PyTorch's Backward Propagation Engine (BP Engine)
Kuaishou Tech
Kuaishou Tech
Jul 16, 2021 · Artificial Intelligence

Bagua: An Open‑Source Distributed Training Framework for Deep Learning

Bagua is a distributed training framework co‑developed by Kuaishou and ETH Zürich that combines algorithmic and system‑level optimizations—such as decentralized, asynchronous, and compressed communication—to achieve up to 60% higher performance than existing frameworks like PyTorch‑DDP, Horovod, and BytePS across various AI workloads.

BaguaGPU scalingPyTorch
0 likes · 15 min read
Bagua: An Open‑Source Distributed Training Framework for Deep Learning
MaGe Linux Operations
MaGe Linux Operations
Jul 8, 2021 · Artificial Intelligence

TensorFlow vs PyTorch 2.x: Which AI Framework Wins in 2021?

An in‑depth comparison of TensorFlow 2.x and PyTorch 1.8 highlights new features, deployment options like TensorFlow Lite and PyTorch Mobile, coding style differences, and practical guidance on choosing the right deep‑learning library for various projects and skill levels.

PyTorchTensorFlowdeep learning
0 likes · 6 min read
TensorFlow vs PyTorch 2.x: Which AI Framework Wins in 2021?
Python Programming Learning Circle
Python Programming Learning Circle
May 29, 2021 · Artificial Intelligence

Comparing PyTorch 1.8 and TensorFlow 2.5: New Features, Use Cases, and Choosing the Right Framework

This article reviews the latest releases of PyTorch 1.8 and TensorFlow 2.5, outlining their new functionalities, ecosystem tools such as TensorFlow.js, Lite, and TFX, as well as PyTorch Mobile and Lightning, and provides guidance on selecting the most suitable framework for different deep‑learning projects.

PyTorchTensorFlowartificial intelligence
0 likes · 7 min read
Comparing PyTorch 1.8 and TensorFlow 2.5: New Features, Use Cases, and Choosing the Right Framework
MaGe Linux Operations
MaGe Linux Operations
Mar 29, 2021 · Artificial Intelligence

Mastering PyTorch Visualization: TensorBoard and Visdom Guide

This tutorial explains how to install, launch, and use TensorBoard and Visdom with PyTorch, providing step‑by‑step commands, code examples for logging training metrics, and visualizing images and plots to monitor deep‑learning experiments.

PyTorchPythonTensorBoard
0 likes · 6 min read
Mastering PyTorch Visualization: TensorBoard and Visdom Guide
Bitu Technology
Bitu Technology
Mar 26, 2021 · Artificial Intelligence

Applying Machine Learning to Advertising‑Based Video‑On‑Demand (AVOD) at Tubi

This article explains how Tubi leverages machine learning—particularly PyTorch, Databricks, and cloud services—to improve content understanding, advertising technology, and recommendation systems within its advertising‑based video‑on‑demand platform, outlining the three AVOD pillars, technical stack, and future research directions.

AVODAdvertising TechnologyDatabricks
0 likes · 13 min read
Applying Machine Learning to Advertising‑Based Video‑On‑Demand (AVOD) at Tubi
360 Quality & Efficiency
360 Quality & Efficiency
Mar 26, 2021 · Operations

Deploying a Code Clone Detection Model with TorchServe

This article explains how to build a code clone detection service using a CodeBERT classification model, create a custom TorchServe handler, package the model with torch-model-archiver, launch the service, and test it with example code pairs to demonstrate clone and non‑clone predictions.

PyTorchTorchServeclone detection
0 likes · 8 min read
Deploying a Code Clone Detection Model with TorchServe
JD Cloud Developers
JD Cloud Developers
Mar 15, 2021 · Artificial Intelligence

Top Tech Weekly: AI Earthquake Monitor, PyTorch 1.8, Language Rankings & More

This developer community weekly roundup highlights CCTV's new big‑data governance platform, RedMonk's programming language rankings, Chromium‑based browsers adopting a four‑week release cycle, PyTorch 1.8 with AMD support, the world’s first AI‑driven earthquake monitoring system, Red Hat OpenShift 4.7, a deep meta‑learning model for city sales prediction, and a CVPR breakthrough in controllable human image generation.

PyTorchartificial intelligencebig data
0 likes · 9 min read
Top Tech Weekly: AI Earthquake Monitor, PyTorch 1.8, Language Rankings & More
MaGe Linux Operations
MaGe Linux Operations
Mar 11, 2021 · Artificial Intelligence

What’s New in PyTorch 1.8? Key Features, APIs, and Performance Boosts

PyTorch 1.8, released by the PyTorch team, bundles over 3,000 commits since 1.7, introducing AMD ROCm support, enhanced Python function conversion, stable FFT and linear‑algebra APIs, complex‑tensor autograd, distributed‑training improvements, new mobile tutorials, performance tools, and several prototype features.

GPUPyTorchVersion Release
0 likes · 6 min read
What’s New in PyTorch 1.8? Key Features, APIs, and Performance Boosts
21CTO
21CTO
Jan 31, 2021 · Artificial Intelligence

How Facebook’s Open‑Source Surge is Shaping AI and Development in 2020

Facebook’s 2020 open‑source report reveals a rapid expansion to over 700 repositories and 1.3 million GitHub followers, highlights AI breakthroughs like the M2M‑100 multilingual model and ReBel algorithm, and showcases frontend tools such as React Native and the newly released Recoil library.

FacebookM2M-100PyTorch
0 likes · 4 min read
How Facebook’s Open‑Source Surge is Shaping AI and Development in 2020
Sohu Tech Products
Sohu Tech Products
Nov 11, 2020 · Artificial Intelligence

Illustrated Transformer: Comprehensive Explanation and Code Implementation

This article provides a step‑by‑step illustrated guide to the Transformer architecture, covering its macro structure, detailed self‑attention mechanisms, multi‑head attention, positional encoding, residual connections, decoder operation, training process, loss functions, and includes complete PyTorch and custom Python code examples.

NLPPyTorchSelf-Attention
0 likes · 33 min read
Illustrated Transformer: Comprehensive Explanation and Code Implementation
Python Programming Learning Circle
Python Programming Learning Circle
Apr 26, 2020 · Artificial Intelligence

Understanding PyTorch Autograd: Tensors, Gradients, and Backpropagation

This article explains PyTorch's autograd system, covering tensor creation, the requires_grad flag, detaching tensors, disabling gradient tracking with no_grad, the Function class and computational graph, and demonstrates forward and backward passes with code examples illustrating gradient computation and Jacobian‑vector products.

AutogradBackpropagationPyTorch
0 likes · 6 min read
Understanding PyTorch Autograd: Tensors, Gradients, and Backpropagation
58 Tech
58 Tech
Mar 27, 2020 · Artificial Intelligence

dl_inference: Open‑Source General Deep Learning Inference Service

dl_inference is an open‑source inference platform that simplifies deployment of TensorFlow and PyTorch models in production, offering unified gRPC access, load‑balanced multi‑node serving, GPU/CPU options, customizable pre‑ and post‑processing, and extensible architecture for future AI workloads.

AI inferenceModel ServingPyTorch
0 likes · 11 min read
dl_inference: Open‑Source General Deep Learning Inference Service
UCloud Tech
UCloud Tech
Mar 24, 2020 · Artificial Intelligence

Why Does PyTorch Struggle with UFS Storage? Insights and Optimizations

A detailed case study reveals why PyTorch training on UFS file storage suffers severe I/O bottlenecks, compares it with local SSD and SSHFS, and presents practical optimizations such as using cv2.imdecode, caching DataLoader handles, and converting small‑file datasets into large UFS files to close the performance gap.

AI TrainingPyTorchUFS
0 likes · 14 min read
Why Does PyTorch Struggle with UFS Storage? Insights and Optimizations
58 Tech
58 Tech
Dec 20, 2019 · Artificial Intelligence

Deep Learning Platform on Kubernetes: Architecture, Resource Management, Offline Training and Online Inference

The article presents a comprehensive overview of 58.com’s AI platform built on Kubernetes, detailing its layered architecture, resource scheduling, offline training pipelines, debugging environment, distributed TensorFlow/PyTorch training, performance benchmarks, and online inference services, highlighting how the system empowers various business units with scalable AI capabilities.

KubernetesPyTorchTensorFlow
0 likes · 11 min read
Deep Learning Platform on Kubernetes: Architecture, Resource Management, Offline Training and Online Inference
MaGe Linux Operations
MaGe Linux Operations
Sep 27, 2019 · Artificial Intelligence

Top 10 Python Libraries Every AI Developer Should Master

This article introduces ten essential Python libraries—TensorFlow, Scikit‑Learn, NumPy, Keras, PyTorch, LightGBM, Eli5, SciPy, Theano, and Pandas—detailing their features, typical use cases, and adoption in machine‑learning and data‑science projects, while highlighting each library's performance advantages, community support, and integration capabilities to help developers choose the right tool for their AI workflows.

KerasNumPyPyTorch
0 likes · 15 min read
Top 10 Python Libraries Every AI Developer Should Master
Qunar Tech Salon
Qunar Tech Salon
Sep 11, 2018 · Artificial Intelligence

Overview of Deep Learning Object Detection Methods and Detailed Implementation of Faster R‑CNN

This article reviews major deep‑learning object detection approaches—including one‑stage YOLO and SSD and two‑stage RCNN, Fast RCNN, and Faster RCNN—then provides a step‑by‑step explanation of Faster RCNN’s architecture, region‑proposal network, RoI pooling, loss functions, and sample PyTorch code.

Computer VisionFaster R-CNNObject Detection
0 likes · 20 min read
Overview of Deep Learning Object Detection Methods and Detailed Implementation of Faster R‑CNN
MaGe Linux Operations
MaGe Linux Operations
Mar 3, 2017 · Artificial Intelligence

Top 5 Python Libraries to Supercharge Your Machine Learning Projects

This article introduces five highly rated Python libraries—PyWren, Tfdeploy, Luigi, Kubelib, and PyTorch—that streamline data handling, cloud execution, workflow orchestration, and GPU acceleration, helping machine‑learning engineers boost productivity and tackle complex projects more efficiently.

AWS LambdaKubernetesPyTorch
0 likes · 6 min read
Top 5 Python Libraries to Supercharge Your Machine Learning Projects