BestHub
search
Sign in
Tag

SGD

0 views collected around this technical thread.

360 Tech Engineering
360 Tech Engineering
Sep 16, 2019 · Artificial Intelligence

Backpropagation Algorithm for Fully Connected Neural Networks with Python Implementation

This article explains the backpropagation training algorithm for fully connected artificial neural networks, detailing its gradient‑descent basis, mathematical derivation, matrix formulation, and provides a complete Python implementation with mini‑batch stochastic gradient descent, momentum, learning‑rate decay, and experimental results.

Machine LearningSGDbackpropagation
0 likes · 14 min read
Backpropagation Algorithm for Fully Connected Neural Networks with Python Implementation
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Aug 21, 2015 · Artificial Intelligence

Facebook’s Distributed Recommendation System: Architecture, Algorithms, and Performance

The article explains how Facebook built a large‑scale distributed recommendation system using Apache Giraph, collaborative filtering with matrix factorization, SGD and ALS algorithms, a novel work‑to‑work communication scheme, and performance optimizations that achieve ten‑fold speedups on billions of ratings.

ALSApache GiraphFacebook
0 likes · 9 min read
Facebook’s Distributed Recommendation System: Architecture, Algorithms, and Performance