1 views collected around this technical thread.
This article introduces the basic architectures of recurrent neural networks (RNN), LSTM, and GRU, explains PyTorch APIs such as nn.RNN, nn.LSTM, nn.GRU, details their parameters, demonstrates code examples for building and testing these models, and provides practical insights for deep learning practitioners.
This article presents a practical study of extracting phone numbers from two‑speaker voice dialogues using Seq2Seq models—including LSTM, GRU with attention and feature fusion, and Transformer—detailing data characteristics, model architectures, training strategies, experimental results, and comparative analysis showing the GRU‑Attention approach achieving the best performance.
This article provides a comprehensive overview of deep learning fundamentals, covering neural network basics, forward and backward feedback architectures, key models such as MLP, CNN, RNN, LSTM and GRU, training techniques like gradient descent, learning rate schedules, momentum, weight decay, and batch normalization.
By converting Mercari’s product titles, descriptions, and categorical data into TF‑IDF vectors and embeddings, training MLP and GRU networks, and ensembling them with weighted averaging, the authors achieve a 0.3873 RMSLE—matching the competition’s top score—and demonstrate the power of text‑only price prediction for C2C marketplaces.
DeepGrammar is a bidirectional GRU‑based neural model that detects subject‑verb agreement errors by encoding surrounding context into fixed‑length vectors, outperforming rule‑based, classifier, and NMT approaches on the CoNLL‑2014 benchmark and achieving state‑of‑the‑art results across multiple error types.