Top 2019 AI Papers Loved by Reddit Users: Key Insights and Links

1. Theoretical Research

Effective Estimation of Path‑Differentiable Target Parameters via Undersmoothed HAL

The authors show that asymptotically efficient estimators for smooth functional parameters can be obtained under a verifiable global undersmoothing condition by using Spline‑HAL‑MLE. By employing targeted HAL‑MLE as a meta‑learning step, the estimator combines super‑learning, undersmoothed HAL‑MLE, and TMLE.

Paper link:

https://arxiv.org/pdf/1908.05607.pdf

2. Computer Vision

BA‑Net: Dense Bundle Adjustment Network

This work introduces a neural network that solves Structure‑from‑Motion (SfM) problems by adjusting feature bundles (bundle adjustment). It also proposes a deep parametrization that recovers dense per‑pixel depth. The system integrates hard‑coded multi‑view geometry constraints with learning, achieving better performance than traditional bundle adjustment and contemporary deep methods in large‑scale experiments.

Paper link:

http://dwz.win/wmQ

3. Unsupervised Learning

MoCo: Momentum Contrast for Unsupervised Visual Representation Learning

MoCo builds a dynamic dictionary with a momentum encoder and a contrastive loss, enabling large‑scale unsupervised learning. It scales from ImageNet‑1M to Instagram‑1B, demonstrating that larger datasets remain under‑exploited. Beyond instance discrimination, the framework can be adapted to masked auto‑encoding and other self‑supervised objectives across vision and language.

Paper link:

https://arxiv.org/pdf/1911.05722.pdf

4. Unsupervised Learning via Hidden‑Unit Suppression

Unsupervised Learning by Hidden‑Unit Suppression

The authors design an algorithm that applies global suppression to hidden‑layer units, allowing the network to learn early‑stage feature detectors without any labels. These detectors can later be fine‑tuned with supervised data to train higher‑level weights, achieving performance comparable to standard feed‑forward networks using simple back‑propagation.

Paper link:

http://dwz.win/wuJ

5. Time‑Series Forecasting

N‑BEATS: Neural Basis Expansion Analysis for Interpretable Time Series Forecasting

The paper proposes a generic, flexible architecture for univariate time‑series prediction based on a stack of fully connected blocks that expand a neural basis. Experiments show strong performance across diverse forecasting benchmarks. The authors suggest that N‑BEATS’ success may stem from an implicit meta‑learning behavior, motivating further study.

Paper link:

https://arxiv.org/pdf/1905.10437.pdf