The authors build a mixture-of-experts (MoE) model for time series forecasting that trains experts to specialize by giving each expert its own loss function—not just a global prediction loss, but also expert-specific errors that guide which expert learns what patterns. They combine this with incremental online updates so you can adapt the model without retraining from scratch every time, cutting computational cost. Tests on economic, tourism, and energy datasets show the approach beats standard statistical methods and modern neural architectures (Transformers, WaveNet) in both accuracy and efficiency.
Main takeaways:
- Each expert gets its own loss signal during training, encouraging specialization beyond what a shared global loss would provide
- Online learning lets you update the gating network and expert weights incrementally, avoiding full retraining
- Outperforms statistical baselines and Transformer/WaveNet models on multiple real-world forecasting tasks
- Ablation studies confirm that the expert-specific loss design is doing real work—not just a hyperparameter tweak