Send email Copy Email Address
Research Group

Stich

Optimization is at the heart of many machine learning algorithms. The focus of our research group is on fundamental research on optimization techniques for training machine learning models. The research topics include decentralized methods (collaborative learning, federated learning), but also adaptive stochastic methods, generalization performance, deep theory of deep learning, and privacy and security in machine learning.

Head of Group

Sebastian Stich

Email

Phone

Address

Im Oberen Werk 1
66386 St. Ingbert (Germany)

Members

Placeholder

Xiaowen Jiang
Placeholder

Ali Zindari
Placeholder

Md Sakhawat Hosain
Placeholder

Yuan Gao
Placeholder

Parham Yazdkhasti

Sohom Muhkerjee
Placeholder

Anton Rodomanov
Placeholder

Shireen

Yasin Esfandiari
Placeholder

Baraah Adil Mohammed Sidahmed
Placeholder

Aniket Sanyal
Placeholder

Sneha Chetani
Placeholder

Khaled Alomar

Most Recent Publications

Year 2023

2023-12-11

Adaptive SGD with Polyak stepsize and Line-search: Robust Convergence and Variance Reduction

Conference / Medium

Conference on Neural Information Processing Systems (NeurIPS)

Tags
Trustworthy Information Processing
Authors
Full Paper Visit Detail Page
2023-11-29

Revisiting Gradient Clipping: Stochastic bias and tight convergence guarantees

Conference / Medium

International Conference on Machine Learning (ICML)

Tags
Trustworthy Information Processing
Authors
Full Paper Visit Detail Page
2023-11-29

Special Properties of Gradient Descent with Large Learning Rates

Conference / Medium

International Conference on Machine Learning (ICML)

Tags
Trustworthy Information Processing
Authors
Full Paper Visit Detail Page
2023-06-24

On the effectiveness of partial variance reduction in federated learning with heterogeneous data

Conference / Medium

IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Tags
Trustworthy Information Processing
Authors
Full Paper Visit Detail Page
2023-01-02

Stochastic distributed learning with gradient quantization and double-variance reduction

Article

Optimization Methods and Software

Tags
Trustworthy Information Processing
Authors
  • Samuel Horváth
  • Dmitry Kovalev
  • Konstantin Mishchenko
  • Peter Richtárik
  • Sebastian Stich
Full Paper Visit Detail Page