专题:Stochastic Gradient Optimization Techniques

This cluster of papers focuses on the application of optimization methods in machine learning, particularly in the context of stochastic gradient descent, random projections, deep learning, convex optimization, matrix decompositions, and large-scale optimization. The papers explore various algorithms and techniques for improving the efficiency and effectiveness of machine learning models, with a specific emphasis on neural networks and generalization.
最新文献
Approximate Unitary k-Designs from Shallow, Low-Communication Circuits (Extended Abstract)

article Full Text OpenAlex

Hybrid Real-Complex Linear Attention: A Mathematical Framework for Sub-Quadratic Transformer Architectures

article Full Text OpenAlex

Byzantine-Resilient Federated Learning via Distributed Optimization

article Full Text OpenAlex

Stable Self-Improving AI under Value-Anchored Natural-Law Gradient Flows

preprint Full Text OpenAlex

Private Aggregation for Byzantine-Resilient Heterogeneous Federated Learning

article Full Text OpenAlex

Gradient-Flow-Based Compute--Performance Trade-offs for Intelligent Systems

preprint Full Text OpenAlex

Holographic Observation Quotients and Fractal Boundaries: A Model-Agnostic Design Theory for Compute-Optimal Learning

preprint Full Text OpenAlex

PFedDST: Personalized Federated Learning with Decentralized Selection Training

article Full Text OpenAlex

Compute-Optimal AI via Image--EVI, Interior Bures--HK Control, and Fractal Dendritic Approximation (DIR)

preprint Full Text OpenAlex

Parallel Rank-Adaptive Higher Order Orthogonal Iteration

article Full Text OpenAlex

近5年高被引文献
Exploring Material Design Space with a Deep-Learning Guided Genetic Algorithm

preprint Full Text OpenAlex 49698 FWCI1242.93091121

Federated Learning on Non-IID Data Silos: An Experimental Study

article Full Text OpenAlex 887 FWCI101.92021949

Model Pruning Enables Efficient Federated Learning on Edge Devices

article Full Text OpenAlex 459 FWCI81.84390688

Generalization in quantum machine learning from few training data

article Full Text OpenAlex 380 FWCI72.44556351

Privacy‐preserving federated learning based on multi‐key homomorphic encryption

article Full Text OpenAlex 321 FWCI62.45982367

Filter-enhanced MLP is All You Need for Sequential Recommendation

article Full Text OpenAlex 295 FWCI47.97921284

Decentralized Federated Averaging

article Full Text OpenAlex 269 FWCI51.49508974

Privacy-Preserving Byzantine-Robust Federated Learning via Blockchain Systems

article Full Text OpenAlex 229 FWCI44.64213103

The Quantum Approximate Optimization Algorithm and the Sherrington-Kirkpatrick Model at Infinite Size

article Full Text OpenAlex 211 FWCI36.41858057

Recent Advances in Stochastic Gradient Descent in Deep Learning

article Full Text OpenAlex 204 FWCI52.11034908