#

sparse-neural-networks

Here are 31 public repositories matching this topic...

dcmocanu / sparse-evolutionary-artificial-neural-networks

Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).

deep-neural-networks sparsity deep-learning scalability randomization neuroevolution deep-learning-algorithms classification evolutionary-algorithms artificial-neural-networks restricted-boltzmann-machine complex-networks deep-learning-papers multi-layer-perceptron generative-models sparse-neural-networks scalable-deep-learning sparse-training sparse-evolutionary-training adaptive-sparse-connectivity

Updated Jul 21, 2021
Python

nanowell / Q-Sparse-LLM

My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated

machine-learning deep-neural-networks artificial-intelligence transformer deeplearning sparse-neural-networks large-language-models q-sparse

Updated Aug 14, 2024
Python

VITA-Group / SFW-Once-for-All-Pruning

[ICLR 2022] "Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, and No Retraining" by Lu Miao*, Xiaolong Luo*, Tianlong Chen, Wuyang Chen, Dong Liu, Zhangyang Wang

pruning once-and-for-all sparse-neural-networks stochastic-frank-wolfe

Updated Jan 20, 2022
Python

VITA-Group / SMC-Bench

[ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen, Tianjin Huang, AJAY KUMAR JAISWAL, Zhangyang Wang

benchmark sparsity deep-learning pruning sparse-neural-networks dynamic-sparse-training

Updated Aug 29, 2023
Python

Efficient-Scalable-Machine-Learning / EvNN

Event-based neural networks

neural-network cuda pytorch spiking-neural-networks rnn-model sparse-neural-networks efficient-neural-networks

Updated Jul 7, 2024
Python

zahraatashgahi / QuickSelection

[Machine Learning Journal (ECML-PKDD 2022 journal track)] Quick and Robust Feature Selection: the Strength of Energy-efficient Sparse Training for Autoencoders

sparsity deep-learning feature-selection autoencoder dimensionality-reduction denoising-autoencoders sparse-neural-networks sparse-training

Updated Oct 2, 2023
Python

IlanPrice / DCTpS

Code for testing DCT plus Sparse (DCTpS) networks

deep-learning neural-network-compression sparse-neural-networks neural-network-pruning

Updated Jun 15, 2021
Python

lim142857 / Sparsifiner

Demo code for CVPR2023 paper "Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers"

attention-mechanism fast-inference sparse-neural-networks low-rank vision-transformer efficient-transformers sparse-attention efficient-vision-transformers

Updated Jul 4, 2023
Python

GhadaSokar / Dynamic-Sparse-Training-for-Deep-Reinforcement-Learning

[IJCAI 2022] "Dynamic Sparse Training for Deep Reinforcement Learning" by Ghada Sokar, Elena Mocanu , Decebal Constantin Mocanu, Mykola Pechenizkiy, and Peter Stone.

deep-neural-networks sparsity reinforcement-learning deep-learning deep-reinforcement-learning sparse-neural-networks sparse-training continuous-control-tasks

Updated May 13, 2022
Python

bcrafton / ssdfa

Github page for SSDFA

hardware-acceleration backpropagation feedback-alignment sparse-neural-networks bio-plausible-algorithms local-learning

Updated Jan 28, 2020
Python

cambridge-mlg / arch_uncert

Code for "Variational Depth Search in ResNets" (https://arxiv.org/abs/2002.02797)

reproducible-research uncertainty mnist expectation-maximization svhn bayesian-inference variational-inference residual-networks bayesian-neural-networks neural-architecture-search bayesian-deep-learning fashion-mnist reproducible-paper resnets network-compression sparse-neural-networks learnt-depth network-depths

Updated Jun 12, 2020
Jupyter Notebook

GhadaSokar / SpaceNet

Implementation for the paper "SpaceNet: Make Free Space For Continual Learning" in PyTorch.

deep-neural-networks deep-learning incremental-learning sparse-representations brain-inspired continual-learning catastrophic-forgetting sparse-neural-networks sparse-training life-long-learning

Updated Feb 28, 2021
Python

zahraatashgahi / NeuroFS

[TMLR] Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks

python deep-learning keras efficiency high-dimensional-data feature-selection neural-networks sparse-neural-networks sparse-training dynamic-sparse-training

Updated Feb 12, 2023
Python

A-Klass / torch_topkast

PyTorch Implementation of TopKAST

deep-neural-networks sparsity deep-learning sparse-neural-networks sparse-training

Updated Dec 28, 2022
Python

VITA-Group / Peek-a-Boo

[ICLR 2022] "Peek-a-Boo: What (More) is Disguised in a Randomly Weighted Neural Network, and How to Find It Efficiently", by Xiaohan Chen, Jason Zhang and Zhangyang Wang.

deep-learning sparse-neural-networks efficient-deep-learning

Updated Jan 21, 2022
Python

BICLab / RM-SNN

Offical implementation of "Sparser spiking activity can be better: Feature Refine-and-Mask spiking neural network for event-based visual recognition" (Neural Networks 2023)

spiking-neural-networks attention-mechanism sparse-neural-networks

Updated Oct 15, 2023
Python

SurrealVectors / Soevnn

A neural net with a terminal-based testing program.

machine-learning neural-network recurrent-neural-networks neural-networks sparse-neural-networks

Updated Sep 23, 2021
F#

zahraatashgahi / CTRE

[Machine Learning Journal (ECML-PKDD 2022 journal track)] A Brain-inspired Algorithm for Training Highly Sparse Neural Networks

machine-learning sparsity deep-learning classification mlp sparse-neural-networks sparse-training

Updated Feb 20, 2023
Python

elch10 / SignalNeuroHackTasks

Implementation of artcile "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks"

sparse-neural-networks pytorch-implementation conv-lenet-5 lenet-300-100

Updated Jun 12, 2019
Jupyter Notebook

BrosnanYuen / RayBNN_Neural

Neural Networks with Sparse Weights in Rust using GPUs, CPUs, and FPGAs via CUDA, OpenCL, and oneAPI

rust machine-learning cpu deep-learning neural-network gpu opencl machine-learning-algorithms parallel cuda neural-networks sparse-neural-networks sparse-network raybnn

Updated Jun 19, 2024
Rust

Improve this page

Add a description, image, and links to the sparse-neural-networks topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the sparse-neural-networks topic, visit your repo's landing page and select "manage topics."