neuron-death
PyTorch/335 runs/MIT
Do the methods that revive dormant neurons work by reviving dead ones? Analysis-only study of continual learning, with the analysis plan frozen before any data existed. Its control is the missing one: at every recycling event, recycle the same number of units chosen at random. Random selection recovers most of the benefit, and units left alone come back by themselves.