Channel-Remix
Build compact task-specific models by selecting and sparsely recombining pretrained channels instead of relearning new weight directions.
How I used these tools
I learn sparse combinations of pretrained channels for a target task, then fold the mixing coefficients into ordinary model weights. Experiments cover vision models and VLM image encoders.
I measured adaptation time on an NVIDIA RTX PRO 6000 GPU.