A button that moves all colors extracted from the image using patches into the palette would be very useful, preferably with an option to replace the existing colors in the palette.
Seems like quite a good idea.