I'd welcome a small preview window when selecting files in the file chooser.
Krita has two options for the file dialogs: the platform native one and the Qt cross-platform one. The Qt one has no previews, whether the platform native one has previews is up to the platform. We cannot do anything about that, except writing our own file dialog, which is not going to happen.