Using a different font family than Noto Sans or different sizes results in unexpected scaling changes that affect Kickoff, notifications and other parts of the UI. Apart from that, the issue prevents from using any other DPI setting than X11's default 96. I attach a number of screenshots which show how the scaling may change depending on user's settings.
Created attachment 113195 [details] Case #1, Roboto 10
Created attachment 113196 [details] Case #1, Roboto 11
Created attachment 113197 [details] Case #2, Kickoff, Noto Sans
Created attachment 113198 [details] Case #2, Kickoff, Zilla Slab (same size)
Created attachment 113199 [details] Case #2, Kickoff, Catamaran (same size)
Created attachment 113200 [details] Case #2, notification, Noto Sans
Created attachment 113201 [details] Case #2, notification, Zilla Slab (same size)
Created attachment 113202 [details] Case #2, notification, Catamaran (same size)
The first screenshot in each series shows the expected UI scaling.
This is pretty much intentional, to ensure that the relative proportions of the UI remain the same as the font is changed. It breaks down if you crank the font too high, after which point it would make more sense to use a scale factor to make things bigger or smaller. The Fonts KCM now advises you to do this if you try. :) Sadly it's true that there can be minor bugs introduced based on the metrics of the fonts; for example 11pt Noto Sans is 22% bigger than 10pt Noto Sans, not 10% bigger as yo would expect. As a result going to 11pt Noto Sans makes everything enormous. This is a bug in Noto Sans itself, sadly. See Bug 431947 for details. Those issues should be tracked separately though.