Follow up from discussions in #13323. This is essentially a placeholder so that the ideas from there do not get lost. The target state is described in https://github.com/matplotlib/matplotlib/pull/13323#issuecomment-463436655 and following comments.