Browser support would be greatly appreciated, since it's easy to forward some ports and do the processing on a beefy machine while viewing the results on a laptop. Folks at rerun seem to have it figured out, but their backend is in Rust if I'm not mistaken, so they might be using WASM for web support

here's a screenshot of an error I get when trying to run this example. Other ones result in similar errors.
Javascript error logs

[Open Browser Console for more detailed log - Double click to close this message]
Failed to load model class 'RemoteFrameBufferModel' from module 'jupyter_rfb'
Error: No version of module jupyter_rfb is registered
    at WidgetManager.loadClass (https://vscode-remote+ssh-002dremote-002bbrr.vscode-resource.vscode-cdn.net/home/user/.vscode-server/extensions/ms-toolsai.jupyter-renderers-1.1.0/out/node_modules/%40vscode/jupyter-ipywidgets8/dist/ipywidgets.js:2:2420023)
...
    ```

ah yes you get that JS error if you have the python lib jupyter-rfb installed but it's unable to find the JS widget, I'm not sure how to solve this for vscode, I don't know where it fetches the JS widget code. I posted this in vispy/jupyter_rfb#115 you can followup in that issue.

@wolterlw

Browser support would be greatly appreciated, since it's easy to forward some ports and do the processing on a beefy machine while viewing the results on a laptop

Yes I use it like this regularly but with jupyterlab, not vscode. You have to make sure jupyter-rfb is installed in the same environment that you launch the jupyterlab kernel from.

would this work with ssh forwarding?

You could use x-forwarding but it's generally very slow compared to jupyter-rfb