Outline and breadcrumbs only partially working when diffing

When diffing two XML files the breadcrumbs only show the location in the target / new / right hand side file.
If you put the cursor on the other file then the breadcrumbs are not updated anymore.

The outline pane is completely empty.

I think this is a limitation/bug of VS Code. I tried this out with two JavaScript files and it works the same way there.