Run/debug multiple single file programs with the same name #1645

I have a folder structure where each example lives inside a folder with a single java file that is always named Solution.java. Problem is that because classes are cached I have to manually clean cache before executing 2nd, 3rd, ... example, is there a way to configure VS Code to support such case, without changing folder structure and file names?

Launch configuration:

{
      "name": "Java",
      "type": "java",
      "request": "launch",
      "mainClass": "${file}",
      "cwd": "${fileDirname}"
    }

Folder structure:

root/
  example1/
    Solution.java
  example2/
    Solution.java