The root cause here was that we weren't setting the language version in MSBuild, which is only for the command line version. (cherry picked from commit 319e31f71a150e9b0d91e724f0e358390caec4c2)