Uploading coverage fails, this then blocks PRs

[DonJayamanne]

@rchiodo Ok, agreed, its a problem.

https://dev.azure.com/ms/vscode-python/_build/results?buildId=22172&view=logs

[DonJayamanne]

Related issues:

• Error on Travis after update nickmerwin/node-coveralls#80
• Coverage randomly failing in travis, have to manually re-start builds for it to succeed lemurheavy/coveralls-public#750

[DonJayamanne]

Suggestions

Looks like this has been going on for years.

• How about we upload coverage back to codecov.io as well.
• Ensure uploads are allowed to fail (don't fail CI)
• After a month or so, review stability of codecov vs coveralls, and pick the better one...
• Worst case scenario, drop both (we have Azdo) or look for alternatives

All we need to do is modify one task in the yml file to make the changes, or add a new coverage tool

[rchiodo]

Codecov.io is the old one? I'd say not fail the CI is the first step, then look for other solutions.

[DonJayamanne]

Agreed,

Proposed First step Solution

• Not fail the CI is the first step, then look for other solutions.

Set continueOnError to true for the bash: cat ./coverage/lcov.info | ./node_modules/coveralls/bin/coveralls.js job in generate_upload_coverage.yml

    - bash: cat ./coverage/lcov.info | ./node_modules/coveralls/bin/coveralls.js
      displayName: 'Upload coverage to coveralls'
      continueOnError: true
      condition: contains(variables['TestsToRun'], 'testUnitTests')