drop pytorch:20.03-py3 tests

[wyli]

Is your feature request related to a problem? Please describe.
for two reasons:

• it defaults to py3.6 which is not supported now
• pip install pylint doesn't work