add brotli as a dependency

[BurnzZ]

Resolves #29

• bumped a dep to be at least aiohttp >= 3.7.3 since Brotli replaced the old brotlipy dep which was unmaintained.
  https://docs.aiohttp.org/en/stable/changes.html?highlight=brotli#id12
• Needed to add a small code to insert the br headers since the version with Brotli client support is not yet released.
  aio-libs/aiohttp@28ea32d
  • Brotli decompression is fully supported, however.

We don't have automated tests that's set up yet, but I've tested this manually that:

• It sends 'Accept-Encoding': 'br' when brotli is installed.
• It decompresses the response without any problem when 'Content-Encoding': 'br' is received.

[codecov-commenter]

Codecov Report

Merging #31 (eaf9208) into main (dd5e9f8) will not change coverage.
The diff coverage is 0.00%.

Additional details and impacted files

@@           Coverage Diff           @@
##             main      #31   +/-   ##
=======================================
  Coverage   38.04%   38.04%           
=======================================
  Files          10       10           
  Lines         347      347           
  Branches       46       46           
=======================================
  Hits          132      132           
  Misses        215      215           

Impacted Files	Coverage Δ
zyte_api/aio/client.py	27.39% <0.00%> (ø)

[kmike]

Thanks @BurnzZ! The changes look good to me.

Before merging, could you please double-check that the responses are indeed compressed?

[BurnzZ]

Before merging, could you please double-check that the responses are indeed compressed?

Manually confirmed that the responses are compressed. 👍

[Gallaecio]

I think we should be doing this even after that commit is released, i.e. we should always set Accept-Encoding to br, and not to gzip, deflate, br.

Also, since we are requiring brotli as a dependency, using HAS_BROTLI should not be needed.

[BurnzZ]

You're right. 👍 Updated!

[kmike]

I think previously it was fine as well - e.g. in an unlikely event that aiohttp's HAS_BROTLI logic would become different from "brotli library is installed", the code would still have worked, although with gzip instead of brotli.

[kmike]

Feel free to merge it though, it's not a big deal.