Code

Sync new Zyte API features#218

Code

Draft

Gallaecio wants to merge 23 commits intoscrapy-plugins:mainscrapy-plugins/scrapy-zyte-api:mainfrom Gallaecio:serpGallaecio/scrapy-zyte-api:serpCopy head branch name to clipboard

+585-166

Commits

Commits on Aug 1, 2024

• Update parameter mapping

  Gallaecio

  committed
  9035490

  Copy full SHA for 9035490

Commits on Aug 6, 2024

• Refactor param mapping and URL fragment fingerprinting logic

  Gallaecio

  committed
  dc5ad01

  Copy full SHA for dc5ad01

• Do not use Literal with an object()

  Gallaecio

  committed
  c6e759e

  Copy full SHA for c6e759e

• Cover request fingerprinting changes due to new mappings

  Gallaecio

  committed
  29e8db0

  Copy full SHA for 29e8db0

• Cover in the changelog that sessionContextParameters now changes fingerprints

  Gallaecio

  committed
  5d21147

  Copy full SHA for 5d21147

Commits on Aug 19, 2024

• WIP

  Gallaecio

  committed
  137fdf1

  Copy full SHA for 137fdf1

Commits on Nov 4, 2024

• Fix docs

  Gallaecio

  committed
  c1e4a68

  Copy full SHA for c1e4a68

• Remove an unused import

  Gallaecio

  committed
  97ec517

  Copy full SHA for 97ec517

• Fix test_auto_pages_set

  Gallaecio

  committed
  2ce4c63

  Copy full SHA for 2ce4c63

Commits on Nov 5, 2024

• Merge remote-tracking branch 'scrapy-plugins/main' into serp

  Gallaecio

  committed
  662c2bf

  Copy full SHA for 662c2bf

Commits on Nov 15, 2024

• Merge remote-tracking branch 'scrapy-plugins/main' into serp

  Gallaecio

  committed
  d9d7239

  Copy full SHA for d9d7239

• Fix _may_use_browser()’s random return value

  Gallaecio

  committed
  77335e1

  Copy full SHA for 77335e1

• Update URL fragment fingerprinting expectations: when in doubt, assume browser

  Gallaecio

  committed
  b89aa87

  Copy full SHA for b89aa87

Commits on Nov 28, 2024

• Move test_params into test_request_fingerprinter, and complete patch coverage

  Gallaecio

  committed
  0e853f4

  Copy full SHA for 0e853f4

• Map new Zyte API params

  Gallaecio

  committed
  a4aff9c

  Copy full SHA for a4aff9c

• Add a test for default values

  Gallaecio

  committed
  b290a02

  Copy full SHA for b290a02

• Minor doc fixes

  Gallaecio

  committed
  b299d29

  Copy full SHA for b299d29

• Update test expectations and add new scenarios

  Gallaecio

  committed
  ada9316

  Copy full SHA for ada9316

• Address issues detected during a self-review of all changes so far

  Gallaecio

  committed
  702ca6e

  Copy full SHA for 702ca6e

• Improve test coverage

  Gallaecio

  committed
  0d8c30a

  Copy full SHA for 0d8c30a

Commits on Nov 29, 2024

• Merge remote-tracking branch 'scrapy-plugins/main' into serp

  Gallaecio

  committed
  3818a1f

  Copy full SHA for 3818a1f

• Address typing issues

  Gallaecio

  committed
  d756c39

  Copy full SHA for d756c39

• Test the effect of session initialization params on request fingerprinting (some safe scenarios)

  Gallaecio

  committed
  16686da

  Copy full SHA for 16686da