You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This release brings the long awaited HTTP2 capabilities to requestAsBrowser. It could make HTTP2 requests even before, but it was not very helpful in making browser-like ones. This is very important for disguising as a browser and reduction in the number of blocked requests. requestAsBrowser now uses got-scraping.
The most important new feature is that the full set of headers requestAsBrowser uses will now be generated using live data about browser headers that we collect. This means that the "header fingeprint" will always match existing browsers and should be indistinguishable from a real browser request. The header sets will be automatically rotated for you to further reduce the chances of blocking.
We also switched the default HTTP version from 1 to 2 in requestAsBrowser. We don't expect this change to be breaking, and we took precautions, but we're aware that there are always some edge cases, so please let us know if it causes trouble for you.
Full list of changes:
Replace the underlying HTTP client of utils.requestAsBrowser() with got-scraping.
Make useHttp2true by default with utils.requestAsBrowser().
Fix Apify.call() failing with empty OUTPUT.
Update puppeteer to 8.0.0 and playwright to 1.10.0 with Chromium 90 in Docker images.
Update @apify/ps-tree to support Windows better.
Update @apify/storage-local to support Node.js 16 prebuilds.
This discussion was created from the release v1.2.0.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
This release brings the long awaited HTTP2 capabilities to
requestAsBrowser
. It could make HTTP2 requests even before, but it was not very helpful in making browser-like ones. This is very important for disguising as a browser and reduction in the number of blocked requests.requestAsBrowser
now usesgot-scraping
.The most important new feature is that the full set of headers
requestAsBrowser
uses will now be generated using live data about browser headers that we collect. This means that the "header fingeprint" will always match existing browsers and should be indistinguishable from a real browser request. The header sets will be automatically rotated for you to further reduce the chances of blocking.We also switched the default HTTP version from 1 to 2 in
requestAsBrowser
. We don't expect this change to be breaking, and we took precautions, but we're aware that there are always some edge cases, so please let us know if it causes trouble for you.Full list of changes:
utils.requestAsBrowser()
withgot-scraping
.useHttp2
true
by default withutils.requestAsBrowser()
.Apify.call()
failing with emptyOUTPUT
.puppeteer
to8.0.0
andplaywright
to1.10.0
with Chromium 90 in Docker images.@apify/ps-tree
to support Windows better.@apify/storage-local
to support Node.js 16 prebuilds.This discussion was created from the release v1.2.0.
Beta Was this translation helpful? Give feedback.
All reactions