Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Broken link in the "When to use Puppeteer Scraper" tutorial #1100

Open
honzajavorek opened this issue Jul 19, 2024 · 0 comments
Open

Broken link in the "When to use Puppeteer Scraper" tutorial #1100

honzajavorek opened this issue Jul 19, 2024 · 0 comments
Assignees
Labels
bug Something isn't working. t-academy Issues related to Web Scraping and Apify academies.

Comments

@honzajavorek
Copy link
Collaborator

The following won't work, simply because Maxwell Materials are gone:

Those are similar to the ones above with an important caveat. Once you click the first thing, it usually modifies the page in a way > that causes more clicking to become impossible. We deal with those by scraping the pages one by one, using the pagination "next" button. See Maxwell Materials and use the following selector:

'li.page-item.next a';

Because the URL isn't 404 but only a redirect, this hasn't been caught by a link check, only by a manual check performed based on #953.

@honzajavorek honzajavorek added bug Something isn't working. t-academy Issues related to Web Scraping and Apify academies. labels Jul 19, 2024
@honzajavorek honzajavorek self-assigned this Jul 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working. t-academy Issues related to Web Scraping and Apify academies.
Projects
None yet
Development

No branches or pull requests

1 participant