Bug: timeout is documented/treated as milliseconds in the scrape_url method of the FirecrawlApp object, but the SDK forwards it directly to requests.post (timeout=...), which expects seconds.

When providing a non-existing url to the scrape endpoint I get the following message: Failed to scrape URL. Status code: 500. Error: (Internal server error) - DNS resolution failed for hostname: co ...

The IAB Tech Lab's new initiative suggests regulations for how AI bots can access content, ensuring that publishers are fairly compensated.