AdsCrawl for Puppeteer

SETUP METHOD 01

Remote CDP

Discover the WebSocket endpoint with client.cdp.getVersion before puppeteer.connect.

1. 1

   Install the clients

   The core package connects to a remote browser; no local Chromium download is needed for this example.

   ShellCopy

   npm install adscrawl puppeteer-core

2. 2

   Set the API key

   Set ADSCRAWL_API_KEY in the environment of the process running your client. Keep it out of browser code and source control.

3. 3

   Connect, read and clean up

   Run as a Node.js ES module. The example reads the page title and uses finally to request session closure even if navigation fails.

   JavaScriptCopy

   import puppeteer from 'puppeteer-core';
   import AdsCrawl from 'adscrawl';
   
   const client = new AdsCrawl();
   const session = await client.cdp.create();
   try {
     const version = await client.cdp.getVersion(session);
     const browser = await puppeteer.connect({
       browserWSEndpoint: version.webSocketDebuggerUrl,
     });
     try {
       const pages = await browser.pages();
       const page = pages[0] ?? await browser.newPage();
       await page.goto('https://example.com');
       console.log(await page.title());
     } finally {
       browser.disconnect();
     }
   } finally {
     await client.cdp.close(session.sessionId);
   }