Error#c4d8810c

RequestError

Proxy responded with 407 Proxy Authentication Required

src/fetchPage.ts › withProxy · google-maps-scraper

Events

611

Users

First seen

Jun 1

Last seen

31m ago

Input

actor run input

{
  "searchStrings": [
    "coffee shop in Berlin",
    "coworking Kreuzberg"
  ],
  "maxCrawledPlaces": 300,
  "maxConcurrency": 10,
  "language": "en",
  "proxy": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  }
}

Stack trace

most recent call first

withProxysrc/fetchPage.ts:39in app

34export async function withProxy(url: string, sessionId: string) {
35  const proxyUrl = await proxyConfiguration.newUrl(sessionId);
36  const response = await gotScraping({ url, proxyUrl });
37 
38  if (response.statusCode === 407) {
39    throw new RequestError('Proxy authentication failed', response);
40  }
41 
42  return response.body;
43}

gotScrapingnode_modules/got-scraping/index.js:410

crawlsrc/main.ts:71in app

66const crawler = new BasicCrawler({
67  maxConcurrency: input.maxConcurrency ?? 10,
68  async requestHandler({ request, log }) {
69    const sessionId = `maps-${request.uniqueKey}`;
70    log.info(`Fetching ${request.url}`);
71    const html = await withProxy(request.url, sessionId);
72    const place = parsePlace(html);
73    await Dataset.pushData(place);
74  },
75});

Breadcrumbs

leading up to the error

httpGET /maps/place/… → 407 via RESIDENTIAL−0s
apifyrotated proxy session sess_91ad−2s
httpGET /maps/place/… → 407 via RESIDENTIAL−5s

RequestError

Tags

Input

Stack trace

Breadcrumbs