How to send a cookie to authenticate with Crawlee (Apify)

Question

From the documentation I can read only a function for saving

optionalpersistCookiesPerSession persistCookiesPerSession?: boolean Inherited from HttpCrawlerOptions.persistCookiesPerSession

Automatically saves cookies to Session. Works only if Session Pool is used.

It parses cookie from response “set-cookie” header saves or updates cookies for session and once the session is used for next request. It passes the “Cookie” header to the request with the session cookies.

But I just want to send the cookies stored in json file already.

searching for examples, I can't find any proper

Answer 1

Had the same problem and here is the answer:

import cookies from './cookies.json' assert { type: "json" }

...

const crawler = new PlaywrightCrawler({
    preNavigationHooks: [
        async (crawlingContext, gotoOptions) => {
            crawlingContext.page.context().addCookies(cookies)
        },
    ],

You can use this extension to gather the cookies first: EditThisCookie

Hope that helps.