permanent login session across requests

[ArmandoSchiano]

Hello, I need to fetch some informations from a webpage which are available only after I logged in. I am reading the documentation and found this code for logging in:

from scrapling.fetchers import Fetcher

# Submit login form
response = Fetcher.post(
    'https://example.com/login',
    data={
        'username': 'user@example.com',
        'password': 'password123'
    }
)

# Check login success
if response.status == 200:
    # Extract user info
    user_name = response.css_first('.user-name::text')
    print(f"Logged in as: {user_name}")

However, it is not entirely clear to me how that login response could be used later with other session methods as StealthySession to fetch informations

with StealthySession(
                headless=headless,
                geoip=geoip,
                os_randomize=os_randomize,
                solve_cloudflare=solve_cloudflare,
                timeout=timeout,
                selector_config=custom_config
        ) as session:
            pages = session.fetch(target_url),

        if not pages or len(pages) == 0:
            return json.dumps({
                'status': 'error',
                'message': 'Failed to fetch the page',
                'url': target_url,
                "http_status_code": 500
            })

        page = pages[0]

Could you please provide me some help about it?

Best

[D4Vinci]

There's the FetcherSession class

[ArmandoSchiano]

Hi, thanks for the reply. However, it is still unclear to me how to use this class. Here is what I see from the documentation

from scrapling.fetchers import FetcherSession

# Create a session with default configuration
with FetcherSession(
    impersonate='chrome',
    http3=True,
    stealthy_headers=True,
    timeout=30,
    retries=3
) as session:
    # Make multiple requests with the same settings
    page1 = session.get('https://scrapling.requestcatcher.com/get')
    page2 = session.post('https://scrapling.requestcatcher.com/post', data={'key': 'value'})
    page3 = session.get('https://api.github.com/events')

    # All requests share the same session and connection pool

Say the login page is https://fakeloginpage.com: how do I pass the session created after logging in into this page to the FetcherSession params?

[D4Vinci]

It will be something like this:

from scrapling.fetchers import FetcherSession

with FetcherSession(impersonate='chrome', http3=True, stealthy_headers=True, timeout=30,  retries=3) as session:
    page1 = session.post('https://example.com/login', data={'username': 'user@example.com', 'password': 'password123'})
    page2 = session.get('https://example.com/after-login')