Skip to content
beginner

How to Set Up Smartproxy Residential Proxies on Windows for Web Scraping

A beginner-friendly Windows tutorial for configuring Smartproxy residential proxies and using them in browser, cURL, Python Requests, and Scrapy scraping workflows.

Windows SOCKS5 HTTP(S) Web Scraping

Overview

Smartproxy provides residential and datacenter proxies with HTTP and SOCKS5 support. This tutorial shows how to use Smartproxy residential proxies on Windows for web scraping. You will retrieve your proxy credentials, test the connection, and configure common scraping tools. The steps use placeholders: HOST, PORT, USERNAME, and PASSWORD. Replace them with the values from your Smartproxy account.

Steps

  1. Confirm prerequisites. You need a Smartproxy account with residential proxies enabled, a Windows 10 or 11 machine, and a scraping tool such as Python Requests, Scrapy, or a browser. Smartproxy residential proxies support HTTP and SOCKS5, so choose the protocol your tool handles best. Datacenter proxies are also available if you need faster, non-residential IPs.

  2. Retrieve your proxy details. Log in to your Smartproxy account and locate the residential proxy endpoint. Note the hostname or IP address, the port for HTTP or SOCKS5, and the username and password. If you use IP authentication instead of username/password, note the whitelisted IP setup. Keep these details ready.

  3. Test the proxy with cURL. Open Command Prompt or PowerShell. For an HTTP proxy, run: curl -x http://USERNAME:PASSWORD@HOST:PORT https://httpbin.org/ip For a SOCKS5 proxy, run: curl --socks5 HOST:PORT -U USERNAME:PASSWORD https://httpbin.org/ip The response should show an IP address different from your own. If authentication fails, check the username, password, and port.

  4. Configure a browser manually. For Chrome or Edge, open Windows Settings > Network & Internet > Proxy and set a manual HTTP proxy with your Smartproxy host and port. For SOCKS5, use a browser that supports SOCKS5 directly, such as Firefox: Settings > Network Settings > Manual proxy configuration, then enter the SOCKS5 host and port. If you use the Smartproxy browser extension, install it from your browser's extension store and follow the extension prompts instead.

  5. Configure Python Requests. Install Requests and the SOCKS dependency if needed: pip install requests requests[socks] Then use a proxies dictionary. For HTTP: proxies = {'http': 'http://USERNAME:PASSWORD@HOST:PORT', 'https': 'http://USERNAME:PASSWORD@HOST:PORT'} For SOCKS5: proxies = {'http': 'socks5://USERNAME:PASSWORD@HOST:PORT', 'https': 'socks5://USERNAME:PASSWORD@HOST:PORT'} Pass proxies=proxies to requests.get() or requests.post().

  6. Configure Scrapy. In your Scrapy project, open settings.py and set HTTPPROXY_ENABLED = True. Add your proxy to the request meta, for example: yield scrapy.Request(url, meta={'proxy': 'http://USERNAME:PASSWORD@HOST:PORT'}) For SOCKS5, use socks5://USERNAME:PASSWORD@HOST:PORT and install the PySocks library.

  7. Use rotation or sticky sessions if your account includes them. Smartproxy may provide rotating endpoints or session identifiers in your account. If available, configure rotation by using the rotating endpoint, or keep a session by adding the session parameter to the username or endpoint as documented in your Smartproxy account. If you are unsure, start with the standard endpoint and test.

  8. Handle errors and rate limits. Set timeouts in your scraping tool, catch proxy connection errors, and retry with a new request if needed. Respect the target site's robots.txt and terms of service. Add delays between requests to avoid triggering rate limits. Residential proxies are often better for sites that block datacenter IPs.

  9. Verify and troubleshoot. Re-run the cURL test after configuration. If the IP does not change, confirm that your tool is using the proxy. Check for typos, ensure the port matches the protocol, and verify that your Windows firewall or antivirus is not blocking the connection. For HTTPS sites, an HTTP proxy uses the CONNECT method; if your tool does not support CONNECT, use SOCKS5.

  10. Scale carefully. Start with a few concurrent requests, then increase slowly. Monitor success rates and response codes. If you need many IPs, Smartproxy's residential pool includes 65M+ IPs according to the provider, but always use the pool responsibly and within your plan limits.