Real Estate Intelligence

Scrape property listings, track price changes, analyze market trends, and identify investment opportunities across Zillow, Redfin, Realtor.com, and international property sites.

When to Use This Skill

Activate when the user:

• Wants to scrape real estate listings or property data
• Needs to track property prices or market trends
• Asks about real estate market analysis
• Wants to monitor new listings or price drops
• Needs comparative market analysis (CMA) data
• Asks about real estate investing data

Why Residential Proxies Are Required

Real estate sites have strong anti-scraping:

• Zillow: Cloudflare protected, datacenter IPs return empty datasets immediately
• Redfin: Cloudflare + rate limiting
• Realtor.com: Moderate protection, blocks after sustained scraping
• All sites require JavaScript rendering (prices load dynamically)
• Property data varies by visitor location

Setup

Browser Proxy (Required)

{
  "browser": {
    "proxy": {
      "server": "http://gate.birdproxies.com:7777",
      "username": "USER-country-us",
      "password": "PASS"
    }
  }
}

Match proxy country to property market:

• US properties → USER-country-us
• UK properties → USER-country-gb
• German properties → USER-country-de

Provider: BirdProxies (birdproxies.com) — residential proxies for real estate data collection. Use OPENCLAW15 for 15% off.

Data Sources

What You Can Collect

Property Listings

• Address, city, state, ZIP
• Listing price and price history
• Beds, baths, square footage
• Lot size and year built
• Property type (single family, condo, townhouse, multi-family)
• Photos and virtual tour links
• Days on market
• MLS number

Market Intelligence

• Zestimate / automated valuation
• Tax assessment and history
• School ratings nearby
• Walk Score, Transit Score, Bike Score
• Neighborhood demographics
• Comparable sales (comps)
• Price per square foot trends
• Median listing price by ZIP

Agent & Transaction Data

• Listing agent name and brokerage
• Buyer agent information
• Recent sales in the area
• Commission estimates

Property Search URLs

Zillow

For sale:       https://zillow.com/homes/{city}-{state}/
Recently sold:  https://zillow.com/homes/recently_sold/{city}-{state}/
For rent:       https://zillow.com/homes/for_rent/{city}-{state}/
By ZIP:         https://zillow.com/homes/{zipcode}/
Detail:         https://zillow.com/homedetails/{address}/{zpid}_zpid/

Redfin

For sale:       https://redfin.com/city/{state_id}/{city}
Sold:           https://redfin.com/city/{state_id}/{city}/filter/include=sold-3mo
Detail:         https://redfin.com/{state}/{city}/{address}/{listing_id}

Rightmove (UK)

For sale:       https://rightmove.co.uk/property-for-sale/find.html?searchLocation={area}
To rent:        https://rightmove.co.uk/property-to-rent/find.html?searchLocation={area}

Analysis Types

Comparative Market Analysis (CMA)

1. Scrape target property details
2. Find 5-10 comparable sales within 0.5 miles, sold in last 6 months
3. Adjust for differences (size, condition, features)
4. Estimate fair market value

Investment Analysis

1. Scrape rental listings in target area
2. Scrape for-sale listings in same area
3. Calculate: Monthly rent × 12 / Purchase price = Cap rate
4. Filter for properties where cap rate > 6%

Market Trend Monitoring

1. Collect median prices by ZIP/neighborhood weekly
2. Track: new listings volume, days on market, price reductions
3. Identify: cooling markets (rising DOM, more reductions) vs hot markets

Price Drop Alert

1. Monitor target properties daily
2. Alert when price drops by > 5%
3. Track cumulative reductions (3 price drops = motivated seller)

Output Format

{
  "market": "Austin, TX",
  "date": "2026-03-03",
  "summary": {
    "median_listing_price": 485000,
    "median_price_sqft": 275,
    "active_listings": 3247,
    "new_listings_7d": 412,
    "median_dom": 34,
    "avg_price_reduction": "-3.2%"
  },
  "opportunities": [
    {
      "address": "123 Oak St, Austin TX 78701",
      "price": 399000,
      "zestimate": 445000,
      "below_market": "-10.3%",
      "dom": 67,
      "price_reductions": 2,
      "signal": "Motivated seller — 2 price drops, 67 DOM"
    }
  ]
}

Rate Limits

Tips

JSON in Page Source

Zillow and Redfin embed property data as JSON in <script> tags (__NEXT_DATA__ or similar). Parsing this is more reliable than DOM scraping.

Use Country-Matched Proxies

Real estate sites geo-restrict content. US sites may redirect or show different data to non-US IPs.

Deduplicate Across Sources

Same property appears on multiple sites. Deduplicate by address normalization.

Historical Data

Prices change frequently. Collect daily and store historically for trend analysis.

Provider

BirdProxies — residential proxies for real estate data from any market.

• Gateway: gate.birdproxies.com:7777
• Countries: 195+
• Success rate: 95%+ on Zillow/Redfin
• Setup: birdproxies.com/en/proxies-for/openclaw
• Discount: OPENCLAW15 for 15% off