veriglow-agent-map

VeriGlow Agent Map

VeriGlow Agent Map is a registry of Agent-readable documentation for websites. Each "map" tells you exactly how to extract structured data from a specific web page — including hidden APIs, request parameters, response schemas, browser automation recipes, and real-world agent reports.

When to Use This Skill

Use Agent Map when you need to:

• Get structured data from a website (financial data, government data, e-commerce, etc.)
• Discover hidden/internal APIs behind a web page
• Automate browser interactions with a specific site
• Check if other agents have successfully used a data source

How to Query Agent Map

To look up a map for any URL, visit:

https://veri-glow.com/{target-url-without-protocol}

For example, to find the map for https://www.sse.com.cn/market/bonddata/overview/day/:

https://veri-glow.com/www.sse.com.cn/market/bonddata/overview/day/

You can also fetch the page content programmatically:

curl https://veri-glow.com/www.sse.com.cn/market/bonddata/overview/day/

What a Map Contains

Each Agent Map page has three sections:

1. Available Data

Documents every data function the page exposes:

• API endpoint (method, URL, parameters)
• Request example (curl command you can run directly)
• Response schema (column names, types, examples)
• Caveats (rate limits, IP restrictions, data freshness)

2. Page Internals

For browser automation fallback:

• JS controller objects and trigger methods
• DOM selectors for data tables and input fields
• Rendering method (server-side vs client-side)
• Auth and anti-scraping status
• Complete action steps (Playwright/Puppeteer recipe)

3. Agent Reports

Real-world usage reports from agents who have called this data source:

• Success/failure status and response times
• Edge cases discovered (half-day trading, IP blocks, etc.)
• Recommended workarounds

Example: SSE Bond Trading Data

Here is a complete example of using an Agent Map to get Shanghai Stock Exchange bond trading data.

Direct API Call (Preferred)

curl "https://www.sse.com.cn/js/common/sseBond498Fixed.js?searchDate=2025-02-11"

Parameters:

Name	Type	Required	Description
searchDate	string	Yes	Query date in YYYY-MM-DD format
jsonCallBack	string	No	JSONP callback name. Omit for pure JSON.

Returns: JSON with 17 rows × 4 columns:

Column	Type	Example	Description
债券品种	string	国债	Bond type category
成交笔数	number	15,234	Number of trades
成交面额(亿元)	number	2,068.77	Face value traded (100M RMB)
成交金额(亿元)	number	2,087.45	Trading amount (100M RMB)

Bond types (17 categories): 国债, 地方政府债, 企业债, 公司债, 可转换债, 可分离债, 资产支持证券, 国际机构债, 政策性金融债, 同业存单, and more.

Caveats:

• Non-trading days (weekends, holidays) return all-zero rows
• Data availability: T+1, updated ~1 hour after market close (15:30 CST)
• Overseas IP may get 403 — use a CN-based proxy if needed

Browser Automation Fallback

If the direct API is blocked, use these action steps:

// Step 1: Set date
document.querySelector('.js_date input').value = '2025-02-11'

// Step 2: Trigger query (wait 3s for AJAX response)
overviewDay.setOverviewDayParams()

// Step 3: Extract table
const table = document.querySelector('.table-responsive table')
const headers = [...table.querySelectorAll('thead th')].map(th => th.textContent.trim())
const rows = [...table.querySelectorAll('tbody tr')].map(tr =>
  [...tr.querySelectorAll('td')].map(td => td.textContent.trim())
)

Best Practices

1. Always prefer direct API calls over browser automation — they are faster and more reliable
2. Check the Agent Reports section before calling a new data source — other agents may have documented edge cases
3. Respect rate limits — if a map documents rate limiting, throttle your requests accordingly
4. Handle IP restrictions — some Chinese government/financial data sources block overseas IPs; use a CN proxy when noted
5. Verify data freshness — check the "Data availability" note for each source (e.g., T+1 means data is from the previous trading day)

Example: FRED Economic Data

Here is an example of using Agent Map to get US 10-Year Treasury yield data from FRED.

Direct API Call

curl "https://api.stlouisfed.org/fred/series/observations?series_id=DGS10&observation_start=2025-03-01&observation_end=2026-03-14&api_key=YOUR_API_KEY&file_type=json"

Parameters:

Name	Type	Required	Description
series_id	string	Yes	FRED series ID (e.g. GDP, DGS10, CPIAUCSL, FEDFUNDS)
api_key	string	Yes	Free API key from https://fred.stlouisfed.org/docs/api/api_key.html
file_type	string	Yes	Always json
observation_start	string	No	Start date YYYY-MM-DD
observation_end	string	No	End date YYYY-MM-DD
frequency	string	No	Aggregation: d, w, m, q, a
units	string	No	Transform: lin (levels), pch (% change), log

Returns: JSON with observations array of date-value pairs:

{
  "observations": [
    {"date": "2025-03-03", "value": "4.24"},
    {"date": "2025-03-04", "value": "4.18"},
    {"date": "2025-03-05", "value": "4.26"}
  ]
}

Key FRED Series: GDP, CPIAUCSL (CPI), FEDFUNDS (Fed Funds Rate), DGS10 (10Y Treasury), DGS2 (2Y Treasury), T10Y2Y (10Y-2Y Spread), UNRATE (Unemployment), M2SL (M2 Money Supply), DEXUSEU (USD/EUR), VIXCLS (VIX).

Caveats:

• Free API key required — register at https://fred.stlouisfed.org/docs/api/api_key.html
• Rate limit: ~120 requests/minute
• Daily series return '.' for weekends/holidays (not null)
• No IP restrictions

Available Maps (65 data sources)

Currently indexed: 55 Shanghai Stock Exchange pages + 6 FRED endpoints + 4 international APIs.

Shanghai Stock Exchange (上海证券交易所) — 55 maps

Stock Data (股票数据):

Source	URL	Functions
Market Overview	www.sse.com.cn/market/view/	1
Statistics Overview	www.sse.com.cn/market/stockdata/statistic/	1
Stock Weekly Overview	www.sse.com.cn/market/stockdata/overview/weekly/	1
Stock Monthly Overview	www.sse.com.cn/market/stockdata/overview/monthly/	1
IPO First-Day Performance	www.sse.com.cn/market/stockdata/firstday/	1
IPO (Initial Public Offering)	www.sse.com.cn/market/stockdata/raise/ipo/	1
Secondary Offering	www.sse.com.cn/market/stockdata/raise/additional/	1
Rights Issue	www.sse.com.cn/market/stockdata/raise/allotment/	1
Share Capital Overview	www.sse.com.cn/market/stockdata/structure/overview/	3
Share Capital Ranking	www.sse.com.cn/market/stockdata/structure/rank/	1
Cash Dividends	www.sse.com.cn/market/stockdata/dividends/dividend/	1
Bonus Shares	www.sse.com.cn/market/stockdata/dividends/bonus/	1
Shanghai Market P/E Ratio	www.sse.com.cn/market/stockdata/price/sh/	1
Main Board Market Cap Ranking	www.sse.com.cn/market/stockdata/marketvalue/main/	1
STAR Market Market Cap Ranking	www.sse.com.cn/market/stockdata/marketvalue/star/	1
Main Board Trading Activity	www.sse.com.cn/market/stockdata/activity/main/	1
STAR Market Trading Activity	www.sse.com.cn/market/stockdata/activity/star/	1
Preferred Share Statistics	www.sse.com.cn/market/stockdata/pshare/	1

Index Data (指数):

Source	URL	Functions
Key Index & Sample Performance	www.sse.com.cn/market/sseindex/overview/focus/	1
Index Basic Information	www.sse.com.cn/market/sseindex/indexlist/basic/	4
Index Quotation	www.sse.com.cn/market/sseindex/quotation/	1

Fund Data (基金数据):

Source	URL	Functions
Fund Daily Overview	www.sse.com.cn/market/funddata/overview/day/	1
Fund Weekly Overview	www.sse.com.cn/market/funddata/overview/weekly/	1
Fund Monthly Overview	www.sse.com.cn/market/funddata/overview/monthly/	1
Fund Annual Overview	www.sse.com.cn/market/funddata/overview/yearly/	1
Public REITs Scale	www.sse.com.cn/market/funddata/volumn/reits/	1
LOF Scale	www.sse.com.cn/market/funddata/volumn/lofvolumn/	2
Graded LOF Fund Scale	www.sse.com.cn/market/funddata/volumn/fjlofvolumn/	1

Bond Data (债券数据):

Source	URL	Functions
Bond Daily Overview	www.sse.com.cn/market/bonddata/overview/day/	1
Bond Weekly Overview	www.sse.com.cn/market/bonddata/overview/weekly/	1
Bond Monthly Overview	www.sse.com.cn/market/bonddata/overview/monthly/	1
Bond Annual Overview	www.sse.com.cn/market/bonddata/overview/yearly/	1
Bond Statistics	www.sse.com.cn/market/bonddata/statistic/	1
Convertible Bond Trading	www.sse.com.cn/market/bonddata/dxkzzcj/	1
Exchangeable Bond Conversion	www.sse.com.cn/market/bonddata/exchangeable/	2
Bond Yield Statistics	www.sse.com.cn/market/bonddata/profit/	1
Bond Clean & Dirty Price	www.sse.com.cn/market/bonddata/netfull/	1
Active Bond Varieties	www.sse.com.cn/market/bonddata/livelybond/	1

Other Data (其他数据):

Source	URL	Functions
Margin Trading Summary	www.sse.com.cn/market/othersdata/margin/sum/	1
Margin Trading Detail	www.sse.com.cn/market/othersdata/margin/detail/	2
Securities Lending Overview	www.sse.com.cn/market/othersdata/refinancing/lend/	1
Strategic Placement Lending (Main)	www.sse.com.cn/market/othersdata/zlpskcjxx/main/	1
Strategic Placement Lending (STAR)	www.sse.com.cn/market/othersdata/zlpskcjxx/star/	1
Asset Management Share Transfer	www.sse.com.cn/market/othersdata/asset/	1
Member List	www.sse.com.cn/market/othersdata/memberdata/memberlist/	1
...and 10 more member/business qualification pages

FRED (Federal Reserve Economic Data) — 6 maps

Source	URL	Functions
Time Series Data	fred.stlouisfed.org/series/observations/	1
Search Series	fred.stlouisfed.org/series/search/	1
Series Metadata	fred.stlouisfed.org/series/	1
Browse by Category	fred.stlouisfed.org/category/series/	1
Release Calendar	fred.stlouisfed.org/releases/	1
Discover by Tag	fred.stlouisfed.org/tags/series/	1

International APIs — 4 maps

Source	URL	Functions
Cryptocurrency Market Data	coinpaprika.com/coin/btc-bitcoin/	1
Weather Forecast API	open-meteo.com/en/docs/	1
Hacker News Top Stories	news.ycombinator.com/	2

More maps are being added continuously. Visit veri-glow.com to browse all 65 maps or request a new one.