The URLs tab allows you to connect an entire website to the AI Agent’s knowledge base. Rather than manually uploading or writing content, the agent will crawl the website you specify and automatically extract relevant information from its pages. This is particularly useful for pointing the agent to your hotel website, booking pages, or any online resource containing up-to-date property information.

How to add a URL:

1. Click the URLs tab and then click Add URL.

2. Enter a Title to label this URL entry and paste the full web address into the URL field (e.g. https://yourhotel.com).

3. Add a Description to summarise what the site contains and why it is relevant.

4. Expand the Crawl scope section to configure how the agent crawls the site. The available options are: Include subdomains (index pages from subdomains such as blog.example.com); Follow external links (crawl links that lead to other domains — off by default); Index with Claude Native (beta feature — uploads each page as a Claude file with a sitemap for direct reading at chat time); Skip these URLs (enter URL patterns to exclude from crawling, one per line, e.g. /admin, /login, *.pdf).

Click Save. Once processed, the URL will appear in the list with a READY TO USE status badge.