Cortex
TwitterDiscord
  • 👋Welcome to Cortex
  • Overview
    • 💡Understanding Cortex Architecture
  • Product Guides
    • 🛫Making your first Copilot
    • ⚡Making your first Callable
  • Fundamentals
    • ✈️Copilot
    • 🧠Knowledge
    • ⚡Callable
    • 🛠️Getting set up
      • 📝Setting permissions
  • Callable
    • Blocks
      • Models
        • Language Model
        • Language Model With Code
      • Data
        • Dataset Loader
      • Tools
        • Knowledge Search
        • Google Search
        • Curl Request
        • Web Page Crawler
      • Control
        • Code
        • Loop Until
        • Map Reduce
    • Use Cases
      • Building a Company Help Desk
      • Creating a Social Media Manager Chatbot
      • Utilizing Model Examples to Convert Text to JSON
      • Retrievals from Knowledge Search Blocks
      • Chatbot with Google Search Assistance
  • Guides
    • Getting Started with the SDK
    • Documents
  • API References
    • Introduction
    • Authentication
    • Making Curl Requests
    • Node.js Library
    • Python Library
Powered by GitBook
On this page
  1. Callable
  2. Blocks
  3. Tools

Web Page Crawler

PreviousCurl RequestNextControl

Last updated 1 year ago

Goes to a specified URL and retrieves the HTML from the page.

Parameters:

  • URL: The URL that you want to get HTML data from

  • CSS Selector: Provide an HTML Element () to search the contents for on the specified website. Each result will return the html, text, width, height, top, left, and attributes of the each element that matches the selector.

https://developer.mozilla.org/en-US/docs/Web/HTML/Element