Processing Flow
Protected Token Classes
- Code Fences & Inline Backticks: Code blocks (including indentation and language identifiers) and inline code elements are protected.
- JSON Objects & Schemas: Valid JSON objects, arrays, and parameter definitions remain structurally intact.
- Template Variables: Mustache placeholders (
{{user_id}}), Jinja2 tags, and custom interpolation markers are isolated from token splitting. - URLs & Regular Expressions: HTTP/HTTPS URLs, query parameters, and regex patterns are preserved without modification.