Skip to content

Token Splitter#

The Token Splitter node splits a raw text string by first converting the text into BPE tokens, then splits these tokens into chunks and converts the tokens within a single chunk back into text.

On this page, you'll find the node parameters for the Token Splitter node, and links to more resources.

Examples and templates

For usage examples and templates to help you get started, refer to n8n's LangChain integrations page.

Node parameters#

  • Chunk Size
  • Chunk Overlap

Node reference#

View example workflows and related content on n8n's website.

Refer to LangChain's token text splitter documentation for more information about the service.

View n8n's LangChain documentation.