> For the complete documentation index, see [llms.txt](https://docs.rowsncolumns.app/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.rowsncolumns.app/configuration/features/tokenizer.md).

# Tokenizer

A Tokenizer tells the Spreadsheet how to identify formulas and string tokens in the user entered value of cell.

Spreadsheet comes with a built-in tokenizer in `rowsncolumns/calculator` module. Developers can pass a custom tokenizer, especially if you want to additional highlighting capabilities.