Text processing

What is a token? Why is a paragraph cut into many small pieces by AI?

Tokens can be understood as the "smallest unit of work" when the model processes text. It doesn't necessarily equal a word, a word, or a punctuation, ...