| Token name (lexical category) | Explanation | Sample token values |
|---|---|---|
| identifier | Names assigned by the programmer. | x, color, UP |
| keyword | Reserved words of the language. | if, while, return |
| separator/punctuator | Punctuation characters and paired delimiters. | }, (, ; |
| operator | Symbols that operate on arguments and produce results. | +, <, = |
| literal | Numeric, logical, textual, and reference literals. | true, 6.02e23, "music" |
| comment | Line or block comments. Usually discarded. | /﹡ Retrieves user data ﹡/, // must be negative |
| whitespace | Groups of non-printable characters. Usually discarded. | – |
Examples of common tokens
(echo:: @ ᯤ)