tokenize-words
text →
tokenize-words() → array
Returns word tokens using separators, punctuation, symbols, case transitions, and acronym transitions as boundaries.
Parameters
This function has no parameters.
Examples
"customer_HTTP-server_id" | tokenize-words → {"customer", "HTTP", "server", "id"}
Kind: Function
Scope: text/tokenization
Aliases: text-to-tokenize-words