WordTokenizer

Tokenizes the words in an input text.

Script Data


NameDescription
Script Typepython
Tagsphishing, ml

Inputs


Argument NameDescription
valueThe text value.
typeThe Tokenizer type. For more information click here.
cleanHtmlThe clean html from the text value.
removeLineBreaksThe line breaks that will be removed.
encodingThe encoding text.
hashWordWithSeedThe hash of the words with this seed, if not empty.

Outputs


PathDescriptionType
WordTokenizeOutputThe output text.string