Word
Associations
Network

For example, love, dream, bee, flower, grass, paint, thunder, gift, motorcycle

A
B
C
D
E
F
G
H
I
J
K
L
M
N
O
P
Q
R
S
T
U
V
W
X
Y
Z

Associations to the word «Tokenize»

Noun

Adjective

Lexical

Verb

Store

1

Wiktionary

TOKENIZE, verb. (transitive) (computing) To reduce to a set of tokens by parsing.

TOKENIZE, verb. (transitive) To treat as a token minority.

Wise words

It is only with the heart that one can see rightly; what is essential is invisible to the eye.

Antoine de Saint-Exupery