To reduce to a token or set of tokens by lexical analysis.
Infinitivetokenize
Past simpletokenized
Past participletokenized
-ing formtokenizing
Full conjugation of the English verb to tokenize (past simple tokenized,
past participle tokenized):
present simple and continuous, past simple and continuous, present perfect, past perfect,
future, conditional, subjunctive and imperative, with all persons.
Indicative
Present simple
I
tokenize
you
tokenize
he/she/it
tokenizes
we
tokenize
you
tokenize
they
tokenize
Present continuous
I
am tokenizing
you
are tokenizing
he/she/it
is tokenizing
we
are tokenizing
you
are tokenizing
they
are tokenizing
Present perfect
I
have tokenized
you
have tokenized
he/she/it
has tokenized
we
have tokenized
you
have tokenized
they
have tokenized
Present perfect continuous
I
have been tokenizing
you
have been tokenizing
he/she/it
has been tokenizing
we
have been tokenizing
you
have been tokenizing
they
have been tokenizing
Past simple
I
tokenized
you
tokenized
he/she/it
tokenized
we
tokenized
you
tokenized
they
tokenized
Past continuous
I
was tokenizing
you
were tokenizing
he/she/it
was tokenizing
we
were tokenizing
you
were tokenizing
they
were tokenizing
Past perfect
I
had tokenized
you
had tokenized
he/she/it
had tokenized
we
had tokenized
you
had tokenized
they
had tokenized
Past perfect continuous
I
had been tokenizing
you
had been tokenizing
he/she/it
had been tokenizing
we
had been tokenizing
you
had been tokenizing
they
had been tokenizing
Future simple
I
will tokenize
you
will tokenize
he/she/it
will tokenize
we
will tokenize
you
will tokenize
they
will tokenize
Future continuous
I
will be tokenizing
you
will be tokenizing
he/she/it
will be tokenizing
we
will be tokenizing
you
will be tokenizing
they
will be tokenizing
Future perfect
I
will have tokenized
you
will have tokenized
he/she/it
will have tokenized
we
will have tokenized
you
will have tokenized
they
will have tokenized
Future perfect continuous
I
will have been tokenizing
you
will have been tokenizing
he/she/it
will have been tokenizing
we
will have been tokenizing
you
will have been tokenizing
they
will have been tokenizing
Conditional
Present
I
would tokenize
you
would tokenize
he/she/it
would tokenize
we
would tokenize
you
would tokenize
they
would tokenize
Present continuous
I
would be tokenizing
you
would be tokenizing
he/she/it
would be tokenizing
we
would be tokenizing
you
would be tokenizing
they
would be tokenizing
Perfect
I
would have tokenized
you
would have tokenized
he/she/it
would have tokenized
we
would have tokenized
you
would have tokenized
they
would have tokenized
Perfect continuous
I
would have been tokenizing
you
would have been tokenizing
he/she/it
would have been tokenizing
we
would have been tokenizing
you
would have been tokenizing
they
would have been tokenizing
Subjunctive
Present
that I
tokenize
that you
tokenize
that he/she/it
tokenize
that we
tokenize
that you
tokenize
that they
tokenize
Past
if I
tokenized
if you
tokenized
if he/she/it
tokenized
if we
tokenized
if you
tokenized
if they
tokenized
Imperative
Affirmative
you
tokenize
we
let's tokenize
Negative
you
don't tokenize
we
let's not tokenize
Non-finite forms
Infinitive
to tokenize
Perfect infinitive
to have tokenized
Present participle / gerund
tokenizing
Past participle
tokenized
Conjugations: Wiktionary (via kaikki.org), adapted, licensed under CC BY-SA 4.0.