AnalyzerInterface
in
An AnalyzerInterface is used to analyze text.
Tags
Table of Contents
Methods
- nextToken() : Token|null
- Tokenization stream API Get next token Returns null at the end of stream
- reset() : mixed
- Reset token stream
- setInput() : mixed
- Tokenization stream API Set input
- tokenize() : array<string|int, mixed>
- Tokenize text to terms Returns array of ZendSearch\Lucene\Analysis\Token objects
Methods
nextToken()
Tokenization stream API Get next token Returns null at the end of stream
public
nextToken() : Token|null
Tokens are returned in UTF-8 (internal Zend_Search_Lucene encoding)
Return values
Token|nullreset()
Reset token stream
public
reset() : mixed
setInput()
Tokenization stream API Set input
public
setInput(string $data[, mixed $encoding = '' ]) : mixed
Parameters
- $data : string
- $encoding : mixed = ''
tokenize()
Tokenize text to terms Returns array of ZendSearch\Lucene\Analysis\Token objects
public
tokenize(string $data[, mixed $encoding = '' ]) : array<string|int, mixed>
Tokens are returned in UTF-8 (internal Zend_Search_Lucene encoding)
Parameters
- $data : string
- $encoding : mixed = ''