grn_ngram_tokenizer Struct Reference

Collaboration diagram for grn_ngram_tokenizer:

Data Fields
grn_tokenizer_token	token
grn_tokenizer_query *	query
uint8_t	uni_alpha
uint8_t	uni_digit
uint8_t	uni_symbol
uint8_t	ngram_unit
uint8_t	ignore_blank
uint8_t	overlap
int32_t	pos
uint32_t	skip
const unsigned char *	next
const unsigned char *	end
const uint_least8_t *	ctypes
uint32_t	len
uint32_t	tail

Detailed Description

Definition at line 242 of file token.c.

Field Documentation

const uint_least8_t* ctypes

Definition at line 255 of file token.c.

const unsigned char* end

Definition at line 254 of file token.c.

uint8_t ignore_blank

Definition at line 249 of file token.c.

uint32_t len

Definition at line 256 of file token.c.

const unsigned char* next

Definition at line 253 of file token.c.

uint8_t ngram_unit

Definition at line 248 of file token.c.

uint8_t overlap

Definition at line 250 of file token.c.

int32_t pos

Definition at line 251 of file token.c.

grn_tokenizer_query* query

Definition at line 244 of file token.c.

uint32_t skip

Definition at line 252 of file token.c.

uint32_t tail

Definition at line 257 of file token.c.

grn_tokenizer_token token

Definition at line 243 of file token.c.

uint8_t uni_alpha

Definition at line 245 of file token.c.

uint8_t uni_digit

Definition at line 246 of file token.c.

uint8_t uni_symbol

Definition at line 247 of file token.c.

---

The documentation for this struct was generated from the following file:

• /home/maru/tmp/groonga/lib/token.c