grn_delimited_tokenizer Struct Reference

Collaboration diagram for grn_delimited_tokenizer:

Data Fields
const uint8_t *	delimiter
uint32_t	delimiter_len
const unsigned char *	next
const unsigned char *	end
grn_tokenizer_token	token
grn_tokenizer_query *	query
grn_bool	have_tokenized_delimiter

Detailed Description

Definition at line 103 of file token.c.

Field Documentation

const uint8_t* delimiter

Definition at line 104 of file token.c.

uint32_t delimiter_len

Definition at line 105 of file token.c.

const unsigned char* end

Definition at line 107 of file token.c.

grn_bool have_tokenized_delimiter

Definition at line 110 of file token.c.

const unsigned char* next

Definition at line 106 of file token.c.

grn_tokenizer_query* query

Definition at line 109 of file token.c.

grn_tokenizer_token token

Definition at line 108 of file token.c.

---

The documentation for this struct was generated from the following file:

• /home/maru/tmp/groonga/lib/token.c