Horton

Re: string_to_array eats too much memory?

Teodor Sigaev <teodor@sigaev.ru>

View thread View on postgr.es
From: Teodor Sigaev <teodor@sigaev.ru>
To: Tatsuo Ishii <ishii@sraoss.co.jp>
Cc: pgsql-hackers@postgresql.org
Date: 2006-11-08T10:58:02Z
Lists: pgsql-hackers 
> Porblem with Japanese is, it's an agglutinative language and we need
> to separate each word from a sentence. So, I need to modify tsearch2
> anyway (I know someone from Japan is working on this).
https://www.oss.ecl.ntt.co.jp/tsearch2j/index.html
That's it?

> 
> BTW, can tsearch2 handle ~70k words in a document?

I don't see any problem. tsvector size should not be greater than 1Mb however.

-- 
Teodor Sigaev                                   E-mail: teodor@sigaev.ru
                                                    WWW: http://www.sigaev.ru/