comparison test/test_indexer.py @ 6599:39189dd94f2c

issue2551189 - increase size of words in full text index. Increased indexed word maxlength to 50 DB migration code is written and tests work. Restructured some tests to allow for code reuse. Docs. If this passes CI without errors 2551189 should be done. However, testing on my system generates errors. Encoding (indexer unicode russian unicode string invalid) and collation errors (utf8_bin not valid) when running under python2. No issues with python3 and I haven't changed code that should cause these since the last successful build in CI. So if this fails in CI we will have more checkins.
author John Rouillard <rouilj@ieee.org>
date Wed, 26 Jan 2022 15:04:09 -0500
parents 91ab3e0ffcd0
children 0d99ae7c8de6
comparison
equal deleted inserted replaced
6598:27a4ab499189 6599:39189dd94f2c
121 # skip this for FTS test 121 # skip this for FTS test
122 if isinstance(self,sqliteFtsIndexerTest): 122 if isinstance(self,sqliteFtsIndexerTest):
123 pytest.skip("extremewords not tested for native FTS backends") 123 pytest.skip("extremewords not tested for native FTS backends")
124 124
125 short = "b" 125 short = "b"
126 long = "abcdefghijklmnopqrstuvwxyz" 126 long = "abcdefghijklmnopqrstuvwxyzabcdefghijklmnopqrstuvwxyz"
127 self.dex.add_text(('test', '1', 'a'), '%s hello world' % short) 127 self.dex.add_text(('test', '1', 'a'), '%s hello world' % short)
128 self.dex.add_text(('test', '2', 'a'), 'blah a %s world' % short) 128 self.dex.add_text(('test', '2', 'a'), 'blah a %s world' % short)
129 self.dex.add_text(('test', '3', 'a'), 'blah Blub river') 129 self.dex.add_text(('test', '3', 'a'), 'blah Blub river')
130 self.dex.add_text(('test', '4', 'a'), 'blah river %s %s' 130 self.dex.add_text(('test', '4', 'a'), 'blah river %s %s'
131 % (short, long)) 131 % (short, long))

Roundup Issue Tracker: http://roundup-tracker.org/