generate_normalized_query() no longer needs to truncate text, but this
one comment didn't get the memo. Per Peter Geoghegan.
if (tok_len < 0)
continue; /* ignore any duplicates */
- /* Copy next chunk, or as much as will fit */
+ /* Copy next chunk (what precedes the next constant) */
len_to_wrt = off - last_off;
len_to_wrt -= last_tok_len;
memcpy(norm_query + n_quer_loc, query + quer_loc, len_to_wrt);
n_quer_loc += len_to_wrt;
+ /* And insert a '?' in place of the constant token */
norm_query[n_quer_loc++] = '?';
quer_loc = off + tok_len;