Build de-escaped JSON strings in larger chunks during lexing
John Naylor <john.naylor@postgresql.org>
Build de-escaped JSON strings in larger chunks during lexing During COPY BINARY with large JSONB blobs, it was found that half the time was spent parsing JSON, with much of that spent in separate appendStringInfoChar() calls for each input byte. Add lookahead loop to json_lex_string() to allow batching multiple bytes via appendBinaryStringInfo(). Also use this same logic when de-escaping is not done, to avoid code duplication. Report and proof of concept patch by Jelte Fennema, reworked by Andres Freund and John Naylor Discussion: https://www.postgresql.org/message-id/CAGECzQQuXbies_nKgSiYifZUjBk6nOf2%3DTSXqRjj2BhUh8CTeA%40mail.gmail.com Discussion: https://www.postgresql.org/message-id/flat/PR3PR83MB0476F098CBCF68AF7A1CA89FF7B49@PR3PR83MB0476.EURPRD83.prod.outlook.com
Files
| Path | Change | +/− |
|---|---|---|
| src/common/jsonapi.c | modified | +39 −19 |
Discussion
- [PATCH] Optimize json_lex_string by batching character copying 32 messages · 2022-06-24 → 2022-09-02
- WIP Patch: Add a function that returns binary JSONB as a bytea 34 messages · 2018-10-31 → 2022-06-28