Re: POC PATCH: copy from ... exceptions to: (was Re: VLDB Features)
Damir Belyalov <dam.bel07@gmail.com>
From: Damir Belyalov <dam.bel07@gmail.com>
To: Danil Anisimow <anisimow.d@gmail.com>,
"HukuToc@gmail.com" <HukuToc@gmail.com>
Cc: torikoshia <torikoshia@oss.nttdata.com>, "a.lepikhov@postgrespro.ru" <a.lepikhov@postgrespro.ru>, PostgreSQL Hackers <pgsql-hackers@postgresql.org>
Date: 2023-02-03T10:27:24Z
Lists: pgsql-hackers
Commits
Same data as JSON:
GET /api/v1/messages/:b64id/commits
the thread's linked commits as JSON, with link sources.
API reference →
-
doc: Fix COPY ON_ERROR option syntax synopsis.
- f6f8ac8e75c9 17.0 landed
-
Disallow specifying ON_ERROR option without value.
- a6d0fa5ef840 17.0 landed
-
Rename COPY option from SAVE_ERROR_TO to ON_ERROR
- b725b7eec431 17.0 landed
-
Fix spelling in notice
- 58fbbc9d683c 17.0 landed
-
Add new COPY option SAVE_ERROR_TO
- 9e2d8701194f 17.0 landed
Attachments
- 0011-COPY_IGNORE_ERRORS.patch (text/x-patch) patch 0011
Hi, Danil and Nikita! Thank you for reviewing. Why is there no static keyword in the definition of the SafeCopying() > function, but it is in the function declaration. > Correct this. 675: MemoryContext cxt = > MemoryContextSwitchTo(econtext->ecxt_per_tuple_memory); > 676: > 677: valid_row = NextCopyFrom(cstate, econtext, myslot->tts_values, > myslot->tts_isnull); > 678: tuple_is_valid = valid_row; > 679: > 680: if (valid_row) > 681: sfcstate->safeBufferBytes += cstate->line_buf.len; > 682: > 683: CurrentMemoryContext = cxt; > > Why are you using a direct assignment to CurrentMemoryContext instead of > using the MemoryContextSwitchTo function in the SafeCopying() routine? > "CurrentMemoryContext = cxt" is the same as "MemoryContextSwitchTo(cxt)", you can see it in the implementation of MemoryContextSwitchTo(). Also correct this. When you initialize the cstate->sfcstate structure, you create a > cstate->sfcstate->safe_cxt memory context that inherits from oldcontext. > Was it intended to use cstate->copycontext as the parent context here? > Good remark, correct this. Thanks Nikita Malakhov for advice to create file with errors. But I decided to to log errors in the system logfile and don't print them to the terminal. The error's output in logfile is rather simple - only error context logs (maybe it's better to log all error information?). There are 2 points why logging errors in logfile is better than logging errors in another file (e.g. PGDATA/copy_ignore_errors.txt). The user is used to looking for errors in logfile. Creating another file entails problems like: 'what file name to create?', 'do we need to make file rotation?', 'where does this file create?' (we can't create it in PGDATA cause of memory constraints) Regards, Damir Belyalov Postgres Professional