Re: some review comments on logical rep code
Fujii Masao <masao.fujii@gmail.com>
From: Fujii Masao <masao.fujii@gmail.com>
To: Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Cc: Sawada Masahiko <sawada.mshk@gmail.com>, PostgreSQL-development <pgsql-hackers@postgresql.org>
Date: 2017-04-25T23:01:55Z
Lists: pgsql-hackers
Attachments
- 002_Reset_on_commit_launcher_wakeup_v5.patch (application/octet-stream) patch v5
On Mon, Apr 24, 2017 at 7:57 PM, Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp> wrote: > Hello, > > At Mon, 24 Apr 2017 11:18:32 +0900, Masahiko Sawada <sawada.mshk@gmail.com> wrote in <CAD21AoBU8mZdGx-sTJ3u+qkaej5RPnOuotW4kfeXc4XdDNF8cw@mail.gmail.com> >> >> BEGIN; >> >> ALTER SUBSCRIPTION hoge_sub ENABLE; >> >> PREPARE TRANSACTION 'g'; >> >> BEGIN; >> >> SELECT 1; >> >> COMMIT; -- wake up the launcher at this point. >> >> COMMIT PREPARED 'g'; >> >> >> >> Even if we wake up the launcher even when a ROLLBACK PREPARED, it's >> >> not a big deal to the launcher process actually. Compared with the >> >> complexly of changing the logic so that on_commit_launcher_wakeup >> >> corresponds to prepared transaction, we might want to accept this >> >> behavior. >> > >> > on_commit_launcher_wakeup needs to be recoreded in 2PC state >> > file to handle this issue properly. But I agree with you, that would >> > be overkill for small gain. So I'm thinking to add the following >> > comment into your patch and push it. Thought? >> > >> > ------------------------- >> > Note that on_commit_launcher_wakeup flag doesn't work as expected in 2PC case. >> > For example, COMMIT PREPARED on the transaction enabling the flag >> > doesn't wake up >> > the logical replication launcher if ROLLBACK on another transaction >> > runs before it. >> > To handle this case properly, the flag needs to be recorded in 2PC >> > state file so that >> > COMMIT PREPARED and ROLLBACK PREPARED can determine whether to wake up >> > the launcher. However this is overkill for small gain and false wakeup >> > of the launcher >> > is not so harmful (probably we can live with that), so we do nothing >> > here for this issue. >> > ------------------------- >> > >> >> Agreed. >> >> I added this comment to the patch and attached it. > > The following "However" may need a follwoing comma. > >> However this is overkill for small gain and false wakeup of the >> launcher is not so harmful (probably we can live with that), so >> we do nothing here for this issue. > > I agree this as a whole. But I think that the main issue here is > not false wakeups, but 'possible delay of launching new workers > by 3 minutes at most' (this is centainly a kind of false wakeups, > though). We can live with this failure when using two-paase > commmit, but I think it shouldn't happen silently. > > > How about providing AtPrepare_ApplyLauncher(void) like the > follows and calling it in PrepareTransaction? Or we should apply the attached patch and handle the 2PC case properly? I was thinking that it's overkill more than necessary, but that seems not true as far as I implement that. Regards, -- Fujii Masao
Commits
-
Fix bug so logical rep launcher saves correctly time of last startup of worker.
- 9f11fcec6624 10.0 landed
-
Prevent log_replication_commands from causing SQL commands to be logged.
- 3a66581dd12b 10.0 landed
-
Mark some columns in pg_subscription as NOT NULL.
- 88b0a3192633 10.0 landed
-
Don't call the function that may raise an error while holding spinlock.
- 8bbc618b4825 10.0 landed
-
A collection of small fixes for logical replication.
- 280c53ecfbca 10.0 landed
-
Use DatumGetInt32() to extract 32-bit integer value from a datum.
- 39a6772d0494 10.0 landed