Re: some review comments on logical rep code
Petr Jelinek <petr.jelinek@2ndquadrant.com>
From: Petr Jelinek <petr.jelinek@2ndquadrant.com>
To: Fujii Masao <masao.fujii@gmail.com>
Cc: Masahiko Sawada <sawada.mshk@gmail.com>,
Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>,
PostgreSQL-development <pgsql-hackers@postgresql.org>
Date: 2017-04-19T02:18:18Z
Lists: pgsql-hackers
Attachments
- 010_dont-read-catalog-inside-spinlock-v2.patch (text/plain) patch v2
On 18/04/17 19:27, Fujii Masao wrote: > On Wed, Apr 19, 2017 at 1:35 AM, Petr Jelinek > <petr.jelinek@2ndquadrant.com> wrote: >> Thank you for working on this! >> >> On 18/04/17 10:16, Masahiko Sawada wrote: >>> On Tue, Apr 18, 2017 at 12:24 PM, Kyotaro HORIGUCHI >>> <horiguchi.kyotaro@lab.ntt.co.jp> wrote: >>>>>> >>>>>>>> 10. >>>>>>>>> >>>>>>>>> SpinLockAcquire(&MyLogicalRepWorker->relmutex); >>>>>>>>> MyLogicalRepWorker->relstate = >>>>>>>>> GetSubscriptionRelState(MyLogicalRepWorker->subid, >>>>>>>>> MyLogicalRepWorker->relid, >>>>>>>>> &MyLogicalRepWorker->relstate_lsn, >>>>>>>>> false); >>>>>>>>> SpinLockRelease(&MyLogicalRepWorker->relmutex); >>>>>>>>> >>>>>>>>> Non-"short-term" function like GetSubscriptionRelState() should not >>>>>>>>> be called while spinlock is being held. >>>>>>>>> >>>>>>>> >>>>>>>> One option is adding new LWLock for the relation state change but this >>>>>>>> lock is used at many locations where the operation actually doesn't >>>>>>>> take time. I think that the discussion would be needed to get >>>>>>>> consensus, so patch for it is not attached. >>>>>>> >>>>>>> From the point of view of time, I agree that it doesn't seem to >>>>>>> harm. Bt I thing it as more significant problem that >>>>>>> potentially-throwable function is called within the mutex >>>>>>> region. It potentially causes a kind of dead lock. (That said, >>>>>>> theoretically dosn't occur and I'm not sure what happens by the >>>>>>> dead lock..) >>>>>>> >> >> Hmm, I think doing what I attached should be fine here. > > Thanks for the patch! > >> We don't need to >> hold spinlock for table read, just for changing the >> MyLogicalRepWorker->relstate. > > Yes, but the update of MyLogicalRepWorker->relstate_lsn also should > be protected with the spinlock. > Yes, sorry tired/blind, fixed. -- Petr Jelinek http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training & Services
Commits
-
Fix bug so logical rep launcher saves correctly time of last startup of worker.
- 9f11fcec6624 10.0 landed
-
Prevent log_replication_commands from causing SQL commands to be logged.
- 3a66581dd12b 10.0 landed
-
Mark some columns in pg_subscription as NOT NULL.
- 88b0a3192633 10.0 landed
-
Don't call the function that may raise an error while holding spinlock.
- 8bbc618b4825 10.0 landed
-
A collection of small fixes for logical replication.
- 280c53ecfbca 10.0 landed
-
Use DatumGetInt32() to extract 32-bit integer value from a datum.
- 39a6772d0494 10.0 landed