Re: Replication slot stats misgivings
vignesh C <vignesh21@gmail.com>
From: vignesh C <vignesh21@gmail.com>
To: Amit Kapila <amit.kapila16@gmail.com>
Cc: Andres Freund <andres@anarazel.de>,
Masahiko Sawada <sawada.mshk@gmail.com>, pgsql-hackers <pgsql-hackers@postgresql.org>, Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Date: 2021-04-19T10:58:00Z
Lists: pgsql-hackers
Attachments
- 0001-Update-decoding-stats-while-releasing-replication-sl.patch (text/x-patch) patch 0001
On Fri, Apr 16, 2021 at 3:16 PM Amit Kapila <amit.kapila16@gmail.com> wrote: > > On Mon, Apr 12, 2021 at 2:57 PM vignesh C <vignesh21@gmail.com> wrote: > > > > On Sat, Mar 20, 2021 at 9:26 AM Amit Kapila <amit.kapila16@gmail.com> wrote: > > > > > > On Sat, Mar 20, 2021 at 12:22 AM Andres Freund <andres@anarazel.de> wrote: > > > > > > > > And then more generally about the feature: > > > > - If a slot was used to stream out a large amount of changes (say an > > > > initial data load), but then replication is interrupted before the > > > > transaction is committed/aborted, stream_bytes will not reflect the > > > > many gigabytes of data we may have sent. > > > > > > > > > > We can probably update the stats each time we spilled or streamed the > > > transaction data but it was not clear at that stage whether or how > > > much it will be useful. > > > > > > > I felt we can update the replication slot statistics data each time we > > spill/stream the transaction data instead of accumulating the > > statistics and updating at the end. I have tried this in the attached > > patch and the statistics data were getting updated. > > Thoughts? > > > > Did you check if we can update the stats when we release the slot as > discussed above? I am not sure if it is easy to do at the time of slot > release because this information might not be accessible there and in > some cases, we might have already released the decoding > context/reorderbuffer where this information is stored. It might be > okay to update this when we stream or spill but let's see if we can do > it easily at the time of slot release. > I have made the changes to update the replication statistics at replication slot release. Please find the patch attached for the same. Thoughts? Regards, Vignesh
Commits
-
Doc: Update logical decoding stats information.
- 0c6b92d9c6fb 14.0 landed
-
Fix tests for replication slots stats.
- fc69509131c3 14.0 landed
-
Update replication statistics after every stream/spill.
- 592f00f8dec6 14.0 landed
-
Fix the computation of slot stats for 'total_bytes'.
- 205f466282be 14.0 landed
-
Another try to fix the test case added by commit f5fc2f5b23.
- 51ef9173030c 14.0 landed
-
Use HTAB for replication slot statistics.
- 3fa17d37716f 14.0 landed
-
Fix test case added by commit f5fc2f5b23.
- c64dcc7fee5f 14.0 landed
-
Add information of total data processed to replication slot stats.
- f5fc2f5b23d1 14.0 landed
-
Use NameData datatype for slotname in stats.
- cca57c1d9bf7 14.0 landed