Re: Reduce timing overhead of EXPLAIN ANALYZE using rdtsc?
Lukas Fittl <lukas@fittl.com>
Attachments
- v17-0005-instrumentation-ARM-support-for-fast-time-measur.patch (application/octet-stream) patch v17-0005
- v17-0002-Allow-retrieving-x86-TSC-frequency-flags-from-CP.patch (application/octet-stream) patch v17-0002
- v17-0001-instrumentation-Streamline-ticks-to-nanosecond-c.patch (application/octet-stream) patch v17-0001
- v17-0004-pg_test_timing-Also-test-RDTSC-RDTSCP-timing-and.patch (application/octet-stream) patch v17-0004
- v17-0003-instrumentation-Use-Time-Stamp-Counter-TSC-on-x8.patch (application/octet-stream) patch v17-0003
On Fri, Apr 3, 2026 at 2:06 AM John Naylor <johncnaylorls@gmail.com> wrote: > > On Fri, Apr 3, 2026 at 6:16 AM Lukas Fittl <lukas@fittl.com> wrote: > > v16 > > Just some minor quibbles on 0002: Thanks for the review! > > --- a/src/include/port/pg_cpu.h > +++ b/src/include/port/pg_cpu.h > @@ -23,6 +23,12 @@ typedef enum X86FeatureId > /* scalar registers and 128-bit XMM registers */ > PG_SSE4_2, > PG_POPCNT, > + PG_HYPERVISOR, > > The hypervisor flag doesn't really belong with an instruction family. > Maybe a separate category like "identification"? Yeah, I've pondered different names here, but "identification" seems good for now - I agree it doesn't belong with the earlier flags. > > + /* TSC flags */ > + PG_RDTSCP, > + PG_TSC_INVARIANT, > + PG_TSC_ADJUST, > > Maybe spell out time stamp counter in the comment, since this will be > the first time the reader encounters that in this file. Makes sense, done. FWIW, TSC can be spelled out either as "Time Stamp Counter" or "Time-Stamp Counter". I've gone with the latter for now since that's what was done elsewhere, and is how the Intel manuals reference it as well. > > + * For some other Hypervisors that have an invariant TSC, e.g. HyperV, we would > + * need to access an MSR to get the frequency (which is typically not available > > Maybe spell out MSR too, because I for one don't know what that is. Done. I've also removed the note re: TSC calibration in that same comment, since that's in a later commit and I don't think its necessary to talk about it in that comment anyway. > > + X86Features[PG_HYPERVISOR] = reg[ECX] >> 31 & 1; > + have_osxsave = reg[ECX] & (1 << 27); > + > + pg_cpuid_subleaf(0x07, 0, reg); > + > + X86Features[PG_TSC_ADJUST] = (reg[EBX] & (1 << 1)) != 0; > > Some inconsistency in shift style. Fixed. See attached v17. Thanks, Lukas -- Lukas Fittl
Commits
GET /api/v1/messages/:b64id/commits
the thread's linked commits as JSON, with link sources.
API reference →
-
pg_test_timing: Show additional TSC clock source debug info
- 5ba34f6dc838 19 (unreleased) landed
-
instrumentation: Avoid CPUID 0x15/0x16 for Hypervisor TSC frequency
- 7fc36c5db550 19 (unreleased) landed
-
pg_test_timing: Also test RDTSC[P] timing, report time source, TSC frequency
- 16fca4825483 19 (unreleased) landed
-
Allow retrieving x86 TSC frequency/flags from CPUID
- bcb2cf41f964 19 (unreleased) landed
-
instrumentation: Standardize ticks to nanosecond conversion method
- 0022622c93d9 19 (unreleased) landed
-
instrumentation: Use Time-Stamp Counter on x86-64 to lower overhead
- 294520c44487 19 (unreleased) landed
-
Check for __cpuidex and __get_cpuid_count separately
- effaa464afd3 19 (unreleased) landed
-
pg_test_timing: Reduce per-loop overhead
- 82c0cb4e672d 19 (unreleased) landed
-
Refactor handling of x86 CPUID instructions
- be6a7494d2e3 19 (unreleased) landed
-
instrumentation: Drop INSTR_TIME_SET_CURRENT_LAZY macro
- 9d6294c09ed0 19 (unreleased) landed
-
Rename pg_crc32c_sse42_choose.c for general purpose
- b9278871f991 19 (unreleased) cited
-
Zero initialize uses of instr_time about to trigger compiler warnings
- 25b2aba0c3a5 16.0 landed
-
instr_time: Represent time as an int64 on all platforms
- 03023a2664f8 16.0 landed
-
Add 250c8ee07ed to git-blame-ignore-revs
- ff23b592ad66 16.0 cited