Re: [RFC] Removing "magic" oids
Noah Misch <noah@leadboat.com>
From: Noah Misch <noah@leadboat.com>
To: Andres Freund <andres@anarazel.de>
Cc: pgsql-hackers@postgresql.org
Date: 2018-11-15T04:57:28Z
Lists: pgsql-hackers
On Wed, Nov 14, 2018 at 12:01:52AM -0800, Andres Freund wrote:
> - one pgbench test tested concurrent insertions into a table with
> oids, as some sort of stress test for lwlocks and spinlocks. I *think*
> this doesn't really have to be a system oid column, and this was just
> because that's how we triggered a bug on some machine. Noah, do I get
> this right?
The point of the test is to exercise OidGenLock by issuing many parallel
GetNewOidWithIndex() and verifying absence of duplicates. There's nothing
special about OidGenLock, but it is important to use an operation that takes a
particular LWLock many times, quickly. If the test query spends too much time
on things other than taking locks, it will catch locking races too rarely.
> --- a/src/bin/pgbench/t/001_pgbench_with_server.pl
> +++ b/src/bin/pgbench/t/001_pgbench_with_server.pl
> @@ -48,28 +48,26 @@ sub pgbench
> return;
> }
>
> -# Test concurrent insertion into table with UNIQUE oid column. DDL expects
> -# GetNewOidWithIndex() to successfully avoid violating uniqueness for indexes
> -# like pg_class_oid_index and pg_proc_oid_index. This indirectly exercises
> -# LWLock and spinlock concurrency. This test makes a 5-MiB table.
> +# Test concurrent insertion into table with serial column. This
> +# indirectly exercises LWLock and spinlock concurrency. This test
> +# makes a 5-MiB table.
>
> $node->safe_psql('postgres',
> - 'CREATE UNLOGGED TABLE oid_tbl () WITH OIDS; '
> - . 'ALTER TABLE oid_tbl ADD UNIQUE (oid);');
> + 'CREATE UNLOGGED TABLE insert_tbl (id serial primary key); ');
>
> pgbench(
> '--no-vacuum --client=5 --protocol=prepared --transactions=25',
> 0,
> [qr{processed: 125/125}],
> [qr{^$}],
> - 'concurrency OID generation',
> + 'concurrent insert generation',
> {
> - '001_pgbench_concurrent_oid_generation' =>
> - 'INSERT INTO oid_tbl SELECT FROM generate_series(1,1000);'
> + '001_pgbench_concurrent_insert' =>
> + 'INSERT INTO insert_tbl SELECT FROM generate_series(1,1000);'
The code for sequences is quite different, so this may or may not be an
effective replacement. To study that, you could remove a few barriers from
lwlock.c, measure how many iterations today's test needs to catch the
mutation, and then measure the same for this proposal.
Commits
-
Revive test of concurrent OID generation.
- dffb891d78cb 12.0 landed
- 8a0cbb88524e 13.0 landed
-
Fix typo introduced in 578b229718.
- 54bb22f66af9 12.0 landed
-
Fix pg_upgrade for oid removal.
- 12a53c732ced 12.0 landed
-
Fix sepgsql compile error caused by oid removal.
- 937e4e509998 12.0 landed
-
Remove WITH OIDS support, change oid catalog column visibility.
- 578b229718e8 12.0 landed