Re: Global temporary tables

Japin Li <japinli@hotmail.com>

From: Japin Li <japinli@hotmail.com>
To: Dean Rasheed <dean.a.rasheed@gmail.com>
Cc: Kirk Wolak <wolakk@gmail.com>, Pavel Stehule <pavel.stehule@gmail.com>, Andrew Dunstan <andrew@dunslane.net>, PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Date: 2026-07-03T03:16:57Z
Lists: pgsql-hackers
Hi, Dean

On Thu, 02 Jul 2026 at 17:11, Japin Li <japinli@hotmail.com> wrote:
> Hi, Dean
>
> On Wed, 01 Jul 2026 at 08:32, Dean Rasheed <dean.a.rasheed@gmail.com> wrote:
>> On Wed, 1 Jul 2026 at 07:24, Japin Li <japinli@hotmail.com> wrote:
>>>
>>> Thanks for working on this.
>>
>> Thank you for testing it!
>>
>>> While testing the v5 patch, I encountered a lock wait.
>>>
>>> 2026-07-01 14:18:43.603 CST [1486593] LOG:  process 1486593 still waiting for AccessExclusiveLock on relation 16384 of database 5 after 1000.106 ms
>>> 2026-07-01 14:18:43.603 CST [1486593] DETAIL:  Process holding the lock: 1486484. Wait queue: 1486593.
>>> 2026-07-01 14:18:43.603 CST [1486593] CONTEXT:  waiting for AccessExclusiveLock on relation 16384 of database 5
>>> 2026-07-01 14:18:43.603 CST [1486593] STATEMENT:  SELECT * FROM gtt_delete;
>>>
>>> Is this expected?
>>
>> Ah yes, you're right. That's not good.
>>
>> The root cause looks to be the same issue that Pavel reported -- the
>> ON COMMIT DELETE ROWS does a TRUNCATE when the transaction is
>> committed, which requires an AccessExclusiveLock. I think the patch
>> should reduce the lock level required for TRUNCATE on a global
>> temporary relation to RowExclusiveLock, like DELETE.
>>
>
> Here is my review on v5-0002.  Please take a look.
>
> 1.
> $ git am ~/Patches/gtt/*.patch
> Applying: Save temporary table ON COMMIT actions to pg_class.
> Applying: Basic support for global temporary tables.
> Applying: Support indexes on global temporary tables.
> Applying: Support global temporary sequences.
> Applying: Support global temporary catalog tables and add pg_temp_class.
> Applying: Add relation statistics columns to pg_temp_class.
> Applying: Add relfrozenxid and relminmxid columns to pg_temp_class.
> .git/rebase-apply/patch:940: new blank line at EOF.
> +
> warning: 1 line adds whitespace errors.
> Applying: Add pg_temp_statistic global temporary catalog table.
> Applying: Add pg_temp_statistic_ext_data global temporary catalog table.
> Applying: Add pg_temp_index global temporary catalog table.
>
> 2.
> +static void
> +gtr_delete_all_storage_on_exit(int code, Datum arg)
> +{
> +	ProcNumber	backend;
> +	HASH_SEQ_STATUS status;
> +	GtrStorageEntry *entry;
> +	SMgrRelation srel;
> +
> +	/* Loop over all storage created and delete it */
> +	backend = ProcNumberForTempRelations();
> +	hash_seq_init(&status, gtr_local_storage);
> +	while ((entry = hash_seq_search(&status)) != NULL)
> +	{
> +		srel = smgropen(entry->rlocator, backend);
> +		smgrdounlinkall(&srel, 1, false);
> +		smgrclose(srel);
> +	}
> +}
>
> We can restrict srel to the loop scope.
>
> 3.
> +gtr_remove_all_usage_on_exit(int code, Datum arg)
> +{
> +	HASH_SEQ_STATUS status;
> +	GtrUsageEntry *local_entry;
> +	GtrSharedUsageKey key;
> +	GtrSharedUsageEntry *shared_entry;
> +
> +	/* Loop over all the global temporary relations we were using */
> +	hash_seq_init(&status, gtr_local_usage);
> +	while ((local_entry = hash_seq_search(&status)) != NULL)
> +	{
> +		/* Find the shared usage entry */
> +		key.dbid = MyDatabaseId;
> +		key.relid = local_entry->relid;
> +		shared_entry = dshash_find(gtr_shared_usage, &key, true);
>
> Same as above: move the declarations of key and shared_entry inside the loop.
>
> 4.
> +static void
> +gtr_init_usage_tables(void)
> +{
> +	HASHCTL		ctl;
> +	MemoryContext oldcontext;
> +
> +	/* Local usage table */
> +	if (gtr_local_usage == NULL)
> +	{
> +		ctl.keysize = sizeof(Oid);
> +		ctl.entrysize = sizeof(GtrUsageEntry);
> +
> +		gtr_local_usage = hash_create("Global temporary relations in use locally",
> +									  128, &ctl, HASH_ELEM | HASH_BLOBS);
> +	}
> +
> +	/* Shared usage table */
> +	if (gtr_shared_usage == NULL)
> +	{
> +		/* Use a lock to ensure only one process creates the table */
> +		LWLockAcquire(GlobalTempRelControlLock, LW_EXCLUSIVE);
> +
> +		/* Be sure any local memory allocated by DSA routines is persistent */
> +		oldcontext = MemoryContextSwitchTo(TopMemoryContext);
>
> Likewise, narrow ctl to the first if and oldContext to the second.
>
> 5.
> +	 * the usage hash table entries for it.  Otherwise, reset the hash entry's
> +	 * subids to zero.
>
> Instead of zero, how about using an invalid sub-transaction ID?
>
> 6.
> +static void
> +gtr_process_invalidated_gtrs(void)
> +{
> +	MemoryContext oldcontext;
> +	Oid			relid;
> +
> +	/*
> +	 * Scan the gtrs_invalidated list and add any dropped relations to the
> +	 * gtrs_dropped list.  Since the transaction might fail later on, we need
> +	 * the gtrs_dropped list to persist until we can successfully process it.
> +	 */
> +	oldcontext = MemoryContextSwitchTo(TopMemoryContext);
> +
> +	/*
> +	 * As we scan the gtrs_invalidated list, more invalidation messages might
> +	 * arrive, so keep going until it is empty.
> +	 */
> +	while (gtrs_invalidated != NIL)
> +	{
> +		/* Pop the last relid from the list */
> +		relid = llast_oid(gtrs_invalidated);
>
> Restrict relid to the while loop scope.
>
> 7.
> +void
> +TrackGlobalTempRelationStorage(Oid relid, RelFileLocator rlocator,
> +							   ProcNumber backend, bool create)
> +{
> +	GtrStorageEntry *entry;
> +	bool		found;
> +	SMgrRelation srel;
> +
> +	if (create)
> +	{
> +		/* Initialize the storage table, if necessary */
> +		gtr_init_storage_table();
> +
> +		/* Insert an entry to track the storage */
> +		entry = hash_search(gtr_local_storage, &rlocator, HASH_ENTER, &found);
>
> Likewise, restrict found and srel to the if statement.
>
> 8.
> +		/* Register the ON COMMIT action for relation, if it's DELETE ROWS */
> +		Assert(relation->rd_rel->reloncommit == RELONCOMMIT_PRESERVE_ROWS ||
> +			   relation->rd_rel->reloncommit == RELONCOMMIT_DELETE_ROWS);
> +
> +		if (relation->rd_rel->reloncommit == RELONCOMMIT_DELETE_ROWS)
> +			register_on_commit_action(relation->rd_id, ONCOMMIT_DELETE_ROWS);
>
> How about moving the comment to just before the if statement?
>
> 9.
> +void
> +InvalidateGlobalTempRelation(Oid relid)
> +{
> +	MemoryContext oldcontext;
> +	HASH_SEQ_STATUS status;
> +	GtrUsageEntry *entry;
> +
> +	/* Quick exit if we haven't used any global temporary relations */
> +	if (gtr_local_usage == NULL)
> +		return;
>
> Restrict status and entry to the else statement.
>
> 10.
> +void
> +GlobalTempRelationDropped(Oid relid)
>
> Not a fan of this name, but no better idea yet.
>
> 11.
> +void
> +PreCommit_GlobalTempRelation(void)
> +{
> +	HASH_SEQ_STATUS status;
> +	GtrStorageEntry *storage_entry;
> +	Relation	rel;
> +
>
> Restrict rel to the while loop.
>
> 12.
> +List *
> +AllGlobalTempRelationsInUse(Oid dbid)
>
> How about GetGlobalTempReplationsInUse()?
>
> 13.
> +				ereport(ERROR,
> +						(errcode(ERRCODE_INVALID_TABLE_DEFINITION),
> +						 errmsg("cannot create relations in temporary schemas of other sessions")));
>
> For consistency with the above, I suggest changing the error message to:
>
>     cannot create global temporary relation in temporary schema of other sessions
>
> 14.
> +         * If they're global temp relations, reassign rel2's storage to rel1.
>
> We use "global temporary relations" elsewhere – should we keep the same
> terminology here?
>
> 15.
> +                     errmsg(RELATION_IS_GLOBAL_TEMP(relation)
> +                            ? "cannot create a local temporary relation as partition of global temporary relation \"%s\""
> +                            : "cannot create a temporary relation as partition of permanent relation \"%s\"",
>
> Should we use the following error message:
>
>     cannot create a local temporary relation as partition of permanent relation \"%s\"
>
> 16.
> +                            : relpersistence == RELPERSISTENCE_GLOBAL_TEMP
> +                            ? "cannot create a global temporary relation as partition of local temporary relation \"%s\""
>                              : "cannot create a permanent relation as partition of temporary relation \"%s\"",
>
> Same as above:
>
>     cannot create a permanent relation as partition of local temporary relation \"%s\"
>
> 17.
> +            if (RELATION_IS_GLOBAL_TEMP(OldHeap) &&
> +                IsOtherUsingGlobalTempRelation(RelationGetRelid(OldHeap)))
> +                ereport(ERROR,
> +                        errcode(ERRCODE_FEATURE_NOT_SUPPORTED),
> +                        errmsg("cannot rewrite global temporary table \"%s\" because it is being used in another session",
> +                               RelationGetRelationName(OldHeap)));
>
>
> 18.
> +                            errcode(ERRCODE_FEATURE_NOT_SUPPORTED),
> +                            errmsg("cannot add or alter constraints of global temporary table \"%s\" because it is being used in another session",
> +                                   get_rel_name(tab->relid)));
>
> 19.
>  			if (pkrel->rd_rel->relpersistence != RELPERSISTENCE_TEMP)
>  				ereport(ERROR,
>  						(errcode(ERRCODE_INVALID_TABLE_DEFINITION),
> -						 errmsg("constraints on temporary tables may reference only temporary tables")));
> +						 errmsg("constraints on local temporary tables may reference only local temporary tables")));
>  			if (!pkrel->rd_islocaltemp || !rel->rd_islocaltemp)
>  				ereport(ERROR,
>  						(errcode(ERRCODE_INVALID_TABLE_DEFINITION),
> -						 errmsg("constraints on temporary tables must involve temporary tables of this session")));
> +						 errmsg("constraints on local temporary tables must involve local temporary tables of this session")));
> +			break;
> +		case RELPERSISTENCE_GLOBAL_TEMP:
> +			if (!RELATION_IS_GLOBAL_TEMP(pkrel))
> +				ereport(ERROR,
> +						(errcode(ERRCODE_INVALID_TABLE_DEFINITION),
> +						 errmsg("constraints on global temporary tables may reference only global temporary tables")));
>
> s/global temporary table/global temporary relation/g
> s/local temporary table/local temporary relation/g
>
> 20.
>  		attachrel->rd_rel->relpersistence == RELPERSISTENCE_TEMP)
>  		ereport(ERROR,
>  				(errcode(ERRCODE_WRONG_OBJECT_TYPE),
> -				 errmsg("cannot attach a temporary relation as partition of permanent relation \"%s\"",
> +				 errmsg(RELATION_IS_GLOBAL_TEMP(rel)
> +						? "cannot attach a local temporary relation as partition of global temporary relation \"%s\""
> +						: "cannot attach a temporary relation as partition of permanent relation \"%s\"",
>  						RelationGetRelationName(rel))));
>
> Same as 15:
>
>     cannot attach a local temporary relation as partition of permanent relation \"%s\"
>
> 21.
>  		attachrel->rd_rel->relpersistence != RELPERSISTENCE_TEMP)
>  		ereport(ERROR,
>  				(errcode(ERRCODE_WRONG_OBJECT_TYPE),
> -				 errmsg("cannot attach a permanent relation as partition of temporary relation \"%s\"",
> +				 errmsg(RELATION_IS_GLOBAL_TEMP(attachrel)
> +						? "cannot attach a global temporary relation as partition of local temporary relation \"%s\""
> +						: "cannot attach a permanent relation as partition of temporary relation \"%s\"",
>  						RelationGetRelationName(rel))));
>
> Same as 16:
>
>     cannot attach a permanent relation as partition of local temporary relation \"%s\
>
> 22.
> @@ -22776,7 +22828,9 @@ createPartitionTable(List **wqueue, RangeVar *newPartName,
>  		newPartName->relpersistence == RELPERSISTENCE_TEMP)
>  		ereport(ERROR,
>  				errcode(ERRCODE_WRONG_OBJECT_TYPE),
> -				errmsg("cannot create a temporary relation as partition of permanent relation \"%s\"",
> +				errmsg(parent_relform->relpersistence == RELPERSISTENCE_GLOBAL_TEMP
> +					   ? "cannot create a local temporary relation as partition of global temporary relation \"%s\""
> +					   : "cannot create a temporary relation as partition of permanent relation \"%s\"",
>  					   RelationGetRelationName(parent_rel)));
>  
>  	/* Permanent rels cannot be partitions belonging to a temporary parent. */
>
> Suggestion:
>
>     cannot create a local temporary relation as partition of permanent relation \"%s\"
>
> 23.
> @@ -22784,7 +22838,9 @@ createPartitionTable(List **wqueue, RangeVar *newPartName,
>  		parent_relform->relpersistence == RELPERSISTENCE_TEMP)
>  		ereport(ERROR,
>  				errcode(ERRCODE_WRONG_OBJECT_TYPE),
> -				errmsg("cannot create a permanent relation as partition of temporary relation \"%s\"",
> +				errmsg(newPartName->relpersistence == RELPERSISTENCE_GLOBAL_TEMP
> +					   ? "cannot create a global temporary relation as partition of local temporary relation \"%s\""
> +					   : "cannot create a permanent relation as partition of temporary relation \"%s\"",
>  					   RelationGetRelationName(parent_rel)));
>
> Suggest:
>
>     cannot create a permanent relation as partition of local temporary relation \"%s\"
>
>

While testing the v5 patch, I noticed that the index of a table with ON COMMIT
DELETE ROWS has the PRESERVE ROWS flag.  See the example below.


	postgres=# CREATE EXTENSION pageinspect;
	CREATE EXTENSION
	postgres=# CREATE GLOBAL TEMPORARY TABLE gtt_delete (id int primary key, info text) ON COMMIT DELETE ROWS;
	CREATE TABLE
	postgres=# CREATE GLOBAL TEMPORARY TABLE gtt_preserve (id int primary key, info text);
	CREATE TABLE
	postgres=# SELECT relname, reloncommit FROM pg_class WHERE relname ~ '^gtt_.*';
	      relname      | reloncommit
	-------------------+-------------
	 gtt_delete        | d
	 gtt_delete_pkey   | p                <-- See here.
	 gtt_preserve      | p
	 gtt_preserve_pkey | p
	(4 rows)
	postgres=# BEGIN;
	BEGIN
	postgres=*# INSERT INTO gtt_delete SELECT id FROM generate_series(1, 10000) id;
	INSERT 0 10000
	postgres=*# SELECT * FROM bt_metap('gtt_delete_pkey');
	 magic  | version | root | level | fastroot | fastlevel | last_cleanup_num_delpages | last_cleanup_num_tuples | allequalimage
	--------+---------+------+-------+----------+-----------+---------------------------+-------------------------+---------------
	 340322 |       4 |    3 |     1 |        3 |         1 |                         0 |                      -1 | t
	(1 row)
	
	postgres=*# SELECT * FROM bt_page_items('gtt_delete_pkey', 1) limit 2;
	 itemoffset | ctid  | itemlen | nulls | vars |          data           | dead | htid  | tids
	------------+-------+---------+-------+------+-------------------------+------+-------+------
	          1 | (1,1) |      16 | f     | f    | 6f 01 00 00 00 00 00 00 |      |       |
	          2 | (0,1) |      16 | f     | f    | 01 00 00 00 00 00 00 00 | f    | (0,1) |
	(2 rows)
	
	postgres=*# END;
	COMMIT
	postgres=# SELECT * FROM bt_metap('gtt_delete_pkey');
	 magic  | version | root | level | fastroot | fastlevel | last_cleanup_num_delpages | last_cleanup_num_tuples | allequalimage
	--------+---------+------+-------+----------+-----------+---------------------------+-------------------------+---------------
	 340322 |       4 |    0 |     0 |        0 |         0 |                         0 |                      -1 | t
	(1 row)
	
	postgres=# SELECT * FROM bt_page_items('gtt_delete_pkey', 1) limit 2;
	ERROR:  block number 1 is out of range
	postgres=# BEGIN;
	BEGIN
	postgres=*# INSERT INTO gtt_preserve SELECT id FROM generate_series(1, 10000) id;
	INSERT 0 10000
	postgres=*# SELECT * FROM bt_metap('gtt_preserve_pkey');
	 magic  | version | root | level | fastroot | fastlevel | last_cleanup_num_delpages | last_cleanup_num_tuples | allequalimage
	--------+---------+------+-------+----------+-----------+---------------------------+-------------------------+---------------
	 340322 |       4 |    3 |     1 |        3 |         1 |                         0 |                      -1 | t
	(1 row)
	
	postgres=*# SELECT * FROM bt_page_items('gtt_preserve_pkey', 1) limit 2;
	 itemoffset | ctid  | itemlen | nulls | vars |          data           | dead | htid  | tids
	------------+-------+---------+-------+------+-------------------------+------+-------+------
	          1 | (1,1) |      16 | f     | f    | 6f 01 00 00 00 00 00 00 |      |       |
	          2 | (0,1) |      16 | f     | f    | 01 00 00 00 00 00 00 00 | f    | (0,1) |
	(2 rows)
	
	postgres=*# COMMIT;
	COMMIT
	postgres=# SELECT * FROM bt_metap('gtt_preserve_pkey');
	 magic  | version | root | level | fastroot | fastlevel | last_cleanup_num_delpages | last_cleanup_num_tuples | allequalimage
	--------+---------+------+-------+----------+-----------+---------------------------+-------------------------+---------------
	 340322 |       4 |    3 |     1 |        3 |         1 |                         0 |                      -1 | t
	(1 row)
	
	postgres=# SELECT * FROM bt_page_items('gtt_preserve_pkey', 1) limit 2;
	 itemoffset | ctid  | itemlen | nulls | vars |          data           | dead | htid  | tids
	------------+-------+---------+-------+------+-------------------------+------+-------+------
	          1 | (1,1) |      16 | f     | f    | 6f 01 00 00 00 00 00 00 |      |       |
	          2 | (0,1) |      16 | f     | f    | 01 00 00 00 00 00 00 00 | f    | (0,1) |
	(2 rows)


Is this expected behavior?

Since the index data for gtt_delete is cleared upon transaction commit, I would
expect its reloncommit flag to be 'd'.

-- 
Regards,
Japin Li
ChengDu WenWu Information Technology Co., Ltd.



Commits

  1. doc: clarify MERGE PARTITIONS adjacency requirement