Horton

Thread

  1. How long does iteration over 4-5 million rows usually take?

    Shaozhong SHI <shishaozhong@gmail.com> — 2022-04-02T01:34:26Z

    I have a script running to iterate over 4-5 million rows.  It keeps showing
up in red in PgAdmin.  It remains active.

How long does iteration over 4-5 million rows usually take?

Regards,

David

  2. How long does iteration over 4-5 million rows usually take?

    Shaozhong SHI <shishaozhong@gmail.com> — 2022-04-02T01:35:04Z

    I have a script running to iterate over 4-5 million rows.  It keeps showing
up in red in PgAdmin.  It remains active.

How long does iteration over 4-5 million rows usually take?

Regards,

David

  3. Re: How long does iteration over 4-5 million rows usually take?

    Adrian Klaver <adrian.klaver@aklaver.com> — 2022-04-02T01:47:42Z

    On 4/1/22 18:34, Shaozhong SHI wrote:
> 
> I have a script running to iterate over 4-5 million rows.  It keeps 
> showing up in red in PgAdmin.  It remains active.
> 
> How long does iteration over 4-5 million rows usually take?

Given that there is no real information provided in the problem 
description there is no chance for an answer more detailed then; as long 
as it takes.

> 
> Regards,
> 
> David


-- 
Adrian Klaver
adrian.klaver@aklaver.com

  4. Re: How long does iteration over 4-5 million rows usually take?

    Ron <ronljohnsonjr@gmail.com> — 2022-04-02T02:18:45Z

    On 4/1/22 20:34, Shaozhong SHI wrote:
>
> I have a script running to iterate over 4-5 million rows.  It keeps 
> showing up in red in PgAdmin.  It remains active.
>
> How long does iteration over 4-5 million rows usually take?

What /*exactly*/ are you doing?


-- 
Angular momentum makes the world go 'round.

  5. Re: How long does iteration over 4-5 million rows usually take?

    Rob Sargent <robjsargent@gmail.com> — 2022-04-02T13:21:00Z

    
> On Apr 1, 2022, at 10:18 PM, Ron <ronljohnsonjr@gmail.com> wrote:
> 
>  On 4/1/22 20:34, Shaozhong SHI wrote:
>> 
>> I have a script running to iterate over 4-5 million rows.  It keeps showing up in red in PgAdmin.  It remains active.
>> 
>> How long does iteration over 4-5 million rows usually take?

4-5 million times as long as it takes to do one iteration ( if you’re doing it correctly)

  6. Aw: Re: How long does iteration over 4-5 million rows usually take?

    Karsten Hilbert <karsten.hilbert@gmx.net> — 2022-04-02T13:46:55Z

    > > On Apr 1, 2022, at 10:18 PM, Ron <ronljohnsonjr@gmail.com> wrote:
> > 
> >  On 4/1/22 20:34, Shaozhong SHI wrote:
> >> 
> >> I have a script running to iterate over 4-5 million rows.  It keeps showing up in red in PgAdmin.  It remains active.
> >> 
> >> How long does iteration over 4-5 million rows usually take?
> 
> 4-5 million times as long as it takes to do one iteration ( if you’re doing it correctly)

I may not take quite that long because setup/teardown times might not be needed for each iteration.

Best,
Karsten

  7. Re: Re: How long does iteration over 4-5 million rows usually take?

    Shaozhong SHI <shishaozhong@gmail.com> — 2022-04-02T14:16:14Z

    Thanks, Karsten,

I would like the information to work planning purpose.

Regards,

David

On Sat, 2 Apr 2022 at 14:47, Karsten Hilbert <Karsten.Hilbert@gmx.net>
wrote:

> > > On Apr 1, 2022, at 10:18 PM, Ron <ronljohnsonjr@gmail.com> wrote:
> > >
> > >  On 4/1/22 20:34, Shaozhong SHI wrote:
> > >>
> > >> I have a script running to iterate over 4-5 million rows.  It keeps
> showing up in red in PgAdmin.  It remains active.
> > >>
> > >> How long does iteration over 4-5 million rows usually take?
> >
> > 4-5 million times as long as it takes to do one iteration ( if you’re
> doing it correctly)
>
> I may not take quite that long because setup/teardown times might not be
> needed for each iteration.
>
> Best,
> Karsten
>
>
>

  8. Re: Re: How long does iteration over 4-5 million rows usually take?

    Benedict Holland <benedict.m.holland@gmail.com> — 2022-04-02T14:34:34Z

    For work planning, create a temporary table, copy from a generated data
set, and test it out. It really depends. Normally, you don't iterate in SQL
since rows are assumed to be independent. You think about SQL in terms of
sets and let application code handle the data transfers. It also really
depends on the size of your tables, indexing, joins, and more. Basically,
there isn't really an answer but it isnt hard to test.

Thanks,
Ben


On Sat, Apr 2, 2022, 10:16 AM Shaozhong SHI <shishaozhong@gmail.com> wrote:

> Thanks, Karsten,
>
> I would like the information to work planning purpose.
>
> Regards,
>
> David
>
> On Sat, 2 Apr 2022 at 14:47, Karsten Hilbert <Karsten.Hilbert@gmx.net>
> wrote:
>
>> > > On Apr 1, 2022, at 10:18 PM, Ron <ronljohnsonjr@gmail.com> wrote:
>> > >
>> > >  On 4/1/22 20:34, Shaozhong SHI wrote:
>> > >>
>> > >> I have a script running to iterate over 4-5 million rows.  It keeps
>> showing up in red in PgAdmin.  It remains active.
>> > >>
>> > >> How long does iteration over 4-5 million rows usually take?
>> >
>> > 4-5 million times as long as it takes to do one iteration ( if you’re
>> doing it correctly)
>>
>> I may not take quite that long because setup/teardown times might not be
>> needed for each iteration.
>>
>> Best,
>> Karsten
>>
>>
>>

  9. Re: How long does iteration over 4-5 million rows usually take?

    Steve Midgley <science@misuse.org> — 2022-04-02T16:38:41Z

    On Fri, Apr 1, 2022 at 6:35 PM Shaozhong SHI <shishaozhong@gmail.com> wrote:

>
>
> I have a script running to iterate over 4-5 million rows.  It keeps
> showing up in red in PgAdmin.  It remains active.
>
> How long does iteration over 4-5 million rows usually take?
>
>
Please share the SQL query, schema, and sample data. If you are using a
third party script with a db connector, then the answer is much harder to
answer.