| Lists: | pgsql-committerspgsql-hackers |
|---|
| From: | Robert Haas <rhaas(at)postgresql(dot)org> |
|---|---|
| To: | pgsql-committers(at)postgresql(dot)org |
| Subject: | pgsql: Support parallel aggregation. |
| Date: | 2016-03-21 13:33:28 |
| Message-ID: | E1ahzxY-0004qA-GJ@gemulon.postgresql.org |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Lists: | pgsql-committers pgsql-hackers |
Support parallel aggregation.
Parallel workers can now partially aggregate the data and pass the
transition values back to the leader, which can combine the partial
results to produce the final answer.
David Rowley, based on earlier work by Haribabu Kommi. Reviewed by
Álvaro Herrera, Tomas Vondra, Amit Kapila, James Sewell, and me.
Branch
------
master
Details
-------
http://git.postgresql.org/pg/commitdiff/e06a38965b3bcdaa881e7e06892d4d8ab6c2c980
Modified Files
--------------
src/backend/executor/execQual.c | 8 +
src/backend/nodes/copyfuncs.c | 1 +
src/backend/nodes/equalfuncs.c | 1 +
src/backend/nodes/nodeFuncs.c | 2 +-
src/backend/nodes/outfuncs.c | 1 +
src/backend/nodes/readfuncs.c | 1 +
src/backend/optimizer/path/allpaths.c | 3 +-
src/backend/optimizer/path/costsize.c | 12 +-
src/backend/optimizer/plan/createplan.c | 4 +-
src/backend/optimizer/plan/planner.c | 520 ++++++++++++++++++++++++++++----
src/backend/optimizer/plan/setrefs.c | 251 ++++++++++++++-
src/backend/optimizer/prep/prepunion.c | 4 +-
src/backend/optimizer/util/clauses.c | 79 +++++
src/backend/optimizer/util/pathnode.c | 16 +-
src/backend/optimizer/util/tlist.c | 45 +++
src/backend/parser/parse_func.c | 3 +-
src/include/catalog/catversion.h | 2 +-
src/include/nodes/primnodes.h | 11 +-
src/include/nodes/relation.h | 2 +
src/include/optimizer/clauses.h | 18 ++
src/include/optimizer/cost.h | 2 +-
src/include/optimizer/pathnode.h | 7 +-
src/include/optimizer/tlist.h | 1 +
23 files changed, 911 insertions(+), 83 deletions(-)
| From: | David Fetter <david(at)fetter(dot)org> |
|---|---|
| To: | Robert Haas <rhaas(at)postgresql(dot)org> |
| Cc: | PG Hackers <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | Re: [COMMITTERS] pgsql: Support parallel aggregation. |
| Date: | 2016-03-21 14:35:21 |
| Message-ID: | 20160321143521.GA12277@fetter.org |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Lists: | pgsql-committers pgsql-hackers |
On Mon, Mar 21, 2016 at 01:33:28PM +0000, Robert Haas wrote:
> Support parallel aggregation.
...and there was much rejoicing!
Cheers,
David.
--
David Fetter <david(at)fetter(dot)org> http://fetter.org/
Phone: +1 415 235 3778 AIM: dfetter666 Yahoo!: dfetter
Skype: davidfetter XMPP: david(dot)fetter(at)gmail(dot)com
Remember to vote!
Consider donating to Postgres: http://www.postgresql.org/about/donate
| From: | Robert Haas <robertmhaas(at)gmail(dot)com> |
|---|---|
| To: | David Fetter <david(at)fetter(dot)org> |
| Cc: | PG Hackers <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | Re: [COMMITTERS] pgsql: Support parallel aggregation. |
| Date: | 2016-03-21 14:39:27 |
| Message-ID: | CA+TgmoZKEnFHDOOhbSa+v=r8wTi2B1w-RvCjYutc9kwYatk66w@mail.gmail.com |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Lists: | pgsql-committers pgsql-hackers |
On Mon, Mar 21, 2016 at 10:35 AM, David Fetter <david(at)fetter(dot)org> wrote:
> On Mon, Mar 21, 2016 at 01:33:28PM +0000, Robert Haas wrote:
>> Support parallel aggregation.
>
> ...and there was much rejoicing!
I know *I* am!
--
Robert Haas
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company
| From: | Simon Riggs <simon(at)2ndQuadrant(dot)com> |
|---|---|
| To: | David Fetter <david(at)fetter(dot)org> |
| Cc: | Robert Haas <rhaas(at)postgresql(dot)org>, PG Hackers <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | Re: [COMMITTERS] pgsql: Support parallel aggregation. |
| Date: | 2016-03-21 14:43:46 |
| Message-ID: | CANP8+jL8w4vnGq0rHFNMsn-B=RY-1xhBKhU4UWw3SYT+ykKwPQ@mail.gmail.com |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Lists: | pgsql-committers pgsql-hackers |
On 21 March 2016 at 14:35, David Fetter <david(at)fetter(dot)org> wrote:
> On Mon, Mar 21, 2016 at 01:33:28PM +0000, Robert Haas wrote:
> > Support parallel aggregation.
>
> ...and there was much rejoicing!
>
+1
Well done all.
--
Simon Riggs http://www.2ndQuadrant.com/
<http://www.2ndquadrant.com/>
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
| From: | Bert <biertie(at)gmail(dot)com> |
|---|---|
| To: | Simon Riggs <simon(at)2ndquadrant(dot)com> |
| Cc: | David Fetter <david(at)fetter(dot)org>, Robert Haas <rhaas(at)postgresql(dot)org>, PG Hackers <pgsql-hackers(at)postgresql(dot)org> |
| Subject: | Re: [COMMITTERS] pgsql: Support parallel aggregation. |
| Date: | 2016-03-21 14:57:49 |
| Message-ID: | CAFCtE1=dyqg6MomnogrEBgX4TVy06FEtfPmMGOr9u_p3pvUEyg@mail.gmail.com |
| Views: | Raw Message | Whole Thread | Download mbox | Resend email |
| Lists: | pgsql-committers pgsql-hackers |
#woopwoop! :-D great work, all!
On Mon, Mar 21, 2016 at 3:43 PM, Simon Riggs <simon(at)2ndquadrant(dot)com> wrote:
> On 21 March 2016 at 14:35, David Fetter <david(at)fetter(dot)org> wrote:
>
>> On Mon, Mar 21, 2016 at 01:33:28PM +0000, Robert Haas wrote:
>> > Support parallel aggregation.
>>
>> ...and there was much rejoicing!
>>
>
> +1
>
> Well done all.
>
> --
> Simon Riggs http://www.2ndQuadrant.com/
> <http://www.2ndquadrant.com/>
> PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
>
--
Bert Desmet
0477/305361