Horton

Re: JIT compiling with LLVM v10.0

Dmitry Dolgov <9erthalion6@gmail.com>

View thread View on postgr.es
From: Dmitry Dolgov <9erthalion6@gmail.com>
To: Andreas Karlsson <andreas@proxel.se>
Cc: Andres Freund <andres@anarazel.de>, PostgreSQL-development <pgsql-hackers@postgresql.org>
Date: 2018-02-08T14:14:42Z
Lists: pgsql-hackers 
> On 8 February 2018 at 10:29, Andreas Karlsson <andreas@proxel.se> wrote:
>> On 02/07/2018 03:54 PM, Andres Freund wrote:
>>
>> I've pushed v10.0. The big (and pretty painful to make) change is that
>> now all the LLVM specific code lives in src/backend/jit/llvm, which is
>> built as a shared library which is loaded on demand.
>
>
> It does not seem to be possible build without LLVM anymore.

Maybe I'm doing something wrong, but I also see some issues during compilation
even with llvm included (with gcc 5.4.0 and 7.1.0). Is it expected, do I need
to use another version to check it out?

    $ git rev-parse HEAD
    e24cac5951575cf86f138080acec663a0a05983e

    $ ./configure --prefix=/build/postgres-jit/ --with-llvm
--enable-debug --enable-depend --enable-cassert

    In file included from llvmjit_error.cpp:22:0:
    /usr/lib/llvm-5.0/include/llvm/Support/ErrorHandling.h:47:36:
warning: identifier 'nullptr' is a keyword in C++11 [-Wc++0x-compat]
                                        void *user_data = nullptr);
                                        ^
    In file included from /usr/include/c++/5/cinttypes:35:0,
                     from /usr/lib/llvm-5.0/include/llvm/Support/DataTypes.h:39,
                     from /usr/lib/llvm-5.0/include/llvm-c/Types.h:17,
                     from ../../../../src/include/jit/llvmjit.h:13,
                     from llvmjit_error.cpp:24:
    /usr/include/c++/5/bits/c++0x_warning.h:32:2: error: #error This
file requires compiler and library support for the ISO C++ 2011
standard. This support must be enabled with the -std=c++11 or
-std=gnu++11 compiler options.
     #error This file requires compiler and library support \
      ^
    In file included from llvmjit_error.cpp:22:0:
    /usr/lib/llvm-5.0/include/llvm/Support/ErrorHandling.h:47:54:
error: 'nullptr' was not declared in this scope
                                        void *user_data = nullptr);
                                                          ^
    /usr/lib/llvm-5.0/include/llvm/Support/ErrorHandling.h:57:56:
error: 'nullptr' was not declared in this scope
                                          void *user_data = nullptr) {
                                                            ^
    /usr/lib/llvm-5.0/include/llvm/Support/ErrorHandling.h:98:56:
error: 'nullptr' was not declared in this scope
                                          void *user_data = nullptr);
                                                            ^
    /usr/lib/llvm-5.0/include/llvm/Support/ErrorHandling.h:121:45:
error: 'nullptr' was not declared in this scope
     llvm_unreachable_internal(const char *msg = nullptr, const char
*file = nullptr,
                                                 ^
    /usr/lib/llvm-5.0/include/llvm/Support/ErrorHandling.h:121:73:
error: 'nullptr' was not declared in this scope
     llvm_unreachable_internal(const char *msg = nullptr, const char
*file = nullptr,
                                                                             ^
    ../../../../src/Makefile.global:838: recipe for target
'llvmjit_error.o' failed
    make[2]: *** [llvmjit_error.o] Error 1
    make[2]: Leaving directory '/postgres/src/backend/jit/llvm'
    Makefile:42: recipe for target 'all-backend/jit/llvm-recurse' failed
    make[1]: *** [all-backend/jit/llvm-recurse] Error 2
    make[1]: Leaving directory '/postgres/src'
    GNUmakefile:11: recipe for target 'all-src-recurse' failed
    make: *** [all-src-recurse] Error 2

Commits

  1. Improve JIT docs.

  2. Add documentation for the JIT feature.

  3. Add EXPLAIN support for JIT.

  4. Add inlining support to LLVM JIT provider.

  5. JIT tuple deforming in LLVM JIT provider.

  6. Add FIELDNO_* macro designating offset into structs required for JIT.

  7. Add expression compilation support to LLVM JIT provider.

  8. Expand list of synchronized types and functions in LLVM JIT provider.

  9. Add helpers for emitting LLVM IR.

  10. Basic planner and executor integration for JIT.

  11. Debugging and profiling support for LLVM JIT provider.

  12. Support for optimizing and emitting code in LLVM JIT provider.

  13. Add file containing extensions of the LLVM C API.

  14. Basic JIT provider and error handling infrastructure.

  15. Add configure infrastructure (--with-llvm) to enable LLVM support.

  16. Add C++ support to configure.

  17. Add PGAC_PROG_VARCC_VARFLAGS_OPT autoconf macro.

  18. Fix VM buffer pin management in heap_lock_updated_tuple_rec().

  19. Allow tupleslots to have a fixed tupledesc, use in executor nodes.

  20. Expression evaluation based aggregate transition invocation.

  21. Perform slot validity checks in a separate pass over expression.

  22. Rely on executor utils to build targetlist for DML RETURNING.

  23. Refer to OS X as "macOS", except for the port name which is still "darwin".