pyqtdeploy-sysroot sources out of sync with Python-3.8.2

[Phil Thompson]

On 28/04/2020 15:39, Patrick Stinson wrote:
> It looks like pyqtdeploy-sysroot (v2.4) is looking for sources that
> don’t exist anymore in Python-3.8.2. After successfully building the
> host interpreter for "—target macos-64", building the sysroot fails
> with the following output:
> 
> Unpacking 'Python-3.8.2.tgz'
> Copying /Users/patrick/dev/vendor/src/Python-3.8.2.tgz to
> /Users/patrick/dev/vendor/sysroot-macos-64/build/Python-3.8.2
> Unpacking 'Python-3.8.2.tgz'
> Configuring Python v3.8.2 for macos-64
> Installing
> /Users/patrick/dev/vendor/sysroot-macos-64/build/Python-3.8.2/Python-3.8.2/Modules/config.c
> Generating
> /Users/patrick/dev/vendor/sysroot-macos-64/build/Python-3.8.2/Python-3.8.2/pyconfig.h
> Installing
> /Users/patrick/dev/vendor/sysroot-macos-64/build/Python-3.8.2/Python-3.8.2/python.pro
> Running '/Users/patrick/dev/vendor/sysroot-macos-64/qt/bin/qmake
> SYSROOT=/Users/patrick/dev/vendor/sysroot-macos-64'
> Info: creating stash file
> /Users/patrick/dev/vendor/sysroot-macos-64/build/Python-3.8.2/Python-3.8.2/.qmake.stash
> WARNING: Failure to find: Parser/bitset.c
> WARNING: Failure to find: Parser/metagrammar.c
> WARNING: Failure to find: Parser/firstsets.c
> WARNING: Failure to find: Parser/grammar.c
> WARNING: Failure to find: Parser/pgen.c
> WARNING: Failure to find: Modules/zipimport.c
> Running 'make'
> /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang
> -c -pipe -fwrapv -std=c99 -O3 -fPIC  -arch x86_64 -isysroot
> /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk
> -mmacosx-version-min=10.13 -w -DNDEBUG -DPy_BUILD_CORE
> -DVERSION=\"3.8\" -DVPATH=\".\" -DPREFIX=\"/\" -DEXEC_PREFIX=\"/\"
> -DPYTHONPATH=\"/lib/python3.8\" -DPLATFORM=\"darwin\"
> -DMULTIARCH=\"darwin\" -DABIFLAGS=\"m\" -I. -I. -IInclude
> -I../../../qt/mkspecs/macx-clang -o .obj/getbuildinfo.o
> Modules/getbuildinfo.c
> /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang
> -c -pipe -fwrapv -std=c99 -O3 -fPIC  -arch x86_64 -isysroot
> /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk
> -mmacosx-version-min=10.13 -w -DNDEBUG -DPy_BUILD_CORE
> -DVERSION=\"3.8\" -DVPATH=\".\" -DPREFIX=\"/\" -DEXEC_PREFIX=\"/\"
> -DPYTHONPATH=\"/lib/python3.8\" -DPLATFORM=\"darwin\"
> -DMULTIARCH=\"darwin\" -DABIFLAGS=\"m\" -I. -I. -IInclude
> -I../../../qt/mkspecs/macx-clang -o .obj/frozen.o Python/frozen.c
> /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang
> -c -pipe -fwrapv -std=c99 -O3 -fPIC  -arch x86_64 -isysroot
> /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk
> -mmacosx-version-min=10.13 -w -DNDEBUG -DPy_BUILD_CORE
> -DVERSION=\"3.8\" -DVPATH=\".\" -DPREFIX=\"/\" -DEXEC_PREFIX=\"/\"
> -DPYTHONPATH=\"/lib/python3.8\" -DPLATFORM=\"darwin\"
> -DMULTIARCH=\"darwin\" -DABIFLAGS=\"m\" -I. -I. -IInclude
> -I../../../qt/mkspecs/macx-clang -o .obj/acceler.o Parser/acceler.c
> /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang
> -c -pipe -fwrapv -std=c99 -O3 -fPIC  -arch x86_64 -isysroot
> /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk
> -mmacosx-version-min=10.13 -w -DNDEBUG -DPy_BUILD_CORE
> -DVERSION=\"3.8\" -DVPATH=\".\" -DPREFIX=\"/\" -DEXEC_PREFIX=\"/\"
> -DPYTHONPATH=\"/lib/python3.8\" -DPLATFORM=\"darwin\"
> -DMULTIARCH=\"darwin\" -DABIFLAGS=\"m\" -I. -I. -IInclude
> -I../../../qt/mkspecs/macx-clang -o .obj/grammar1.o Parser/grammar1.c
> /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang
> -c -pipe -fwrapv -std=c99 -O3 -fPIC  -arch x86_64 -isysroot
> /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk
> -mmacosx-version-min=10.13 -w -DNDEBUG -DPy_BUILD_CORE
> -DVERSION=\"3.8\" -DVPATH=\".\" -DPREFIX=\"/\" -DEXEC_PREFIX=\"/\"
> -DPYTHONPATH=\"/lib/python3.8\" -DPLATFORM=\"darwin\"
> -DMULTIARCH=\"darwin\" -DABIFLAGS=\"m\" -I. -I. -IInclude
> -I../../../qt/mkspecs/macx-clang -o .obj/listnode.o Parser/listnode.c
> /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang
> -c -pipe -fwrapv -std=c99 -O3 -fPIC  -arch x86_64 -isysroot
> /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk
> -mmacosx-version-min=10.13 -w -DNDEBUG -DPy_BUILD_CORE
> -DVERSION=\"3.8\" -DVPATH=\".\" -DPREFIX=\"/\" -DEXEC_PREFIX=\"/\"
> -DPYTHONPATH=\"/lib/python3.8\" -DPLATFORM=\"darwin\"
> -DMULTIARCH=\"darwin\" -DABIFLAGS=\"m\" -I. -I. -IInclude
> -I../../../qt/mkspecs/macx-clang -o .obj/node.o Parser/node.c
> /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang
> -c -pipe -fwrapv -std=c99 -O3 -fPIC  -arch x86_64 -isysroot
> /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk
> -mmacosx-version-min=10.13 -w -DNDEBUG -DPy_BUILD_CORE
> -DVERSION=\"3.8\" -DVPATH=\".\" -DPREFIX=\"/\" -DEXEC_PREFIX=\"/\"
> -DPYTHONPATH=\"/lib/python3.8\" -DPLATFORM=\"darwin\"
> -DMULTIARCH=\"darwin\" -DABIFLAGS=\"m\" -I. -I. -IInclude
> -I../../../qt/mkspecs/macx-clang -o .obj/parser.o Parser/parser.c
> make: *** No rule to make target `Parser/bitset.c', needed by
> `.obj/bitset.o'.  Stop.
> pyqtdeploy-sysroot: Execution failed: returned exit code 2
> 
> Then when I add the following to python.pro,
> 
>     greaterThan(PY_MAJOR_VERSION, 2) {
> 
> 
>         lessThan(PY_MINOR_VERSION, 8) {
> 
> 
> 
> 
> 
>             PARSER_SOURCES += \
> 
> 
>                 Parser/bitset.c \
> 
> 
>                 Parser/metagrammar.c \
> 
> 
>                 Parser/firstsets.c \
> 
> 
>                 Parser/grammar.c \
> 
> 
>                 Parser/pgen.c \
> 
> 
> 
> 
> 
>         }
> 
> 
> 
> 
> 
>         greaterThan(PY_MINOR_VERSION, 7) {
> 
> 
>             PARSER_SOURCES += Parser/token.c
> 
> 
>         }
> 
> 
>     }
> 
>     greaterThan(PY_MINOR_VERSION, 5):lessThan(PY_MINOR_VERSION, 8) {
> 
> 
>         MOD_SOURCES += \
> 
> 
>             Modules/_io/winconsoleio.c \
> 
> 
>             Modules/zipimport.c
> 
> 
>     }
> 
> The non-host target build fails with the following message:
> 
> 
> /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/clang
> -c -pipe -fwrapv -std=c99 -O3 -fPIC  -arch x86_64 -isysroot
> /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk
> -mmacosx-version-min=10.13 -w -DNDEBUG -DPy_BUILD_CORE
> -DVERSION=\"3.8\" -DVPATH=\".\" -DPREFIX=\"/\" -DEXEC_PREFIX=\"/\"
> -DPYTHONPATH=\"/lib/python3.8\" -DPLATFORM=\"darwin\"
> -DMULTIARCH=\"darwin\" -DABIFLAGS=\"m\" -I. -I. -IInclude
> -I../../../qt/mkspecs/macx-clang -o .obj/myreadline.o
> Parser/myreadline.c
> Parser/myreadline.c:13:10: fatal error: 'pycore_pystate.h' file not 
> found
> #include "pycore_pystate.h"
>          ^~~~~~~~~~~~~~~~~~
> 1 error generated.
> make: *** [.obj/myreadline.o] Error 1
> pyqtdeploy-sysroot: Execution failed: returned exit code 2
> 
> 
> I imagine I’m missing something basic about version compatibility here?

Yes, v3.8 isn't supported.

Phil