@tobim Thank you for the preemptive musl fix.

python3Packages.awkward is now failing due to the deprecation warning, do you mind fixing that package and then I think this is good to merge

https://github.com/NixOS/nixpkgs/pull/87638
6 package failed to build:
python37Packages.awkward python37Packages.uproot python37Packages.uproot-methods python38Packages.awkward python38Packages.uproot python38Packages.uproot-methods

8 package built:
arrow-cpp python37Packages.google_cloud_bigquery python37Packages.ibis-framework python37Packages.intake python37Packages.pyarrow python38Packages.google_cloud_bigquery python38Packages.intake python38Packages.pyarrow

@jonringer I think I will just disable the pyarrow support as per upstream
scikit-hep/awkward-0.x@220bd8d
Note that pythonPackages.awkward is to be EOL and superseded by pythonPackages.awkward1 sometime in the future.

Thank you for the preemptive musl fix.

I only fixed the build, unfortunately the static build is not usable atm and requires a bit more work:
apache/arrow#6220. We could disable jemalloc support for static builds in the meantime.

@veprbl Maybe so. But I would like to avoid introducing regressions.

do you mind applying this diff?

diff --git a/pkgs/development/python-modules/awkward/default.nix b/pkgs/development/python-modules/awkward/default.nix
index bd933205f6a..a1cc0f4431b 100644
--- a/pkgs/development/python-modules/awkward/default.nix
+++ b/pkgs/development/python-modules/awkward/default.nix
@@ -19,7 +19,7 @@ buildPythonPackage rec {
   };

   nativeBuildInputs = [ pytestrunner ];
-  checkInputs = [ pandas pyarrow pytest h5py ];
+  checkInputs = [ pandas pytest h5py ];
   propagatedBuildInputs = [ numpy ];

   checkPhase = ''

We could disable jemalloc support for static builds in the meantime.

Not sure if that would work. There are other non-optional vendored libraries like uriparser.

Apache Arrow 0.17.1 (14 May 2020)

Bug

• ARROW-8503 - [Packaging][deb] Can't build apache-arrow-archive-keyring for RC
• ARROW-8505 - [Release][C#] "sourcelink test" is failed by Apache.Arrow.AssemblyInfo.cs
• ARROW-8584 - [Packaging][C++] Protobuf link error in deb builds
• ARROW-8608 - [C++] Update vendored mpark/variant.h to latest to fix NVCC compilation issues
• ARROW-8609 - [C++] ORC JNI bridge crashed on null arrow buffer
• ARROW-8641 - [Python] Regression in feather: no longer supports permutation in column selection
• ARROW-8657 - [Python][C++][Parquet] Forward compatibility issue from 0.16 to 0.17 when using version='2.0'
• ARROW-8684 - [Python] "SystemError: Bad call flags in _PyMethodDef_RawFastCallDict" in Python 3.7.7 on macOS when using pyarrow wheel
• ARROW-8694 - [Python][Parquet] parquet.read_schema() fails when loading wide table created from Pandas DataFrame
• ARROW-8704 - [C++] Fix Parquet crash on invalid input (OSS-Fuzz)
• ARROW-8706 - [C++][Parquet] Tracking JIRA for PARQUET-1857 (unencrypted INT16_MAX Parquet row group limit)
• ARROW-8728 - [C++] Bitmap operation may cause buffer overflow
• ARROW-8741 - [Python][Packaging] Keep VS2015 with for the windows wheels
• ARROW-8750 - [Python] pyarrow.feather.write_feather does not default to lz4 compression if it's available
• PARQUET-1857 - [C++][Parquet] ParquetFileReader unable to read files with more than 32767 row groups

Improvement

• ARROW-8501 - [Packaging][RPM] Upgrade devtoolset to 8 on CentOS 6
• ARROW-8549 - [R] Assorted post-0.17 release cleanups
• ARROW-8699 - [R] Fix automatic r_to_py conversion
• ARROW-8758 - [R] Updates for compatibility with dplyr 1.0
• ARROW-8786 - [Packaging][rpm] Use bundled zstd in the CentOS 8 build

@GrahamcOfBorg build arrow-cpp python3Packages.pyarrow
@GrahamcOfBorg build python38Packages.pyarrow
@GrahamcOfBorg build pkgsi686Linux.arrow-cpp
@GrahamcOfBorg build pkgsStatic.arrow-cpp

@veprbl jemalloc is the only vendored dependency that is built in a separate archive (the others are linked into libarrow.a directly).

@tobim My understanding is that the problem is already present in the current 0.16.0? If that is the case, we can merge this and address the static build later.

I'm getting build failures for arrow-cpp on darwin at the moment. It looks related to this change.

CMake Error at cmake_modules/ThirdpartyToolchain.cmake:1860 (get_target_property):
  get_target_property() called with non-existent target "ZSTD::zstd".

@HuwCampbell
0.17.1 was building on darwin at some point: https://hydra.nixos.org/build/119292492
Let's wait for apache/arrow#7388

Blocked by another regression fixed by #90218