Does Gcloud Storage Python Client Api Support Parallel Composite Upload?

The gsutil command has options to optimize upload/download speed for large files. For example GSUtil:parallel_composite_upload_threshold=150M GSUtil:sliced_object_download_max_comp

Solution 1:

I think it's not natively supported.

However (!) if you're willing to decompose files then use threading or multiprocessing, there is a compose method that should help you assemble the parts into one GCS object.

Ironically, gsutil is written in Python but it uses a library gslib to implement parallel uploads. You may be able to use gslib as a template.