Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
2.0.1
-
None
Description
Swift recommends storing the large object segments in a separate container [1]. I propose changing jclouds to do the same. The Swift convention – in their python library – is to create a "<container>_segments" container for the segments.
We need to consider ways to reduce the number of HEAD requests jclouds would make for container existence. One possible way could be to assume the container exists for the segments and create it if the PUT requests return 404. I will need to look through the existing MPU abstraction to figure out the other caveats to work out in this improvement.
1. https://docs.openstack.org/developer/swift/overview_large_objects.html