310 questions
0
votes
1
answer
71
views
OpenStack Swift CLI prefix-based tempurl not working
running
swift tempurl --prefix-based GET 600 "/v1/AUTH_project/container/my/prefix/" "mykey12345"
returns
/v1/AUTH_project/container/my/prefix/?temp_url_sig=abc0987&...
0
votes
1
answer
67
views
Error 422: Unprocessable Entity errors with Openstack python-swiftclient
I am writing a Python script using python-swiftclient and zipfile to zip and upload files to the Swift API endpoint of an Openstack Object Store. I store the zipped data in memory as an io.BytesIO ...
1
vote
0
answers
175
views
Having issues with PyInstaller and the Python-Keystoneclient package
---Relevant Info---
Custom Hook
# -*- mode: python ; coding: utf-8 -*-
from PyInstaller.utils.hooks import collect_submodules
from PyInstaller.utils.hooks import copy_metadata
from PyInstaller.utils....
0
votes
1
answer
72
views
multiple destination for statsd in object-server.conf of swift open stack
I want to send my statsd metrics from object server module of swift open stack to multiple hosts.
How should I change my object-server.conf in /etc/swift path?
The present version of object-server....
0
votes
1
answer
136
views
Trouble Retrieving Metadata Information from OpenStack Swift Object using REST APIs: Need Help Adding Metadata from Horizon UI or REST API properly
I am new to OpenStack Swift and I am trying to add single/multiple metadata to an object using REST APIs. However, although I receive a 202 success response for the request, when I try to retrieve the ...
0
votes
1
answer
293
views
What issues arise when using Openstack Swift SAIO for Production use?
Swift Use Case
I am currently working on an application that could leverage the ability to add in custom middleware into Swift. Currently that involves a custom auth middleware module, but could be ...
0
votes
1
answer
109
views
is there a way to revert a expiration date for an object in openstack swift?
WIth openstack swift I can set a date for an object to be expired.
After this date or at this date a daemon will take care of delete the object. But if I regreat and want to cancel the expiration date,...
0
votes
1
answer
243
views
Failed to discover available identity versions when contacting http://127.0.0.1:35357/v3. Attempting to parse version from URL. Unauthorized(HTTP 401)
I am using openstack container to enable integration testing against swift
The container used is : https://hub.docker.com/r/jeantil/openstack-swift-keystone-docker/
And the steps followed are : https:/...
0
votes
1
answer
976
views
Copy a lot of files - Swift
I own Object Storage containers at OVH. I found how to copy a file from one container to another:
swift copy -d /"Destination container" "Initial container" "File"
It ...
0
votes
1
answer
589
views
Reducing replication on Openstack Swift
Is it possible to limit replication on OpenStack Swift to one or possibly 2? 3 data replicas are currently being created.
0
votes
1
answer
246
views
How make API calls to OpenStack installed on local machine from outside the network?
I installed OpenStack on my local Ubuntu machine and can access the dashboard using a local IP address. I want to get the list of files on the storage from an external Spring Boot application.
I ...
0
votes
2
answers
1k
views
Thread blocks the main thread
I'm not python programmer.
But I need to write middleware for Openstack Swift. I don't know what environment the code running in. I have no control over the main thread.
I'm tyring to start sub-thread ...
0
votes
1
answer
101
views
OpenIO swift deny host headers
OpenIO 7.2.0.
I have an OpenIO with keystone (queens) auth cluster.
By default any user can configure his own acls and public url.
I would like to restrict user only for read and write in containers ...
0
votes
1
answer
694
views
How to create ec2 credentials with openstacksdk or boto3?
I need to create ec2 credentials, analog to CLI command:
openstack ec2 credentials create
which should return me access and secret keys.
I had run over https://docs.openstack.org/openstacksdk/latest/...
0
votes
1
answer
543
views
OpenStack Swift List Columns
How can I have the OpenStack Swift cli list the columns in the output for the swift list like swift list --lh?
I currently see the following
user@server1:~$ swift list --lh
164006 30G 2020-03-...
1
vote
1
answer
346
views
Is there a practical limit to the number of files in a Swift container?
A solution I work on stores files in OpenStack's Swift but the files are spread out into multiple containers. I have been told this is because the performance is awful after about a million files in a ...
0
votes
1
answer
358
views
why Openstack swift Object start giving me the below error?
Hi I am trying to start openstack swift container, object, account but everytime I am getting the same error for those three cases.
root@nijhum-17101142:/etc/swift# swift-init object start
Starting ...
0
votes
1
answer
74
views
customizing openstack swfit middleware
I want to write openstack/swift middleware. but I don't know where to put my code after development so that I can put it on the pipeline later.
According to it's document I have to put it on /opt/...
0
votes
2
answers
566
views
OVH "get_version_v3() got an unexpected keyword argument 'auth'"
I'm trying to switch from openStack v2 to v3 but I'm having trouble requesting a token.
here is the POST request
{
"auth": {
"identity": {
...
0
votes
0
answers
533
views
How to split InputStream into multiple BoundedInputStream without knowing total stream size?
I'm looking at an open source Swift library that is able to split an InputStream into multiple BoundedInputStream objects, given a total stream size (to know when to stop creating bounded input ...
0
votes
1
answer
1k
views
401 Unauthorized when using s3 API for Swift Openstack
I am getting the following error running this:
Command:
[root@controller s3-curl]# ./s3curl.pl --debug -id personal http://controller:8080/v1/AUTH_aa58420177714dc89e6f06bf96dee164/container1/s3-curl....
0
votes
1
answer
106
views
PHP SDK Opencloud/Openstack - How to add X-Storage-Policy in header?
I am using php sdk openstack v1 for opencloud and I would like to know while creating container I want to add custom header for "X-Storage-Policy" then how can i add custom header?
1
vote
0
answers
336
views
openstack-swift with OVH returns 401 Unauthorized
I'm using a swift bucket on OVH
The CLI tool swift -A $OS_AUTH_URL -U $OS_USERNAME -K $OS_PASSWORD list -l foto-condivise works smoothly.
My config is:
s3proxy:
image: andrewgaul/s3proxy
...
1
vote
0
answers
149
views
PySpark cannot parse metadata from openstack
I'm trying to read a json file stored on my OVH object storage (openstack).
I set everything up :
import pyspark
from pyspark.sql.session import SparkSession
spark = SparkSession.builder.appName("...
0
votes
1
answer
359
views
Keystone v3 on OVH
I am curreny using cyberduck for the storage cloud of ovh.
However, I received an email from OVH to inform me that I have to move from keystone v2.0 to keystone v3 before 24/03/2020.
I have tried a ...
1
vote
2
answers
1k
views
Disable ability to list objects in OVH OpenStack Object Storage
I created an OVH Public Cloud Object Storage Public Container and I can't disable the ability for everyone to list objects in this container. OVH uses OpenStack Object Storage.
It is really annoying, ...
0
votes
1
answer
231
views
Want to upload a sqlite.db file to a swift container using python swiftclient and always get a utf-8 error
i am trying to upload a sqlite.db(binary file) to a swift container using swiftclient in my python code.
import swiftclient
swift_conn.put_object
File "/usr/lib/python3.7/codecs.py", line 322, in ...
0
votes
1
answer
111
views
Big Data Database on top of OpenStack Swift
Is it possible to have a database like Cassandra or any other on top of openstack swift so there is no need to worry about data size? Is this a common approach or is several small servers the better ...
0
votes
2
answers
1k
views
Openstack Swift installation: admin-openrc
I would like to setup an Openstack Swift cluster on Centos 7 with TempAuth authentication method.
In the prerequisite section of the official tutorial it is requested to source the admin-openrc ...
1
vote
0
answers
362
views
What is the best way to zip a file in Swift storage without physically downloading it?
We're using openstack swift what is the best way to zip a file which already is uploaded to swift container.
We need to this because we don't want to ideally download this file as it will be quite ...
0
votes
1
answer
342
views
Access Openstack Swift from Spark - SwiftAuthenticationFailedException
I am attempting to access Openstack Swift from Spark 2.4 but I get an error.
org.apache.hadoop.fs.swift.exceptions.SwiftAuthenticationFailedException: Authenticate as tenant '...
0
votes
1
answer
402
views
How to save output of python-swiftclient to file when dowloading a directory?
Sometimes I get errors when I download files from a cloud with python-swiftclient, like this one:
Error downloading object 'uploads/1/image.png': Object GET failed: https://orbit.brightbox.com/v1/...
0
votes
2
answers
782
views
Access Public URLs from IBM Cloud storage
I have created a IBM cloud Object storage service and i have created objects i.e image files in it.
I am looking for the steps to access the images as public URLs. I did some initial research and ...
0
votes
1
answer
140
views
How to integration Openstack with glusterfs cinder volume
I'm currently using ocata ROD distbution and l'm trying to implement openstack with glusterfs as a cinder volume. But I'm getting module load error.
Please advise if ocata is supporting ...
0
votes
1
answer
2k
views
Download file from object storage through asp net core
I have files stored in an Openstack Swift container (object storage). I usually access them through an API, like this :
_oApi.Swift.GetObject(containerName, fileName, outputStream);
Now, I have a ...
3
votes
0
answers
844
views
Spring Boot app consuming Ceph Swift API via JOSS Swift Client
I am very new to Ceph and not yet very seasoned with Spring Boot Java application development either. I have set up a Ceph Object Storage cluster with Swift Object Gateway.
Now I have a Spring Boot ...
1
vote
1
answer
478
views
How to configure rsync with password in OpenStack Swift
I am currently working on Swfit. For safe, the op ask me to set password for rsync.
While, as we use Swift, we just set rsync work as server with "/etc/rsync.conf" , then Swift works as the client ...
2
votes
0
answers
43
views
what will happen when writing and read Openstack Swift object at the same time
I am learning Openstack swift storage. What will happen when updating/writing and reading Openstack Swift object/container at the same time?
Any hints welcomed. Thanks
1
vote
1
answer
66
views
Can I use username in ACL of openstack swift
From doc, the ACL should look like <project-id>:<user-id>.
But does <project-id>:<user-name> also work?
1
vote
0
answers
58
views
StoredObjectListElement in Javaswift/JOSS does not match openstack swift API?
I am reading JOSS here. I got the following Class definition from https://github.com/javaswift/joss/blob/master/src/main/java/org/javaswift/joss/command/shared/container/StoredObjectListElement.java.
...
3
votes
1
answer
6k
views
Confused by tenant, project, user, account in openstack and swift
I am confused by tenant in openstack and swift.
I have multiple machines on C3 under tenant called myTenant. Here tenant is the same with project. I cannot understand what do tenant and project mean ...
1
vote
0
answers
86
views
How to connetct (accessing) to IBM cloud object store swift from R?
How to connect to IBM cloud object swift with R?
I've had that informations:
auth_url = "https://dal05.objectstorage.softlayer.net/auth/v1.0",
username = "my_user_name",
password = "...
0
votes
1
answer
901
views
how to configure openstack swift proxy with nginx
How to configure open stack swift proxy with Nginx? Basically I want to upload large file to swift storage node through swift proxy without REST interface.
Is it possible to upload a file with out ...
1
vote
2
answers
24k
views
rsync "connection refused" error
I'm getting crazy with rsync which gives me a "connection refused" error. Here's my problem:
I have two servers, used to store datas, with rsync installed on because I need that both servers stay ...
0
votes
1
answer
411
views
Can't Get Authenticate Swift ContextBuilder with Latest OpenStack
i have installed the latest OpenStack and I'm using Java and jclouds SDK to interact with OpenStack Swift, in the OpenStack environment that I'm using, the identity API version is /identity/v3/ and ...
0
votes
1
answer
139
views
Two questions about OpenStack Swift ring function
I'm new in Swift and I'm trying to learn its functionality. I have two question for you regarding the ring and the consistent hashing algorithm.
When we want to store an object, we take its path (for ...
0
votes
1
answer
307
views
Uploading to OpenStack Multipart With Path
I'm using java Jclouds to upload to a container inside an OpenStack Swift, the upload is going fine on the root, but when i pass a path(contains folders then the file), the file is uploaded but also ...
0
votes
1
answer
257
views
Uploading to Swift Container with Metadata
im using Java and the jclouds SDK to upload files to a Swift container as multipart, the uploading is going fine yet i need to add metadata to the file, i noticed that there is a function called ...
4
votes
0
answers
456
views
Can't delete Swift Object from Swift Container
I uploaded malware file into benign container by mistake, and I'm trying it.
I'm trying to remove file from 'Malware_Files' container. I know it's there because of the 'get' command, but the 'delete' ...
0
votes
1
answer
492
views
Upload Very Large File to Swift Container
I'm using jclouds java SDK to upload to Swift Container i saw the code in which i upload as a multipart,i already upload as a multipart as input stream using the code
try (ByteArrayInputStream ...