52 questions
0
votes
1
answer
212
views
Scraping audit logs from storage accounts
I tried reading azure diagnostic logs from storage accounts via Grafana Loki and Promtail, and it works with old logs that are already archived. As soon as I try to instantaneously scrape diagnostic ...
0
votes
1
answer
1k
views
CORS Configuration for Cloudflare R2
i am a super rookie for this. I tried to store some of my data for analysis on cloudflare R2. And when I read it in python by pandas, it said HTTP Error 403: Forbidden. This also when I try to import ...
1
vote
1
answer
165
views
How to connect an OCI function to OCI NoSQL with Go
I am trying to use the Go SDKs that OCI provides:
OCI SDK for Go
Oracle NoSQL Database Go SDK
I am trying to connect using a config file in the same folder that looks like this:
[DEFAULT]
tenancy=...
0
votes
0
answers
98
views
ibm cloud object storage Error: connect (ETIMEDOUT 10.1.129.66:443)
I was implementing the following node.js code
I have created COS but there is an error in response
import S3 from "ibm-cos-sdk/clients/s3.js";
var config = {
endpoint: 's3.private.jp-...
0
votes
1
answer
90
views
Configuring CORS using CLI in IBM Cloud Object Storage Bucket
p@p:/home$ ibmcloud cos bucket-cors-put --bucket test --cors-configuration "./corsconfig.json"
FAILED
The value in flag '--cors-configuration' is invalid
NAME:
ibmcloud cos bucket-cors-...
2
votes
3
answers
3k
views
unable to login in ibm cloud from cli
Authenticating...
Credentials were rejected.
Code: BXNIM0602E, message: The credentials you entered for the user '<email>' are incorrect.
I have verified my credentials while typing it, ...
0
votes
2
answers
951
views
Accessing object storage bucket with a pre-authenticated request using oci java sdk
I have only preauthenticated URL,namespace and bucket name. Is there any way to upload and download data using key with help of oci java sdk. Is there a proper documentation for this, and If there is ...
4
votes
1
answer
2k
views
Testing thanos object storage upload without waiting 2 hours
I was working on a docker-compose file using Prometheus to remote write data to a Thanos receiver. This data would then be queried by Thanos Querier as well as uploaded to minIO. When configuring the ...
1
vote
1
answer
61
views
What is privatekey in oracle objectstorage?
c, clerr := objectstorage.NewObjectStorageClientWithConfigurationProvider(common.NewRawConfigurationProvider(
"ocid1.tenancy.oc1..aaaaaaa5jo3pz1alm1o45rzx1ucaab4njxbwaqqbc7ld3l6biayjaert5la&...
0
votes
1
answer
62
views
IBM cloud Public access
Can people access my source code when i create public access as object reader in order to host a static website in cloud object storage?
And what are all the risk of public access?
1
vote
0
answers
350
views
Install Zenko Cloud Server on ubuntu 20.04 for development purpose
For a couple of days, I have been trying to install the Zenko cloud server for development purposes on my ubuntu 20.04 machine. I am new to Docker and definitely not very much comfortable with ...
1
vote
1
answer
94
views
Are object storage objects technically object oriented class instances?
While every guide describes object storage objects as data with metaproperties, can they also be referred to as objects (i.e. class instantiation) in a OOP technical sense, of how they are implemented?...
0
votes
1
answer
574
views
IBM Cloud Object Storage: Unable to create a bucket
I am unable to create a bucket on my IBM Cloud Object Storage (COS) instance. Each time I try the "create bucket" in the console, it is always blank (gray) with an error sign hovering over ...
0
votes
1
answer
140
views
Watson Assistant image responses
Do you know if by making the images "Public" in IBM Cloud Object Storage it really becomes public meaning you can find the resources through web browser as google? or it becomes like "...
0
votes
1
answer
289
views
does oracle cloud infrastructure supports ACLs?
I am curious regarding whether OCI object storage supports ACLs at the object and bucket levels? I have gone through their documentation and found out that they don't support ACLs at the object level. ...
0
votes
1
answer
328
views
Is Oracle Cloud Infrastructure support tagging at object level?
I was going through the oci python SDK for OCI. I am unable to find any way to add tags to object storage objects from the SDK. that's why got a doubt whether OCI supports tagging at the object level ...
0
votes
2
answers
1k
views
Revoke the signed URL of the object that was created in GCP Cloud storage
Suppose I have this scenario where I created a signed URL to GCP object using the private key of the service account using the following command.
$ gsutil signurl -d 10m <private-key> gs://<...
1
vote
1
answer
695
views
Transfer files from IBM Cloud Object storage to Azure blob
Hi I want to migrate a huge volume of files as a cronjob from my IBM Cloud Object Storage to Azure. Simplest way is to download from IBM cloud to some intermediate server and upload it to Azure. But, ...
0
votes
1
answer
213
views
Is IBM Object Storage S3 have the compatible API with CEPH storage?
The question, pretty much, says it all, but in order to be more specific on the subject.
A production system is going to using CEPH storage which I know it has RESTful API that is compatible with the ...
-1
votes
1
answer
594
views
Configure CORS in IBM Cloud Object Storage Bucket using CLI
I am trying to configure CORS in my IBM Cloud Object Storage bucket. I dont see any option to do that from bucket configuration in UI and I can see it can only be done through CLI. The command looks ...
2
votes
2
answers
312
views
getObject operation returning metadata instead of object content from GCP in camel-spring boot application
I have a spring boot application using camel to connect to google object storage to get an object (text or photo).
This is the code I'm running:
package footballRestAPIs;
import org.apache.camel....
2
votes
1
answer
3k
views
ERROR 401 Unauthorized: Anonymous caller does not have storage.buckets.get access to the Google Cloud Storage bucket in spring boot application
I have a spring boot application that is using camel to get data from object storage (google cloud platform).
This my code in eclipse:
package footballRestAPIs;
import org.apache.camel.builder....
0
votes
0
answers
213
views
Elasticsearch snapshot and store to IBM Object Store using `repository-s3`
I am trying to setup S3 Repository as a IBM Object Store.
I have configured, in the elasticsearch.yml
s3.client.default.endpoint: "s3.ap.cloud-object-storage.appdomain.cloud"
And for the ...
0
votes
1
answer
437
views
What are the dependecies I should add to use Oracel Object Store using java SDK
Following is my build.gradle file with dependencies
plugins {
id 'java'
}
dependencyManagement {
imports {
mavenBom 'com.oracle.oci.sdk:oci-java-sdk-bom:2.6.0'
}
}
dependencies {
...
0
votes
1
answer
349
views
What is the difference between OSS and RDS
It seems i do not fully understand the difference between OSS and RDS.
Both can store data, RDS is good for structured data, and OSS seems to be able to store most types of data (and should be able to ...
0
votes
1
answer
612
views
S3 / COS: rclone authentication using config for IBM Cloud fails
I am trying to use rclone utility for transfer from AWS S3 to IBM COS.
It works for AWS S3 but not sure why it fails for IBM COS.
Using the service credentials , API key as access key id and resource ...
0
votes
0
answers
160
views
How can I manipulate my VPC(Virtual Private Cloud) instance with COS in a Python application ? (IBM Cloud)
I'm trying to write an algorithm with Python that gets a file from COS(IBM Cloud Object Store) and transfer it to a VPC(Virtual private Cloud). .
I'm using this code to try to do this process:
from ...
0
votes
3
answers
899
views
How do I access an IBM Cloud Object Storage instance to use in Watson Studio?
I am working on a course and the project had me create an account in IBM Cloud (all are in the Lite/Free account), then create an instance of IBM Watson Studio, then try to create a new, empty project....
0
votes
2
answers
355
views
Edit object data in IBM Cloud Object Storage or skip the first few rows when reading data
How to edit object data in IBM Cloud Object Storage or skip the first few rows when reading data.
I want to edit my files on IBM COS by using API directly, do we have any API can help to achieve? ...
0
votes
1
answer
964
views
How to get a direct URL to a file on IBM Cloud Object Storage that has access key id and secret access key
I am trying to access a file in a bucket on s3.us.cloud-object-storage and it has an access point id and secret access key and I cant find a way to type a url that gives me access. Can some one help? ...
0
votes
1
answer
934
views
Spark-submit with Stocator failing with Class com.ibm.stocator.fs.ObjectStoreFileSystem not found error
I am trying to run spark-submit wordcount Python on a Kubernetes cluster by pulling a text file stored in COS.
For the config, I followed the Stocator README.md
./bin/spark-submit \
--master k8s://...
0
votes
0
answers
479
views
Upload large files from the Workbook Object to the IBM Cloud Object Storage using the Java
I am creating a large excel file and while uploading it using the Java SDK for the IBM Cloud Object Storage I getting the following
com.ibm.cloud.objectstorage.services.s3.model.AmazonS3Exception: ...
0
votes
1
answer
435
views
How to use Aspera Hot Folder feature to download large files from COS
I have been using Aspera Hot folder Feature to download large files (100GB+) from a vendor server (A). I am trying to do similar downloads from another vendor (B) who has large files on IBM COS. I ...
0
votes
1
answer
282
views
How do I access objects stored in COS (IBM Cloud) and display it to a webpage built in Django and deployed in Cloud Foundry?
I have a Django web app where I am showing videos. This web app is deployed using CloudFoundry. My videos are stored in a bucket in Object Storage of IBM Cloud. How do I access the objects so that the ...
2
votes
1
answer
5k
views
This value does not have any attributes error while trying to use COS HMAC credentials in Terraform?
I am trying to use HMAC credentials for Cloud Object Storage/S3 in Terraform but seeing this error.
Error: Unsupported attribute
on main.tf line 56, in resource "ibm_cos_bucket" "...
0
votes
1
answer
338
views
How to delete multiple key from digitalocean space object storage?
I am trying to delete multiple object once by using delete_objects. But i am getting an error. I didn’t found any solution regarding to this issue.
client = boto3.client("s3", **config)
...
1
vote
2
answers
2k
views
IBM Cloud Object Storage: Get bucket size using CLI
I'm trying to find a way to automate the task of getting COS bucket sizes on IBM Cloud.
I have dozens of buckets over different accounts but still couldn't find a way to get this information using IBM ...
1
vote
1
answer
2k
views
How to upload an image to IBM Cloud object storage (COS) using Node.js?
I am using ibm-cos-sdk but I can able to store text files only, but I want to upload images and pdf files. Can someone help me out of that?
0
votes
1
answer
4k
views
Service: Amazon S3; Status Code: 404; Error Code: NoSuchBucket; Trouble getting a file from IBM Cloud Object Storage
I am trying to get a file from a bucket in IBM cloud object storage. For this, first I am trying to read all the available files in a bucket.
private static List<String> listBuckets(AmazonS3 ...
1
vote
1
answer
264
views
Getting an error "Reseller channel 2c95500b-ea86-4b13-8bb5-b2f0c2fa8200 is invalid." when I try to create a cloud object storage
I created the watson service and went to create a new project. It expects me to add Cloud Object Storage. When I chose the Lite option and press create I get this error "Reseller channel 2c95500b-...
0
votes
1
answer
556
views
Linking IBM Cloud Object Storage to Watson Studio new project?
I've attempted to create object storage for a new Watson Studio project, but get the same 'Reseller channel...is invalid' as other comments.
I've tried changing my region from Dallas, to London or ...
0
votes
0
answers
264
views
File not uploading to ibm cloud object storage using python getting an error
So I was trying to upload a file to my bucket. here is the code for it :-
import ibm_boto3
from ibm_botocore.client import Config
cos = ibm_boto3.client(service_name='s3',use_ssl=False,verify=False,
...
2
votes
1
answer
784
views
IBM Cloud: creating S3-compatible creds for a bucket via API
TL;DR How can we automate the creation of per-user credentials to access COS buckets using the S3 compatibility layer?
The only documented way AFAIK is the CLI; but embedding command-line executions ...
1
vote
0
answers
141
views
Can't create a cloud object storage on a lite account in IBM Cloud
I'm unable to create a cloud object storage plan on my lite account. Everything is fine but it keeps on bringing this error.
[409, Conflict] The account already has an instance created with the
Lite ...
1
vote
1
answer
559
views
IBM Cloud: How can I enable Public Access on a storage bucket from CLI?
I successfully enable Public Access to one of my buckets in IBM Cloud Object Storage and used the console (browser UI). I followed these steps. In the UI, the access group is shown as Public Access ...
0
votes
3
answers
2k
views
How to connect to IBM COS (Cloud Object Store) using SPARK, How to resolve "No FileSystem for scheme: cos"
I am trying to create connection to IBM COS (Cloud Object Store) using Spark.
Spark Version = 2.4.4, Scala Version = 2.11.12.
I am running it locally with correct credentials but I observe ...
0
votes
1
answer
1k
views
IBM Cloud Object Storage with VPC cluster
I have been following this guide in order to add IBM Cloud object storage to my cluster.
While I have gotten it to work with a standard cluster, I have issues when trying to connect the COS to the ...
0
votes
2
answers
4k
views
Should I use nginx reverse proxy for cloud object storage?
I am currently implementing image storing architecture for my service.
As I read in one article it is a good idea to move whole
image upload and download traffic to the external cloud object storage....
1
vote
0
answers
18
views
Can't delete a functions namespace
I've created a Functions namespace in order to test COS triggers, I've already delete all triggers and functions but when I try to delete the namespace I receive this message
"Namespace deletion not ...
1
vote
1
answer
191
views
What REST API load_source and params do I use to load CSV data from IBM COS S3 to IBM Db2 on Cloud
I have been unable to use the Db2 on Cloud REST API to load data from a file in IBM Cloud Object Storage (COS). This is preventing a hybrid integration POC.
Another user has reported similar REST API ...