Cloud Storage Integrations
This section covers integrations with cloud storage providers. All cloud storage integrations use the HTTP Task with appropriate authentication methods.
Available Providers
| Provider | Auth Type | S3-Compatible |
|---|---|---|
| AWS S3 | AWS Signature V4 | Yes (native) |
| Azure Blob Storage | SAS Token | No |
| GCP Cloud Storage | Service Account | No |
| OVH Object Storage | AWS Signature V4 | Yes |
| Scaleway Object Storage | AWS Signature V4 | Yes |
S3-Compatible Providers
Many cloud providers offer S3-compatible object storage. These providers use AWS Signature V4 authentication and can be configured similarly to AWS S3:
- OVH Object Storage
- Scaleway Object Storage
- Cloudflare R2
- MinIO
- Backblaze B2
Common Operations
All cloud storage integrations support these common operations:
| Operation | HTTP Method | Description |
|---|---|---|
| List objects | GET | List objects in a bucket/container |
| Upload file | PUT/POST | Upload a file to storage |
| Download file | GET | Download a file from storage |
| Delete file | DELETE | Delete a file from storage |
Authentication Overview
AWS Signature V4
Used by AWS S3 and S3-compatible providers (OVH, Scaleway, Cloudflare R2, MinIO, Backblaze B2).
json
{
"authentication": {
"useAuthentication": true,
"type": "AWS_SIGNATURE_V4",
"accessKeyId": "${workflow.variables.access_key_id}",
"secretAccessKey": "${workflow.variables.secret_access_key}",
"region": "${workflow.variables.region}",
"service": "s3"
}
}1
2
3
4
5
6
7
8
9
10
2
3
4
5
6
7
8
9
10
Azure SAS Token
Used by Azure Blob Storage. The SAS token is appended to the URL.
json
{
"path": "/container/file.txt?${workflow.variables.sas_token}",
"headers": {
"x-ms-version": "2021-06-08"
}
}1
2
3
4
5
6
2
3
4
5
6
GCP Service Account
Used by Google Cloud Platform services.
json
{
"authentication": {
"useAuthentication": true,
"type": "GCP_SERVICE_ACCOUNT_KEY",
"gcpServiceAccountKeyProjectId": "${workflow.variables.gcp_project_id}",
"gcpServiceAccountKeyPrivateKeyId": "${workflow.variables.gcp_private_key_id}",
"gcpServiceAccountKeyPrivateKey": "${workflow.variables.gcp_private_key}",
"gcpServiceAccountKeyClientEmail": "${workflow.variables.gcp_client_email}",
"gcpServiceAccountKeyClientId": "${workflow.variables.gcp_client_id}",
"gcpServiceAccountKeyScope": ["https://www.googleapis.com/auth/cloud-platform"]
}
}1
2
3
4
5
6
7
8
9
10
11
12
2
3
4
5
6
7
8
9
10
11
12