Skip to content

Commit

Permalink
Added the rclone utility plugin
Browse files Browse the repository at this point in the history
  • Loading branch information
edgarrmondragon committed Sep 24, 2024
1 parent fdf7390 commit a34d607
Showing 1 changed file with 74 additions and 0 deletions.
74 changes: 74 additions & 0 deletions _data/meltano/utilities/rclone/rclone.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,74 @@
# Subcommands
commands:
config:
args: config
sync:
args: sync

name: rclone
namespace: rclone
pip_url: rclone-bin
settings:

# Global settings
- env: RCLONE_LOG_LEVEL
kind: options
name: log_level
options:
- label: DEBUG
value: DEBUG
- label: INFO
value: INFO
- label: NOTICE
value: NOTICE
- label: ERROR
value: ERROR
- kind: boolean
env: RCLONE_USE_JSON_LOG

Check failure on line 27 in _data/meltano/utilities/rclone/rclone.yml

View workflow job for this annotation

GitHub Actions / Lint YAML files

27:3 [key-ordering] wrong ordering of key "env" in mapping
name: use_json_log
- description: IO idle timeout (default 5m0s)
kind: integer
name: timeout

# Local settings
- description: Force the filesystem to report itself as case insensitive.
env: RCLONE_LOCAL_CASE_SENSITIVE
kind: boolean
name: local.case_sensitive

# S3
- description: AWS Access Key ID
env: RCLONE_S3_ACCESS_KEY_ID
kind: string
name: s3.access_key_id
- description: Endpoint for S3 API
env: RCLONE_S3_ENDPOINT
kind: string
name: s3.endpoint
- description: Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars)
kind: boolean
name: env_auth
- description: S3 provider
kind: options
name: s3.provider
options:
- label: AWS
value: AWS
- label: Ceph
value: Ceph
- label: DigitalOcean Spaces
value: DigitalOcean
- label: Minio
value: Minio
- description: Region to connect to
env: RCLONE_S3_REGION
kind: string
name: s3.region
- description: AWS Secret Access Key (password)
env: RCLONE_S3_SECRET_ACCESS_KEY
kind: password
name: s3.secret_access_key
sensitive: true
usage: |
meltano invoke rclone:config
meltano invoke rclone:sync source:path dest:path

0 comments on commit a34d607

Please sign in to comment.