mirror of
https://github.com/seaweedfs/seaweedfs.git
synced 2026-06-13 23:36:45 +03:00
Page:
File Operations Quick Reference
Pages
A typical step‐by‐step example
AWS CLI with SeaweedFS
AWS IAM CLI
Actual Users
Admin UI OIDC
Admin UI
Amazon IAM API
Amazon S3 API
Applications
Async Backup
Async Filer Metadata Backup
Async Replication to Cloud
Async Replication to another Filer
Benchmark SeaweedFS as a GlusterFS replacement
Benchmarks from jinleileiking
Benchmarks
Cache Remote Storage
Choosing a Filer Store
Client Libraries
Cloud Drive Architecture
Cloud Drive Benefits
Cloud Drive Quick Setup
Cloud Monitoring
Cloud Tier
Cluster Plan Day 2 Operations
Cluster Plan Inventory Reference
Cluster Plan Workflow
Components
Configure Remote Storage
Cryptography and FIPS Compliance
Customize Filer Store
Data Backup
Data Structure for Large Files
Deployment to Kubernetes and Minikube
Deployment with seaweed up
Directories and Files
Distributed POSIX Locks
Distributing AI Model Files for Multi GPU Loading
Docker Compose for S3
Docker Image Registry with SeaweedFS
Doris Iceberg Integration
Dremio Iceberg Integration
DuckDB Iceberg Integration
EC Bitrot Detection
Environment Variables
Erasure Coding for warm storage
Error reporting to sentry
FAQ
FIO benchmark
FUSE Mount
Failover Master Server
File Operations Quick Reference
Filer Active Active cross cluster continuous synchronization
Filer Cassandra Setup
Filer Change Data Capture
Filer Commands and Operations
Filer Data Encryption
Filer JWT Use
Filer Metadata Events
Filer Notification Webhook
Filer Operation Serialization
Filer Redis Setup
Filer Server API
Filer Setup
Filer Store Replication
Filer Stores
Filer as a Key Large Value Store
Gateway to Remote Object Storage
Getting Started
HDFS via S3 connector
Hadoop Benchmark
Hadoop Compatible File System
Hardware
Hobbyest Tinkerer scale on premises tutorial
Home
Iceberg Table Maintenance
Independent Benchmarks
Kafka to Kafka Gateway to SMQ to SQL
Kubernetes Backups and Recovery with K8up
Kubernetes ServiceAccount Authentication
Lakekeeper Iceberg Integration
Large File Handling
Load Command Line Options from a file
Master Server API
Migrate Maintenance Scripts to Admin Script Plugin
Migrate to Filer Store
Mount Remote Storage
OIDC Integration
Optimization for Many Small Buckets
Optimization
P2P reading in weed mount
POSIX Compliance
Path Specific Configuration
Path Specific Filer Store
Plugin Worker Scheduling
PostgreSQL compatible Server weed db
Production Setup
Pub Sub to SMQ to SQL
Quick Start with weed mini
Replication
RisingWave Iceberg Integration
Run Blob Storage on Public Internet
Run Presto on SeaweedFS
Rust Volume Server
S3 API Audit log
S3 API Benchmark
S3 API FAQ
S3 Bucket Policies
S3 Bucket Quota
S3 CORS
S3 Conditional Operations
S3 Configuration
S3 Credentials
S3 Lifecycle Architecture
S3 Lifecycle Monitoring
S3 Lifecycle Operator Guide
S3 Lifecycle Troubleshooting
S3 Lifecycle vs Volume TTL
S3 Lifecycle
S3 Nginx Proxy
S3 Object Lock and Retention
S3 Object Versioning
S3 Policy Conditions
S3 Policy Variables
S3 Rate Limiting
S3 Table Bucket Commands
S3 Table Bucket
S3 Tables Security
SFTP Server
SQL Queries on Message Queue
SQL Quick Reference
SRV Service Discovery
Seaweed Message Queue
SeaweedFS Architecture
SeaweedFS Iceberg Catalog
SeaweedFS Java Client
SeaweedFS in Docker Swarm
Security Configuration
Security Overview
Server Side Encryption SSE C
Server Side Encryption SSE KMS
Server Side Encryption
Server Startup via Systemd
Simplest S3 Bucket and User Setup
Spark Iceberg Integration
Store file with a Time To Live
Structured Data Lake with SMQ and SQL
Super Large Directories
Supported APIs vs Minio
System Metrics
TUS Resumable Uploads
TensorFlow with SeaweedFS
Tiered Storage
Trino Iceberg Integration
UrBackup with SeaweedFS
Use Cases
Volume Files Structure
Volume Management
Volume Server API
WebDAV
Words from SeaweedFS Users
Worker
fstab and systemd mount
nodejs with Seaweed S3
rclone with SeaweedFS
restic with SeaweedFS
run HBase on SeaweedFS
run Spark on SeaweedFS
s3cmd with SeaweedFS
weed shell
Clone
1
File Operations Quick Reference
chrislusf edited this page 2025-08-11 12:05:07 -07:00
File Operations Quick Reference
This page provides a quick reference for common file operations in SeaweedFS using the HTTP API.
Basic File Operations
Upload a File
Small files (direct upload):
# Upload with PUT
curl -X PUT "http://localhost:8888/path/to/file.txt" -d "file content"
# Upload with POST (multipart)
curl -X POST "http://localhost:8888/path/to/file.txt" -F "file=@localfile.txt"
Download a File
# Get file content
curl "http://localhost:8888/path/to/file.txt"
# Download to local file
curl "http://localhost:8888/path/to/file.txt" -o localfile.txt
Delete a File
# Delete single file
curl -X DELETE "http://localhost:8888/path/to/file.txt"
# Delete directory (recursive)
curl -X DELETE "http://localhost:8888/path/to/directory/?recursive=true"
Advanced File Operations
Move/Rename Files
# Move file to new location
curl -X POST "http://localhost:8888/new/path/file.txt?mv.from=/old/path/file.txt"
# Rename file in same directory
curl -X POST "http://localhost:8888/path/to/newname.txt?mv.from=/path/to/oldname.txt"
Copy Files ⭐ New Feature
# Copy file (preserves original)
curl -X POST "http://localhost:8888/backup/file.txt?cp.from=/original/file.txt"
# Copy with automatic name resolution
curl -X POST "http://localhost:8888/backup/?cp.from=/original/file.txt"
# Result: /backup/file.txt
List Directory Contents
# List directory
curl -H "Accept: application/json" "http://localhost:8888/path/to/directory/?pretty=y"
# List with pagination
curl -H "Accept: application/json" "http://localhost:8888/path/?limit=10&lastFileName=somefile.txt"
Create Directory
# Create empty directory
curl -X POST "http://localhost:8888/path/to/new/directory/"
File Metadata Operations
Get File Information
# Get file metadata
curl -I "http://localhost:8888/path/to/file.txt"
File Attributes and Tagging
# Set custom attributes
curl -X PUT "http://localhost:8888/path/to/file.txt" \
-H "Seaweed-Custom-Attribute: value" \
-F "file=@localfile.txt"
# Set TTL (time to live)
curl -X POST "http://localhost:8888/path/to/file.txt?ttl=3600" \
-F "file=@localfile.txt"
Response Codes
| HTTP Code | Operation | Meaning |
|---|---|---|
| 200 OK | GET | File retrieved successfully |
| 201 Created | POST/PUT | File uploaded successfully |
| 204 No Content | DELETE, COPY, MOVE | Operation completed successfully |
| 400 Bad Request | Any | Invalid parameters or unsupported operation |
| 404 Not Found | GET, DELETE | File or directory not found |
| 409 Conflict | POST/PUT | File already exists (when using exclusive creation) |
Operation Comparison
| Operation | Source File | Use Case | Performance |
|---|---|---|---|
| Upload | External → SeaweedFS | Add new files | Network dependent |
| Download | SeaweedFS → External | Retrieve files | Network dependent |
Move (mv.from) |
Deleted | Rename/relocate | Very fast (metadata only) |
Copy (cp.from) |
Preserved | Backup/duplicate | Depends on file size |
| Delete | Deleted | Remove files | Fast |
Best Practices
When to Use Copy vs Move
Use Copy (cp.from) when:
- Creating backups before modifications
- Duplicating configuration templates
- Staging files for testing
- Need to preserve original file
Use Move (mv.from) when:
- Renaming files
- Reorganizing file structure
- Moving files between directories
- Don't need original file
Performance Tips
- Batch operations: Group multiple operations when possible
- Small files: Use direct PUT for files < 1MB
- Large files: POST with multipart automatically chunks files
- Copy operations: Server-side copy is much faster than download + upload
- Directory operations: Plan directory structure to minimize reorganization
Error Handling
# Check operation status
if curl -X POST "http://localhost:8888/dest?cp.from=/src" -w "%{http_code}" -o /dev/null -s | grep -q "204"; then
echo "Copy successful"
else
echo "Copy failed"
fi
Related Documentation
- Filer Server API - Complete API reference
- Filer Commands and Operations - Command-line tools
- Getting Started - Installation and setup
- FAQ - Common questions and answers
Examples Repository
For more complex examples and use cases, see:
- SeaweedFS Examples (if available)
- Community-contributed scripts and tools
- Language-specific client libraries
💡 Tip: Use the ?pretty=y parameter with JSON responses to get formatted output for easier reading during development and testing.
Introduction
- Quick Start with weed mini
- Simplest S3 Bucket and User Setup
- Components
- Getting Started
- Production Setup
- A typical step‐by‐step example
- Benchmarks
- FAQ
- Applications
API
Configuration
- Replication
- Store file with a Time To Live
- Failover Master Server
- Erasure coding for warm storage
- EC Bitrot Detection
- Server Startup via Systemd
- Environment Variables
Filer
- Filer Setup
- Directories and Files
- File Operations Quick Reference
- Data Structure for Large Files
- Filer Data Encryption
- Filer Commands and Operations
- Filer JWT Use
- TUS Resumable Uploads
Filer Stores
- Filer Cassandra Setup
- Filer Redis Setup
- Super Large Directories
- Path-Specific Filer Store
- Choosing a Filer Store
- Customize Filer Store
Management
Advanced Filer Configurations
- Migrate to Filer Store
- Add New Filer Store
- Filer Store Replication
- Filer Active Active cross cluster continuous synchronization
- Filer as a Key-Large-Value Store
- Path Specific Configuration
- Filer Change Data Capture
- Filer Operation Serialization
FUSE Mount
- FIO benchmark
- fstab and systemd mount
- POSIX Compliance
- Distributed POSIX Locks
- P2P reading in weed mount
WebDAV
SFTP Server
Cloud Drive
- Cloud Drive Benefits
- Cloud Drive Architecture
- Configure Remote Storage
- Mount Remote Storage
- Cache Remote Storage
- Cloud Drive Quick Setup
- Gateway to Remote Object Storage
AWS S3 API
- Amazon S3 API
- Supported APIs vs Minio
- S3 Lifecycle
- S3 Lifecycle vs Volume TTL
- S3 Conditional Operations
- S3 CORS
- S3 Object Lock and Retention
- S3 Object Versioning
- S3 API Benchmark
- S3 API FAQ
- S3 Bucket Quota
- S3 Rate Limiting
- S3 API Audit log
- S3 Nginx Proxy
- Docker Compose for S3
S3 Table Bucket
- S3 Table Bucket
- S3 Table Bucket Commands
- S3 Tables Security
- SeaweedFS Iceberg Catalog
- Iceberg Table Maintenance
Iceberg Integrations
- Spark Iceberg Integration
- Trino Iceberg Integration
- Dremio Iceberg Integration
- DuckDB Iceberg Integration
- Doris Iceberg Integration
- RisingWave Iceberg Integration
- Lakekeeper Iceberg Integration
S3 Authentication & IAM
- S3 Configuration - Start Here
- S3 Credentials (
-s3.config) - OIDC Integration (
-s3.iam.config) - Kubernetes ServiceAccount Authentication (IRSA-style)
- S3 Policy Variables
- S3 Policy Conditions
- S3 Bucket Policies
- Amazon IAM API
- AWS IAM CLI
- weed shell - Shell IAM Commands
Server-Side Encryption
S3 Client Tools
- AWS CLI with SeaweedFS
- s3cmd with SeaweedFS
- rclone with SeaweedFS
- restic with SeaweedFS
- nodejs with Seaweed S3
Machine Learning
HDFS
- Hadoop Compatible File System
- run Spark on SeaweedFS
- run HBase on SeaweedFS
- run Presto on SeaweedFS
- Hadoop Benchmark
- HDFS via S3 connector
Replication and Backup
- Async Replication to another Filer [Deprecated]
- Async Backup
- Async Filer Metadata Backup
- Async Replication to Cloud [Deprecated]
- Kubernetes Backups and Recovery with K8up
Metadata Change Events
Messaging
- Structured Data Lake with SMQ and SQL
- Seaweed Message Queue
- SQL Queries on Message Queue
- SQL Quick Reference
- PostgreSQL-compatible Server weed db
- Pub-Sub to SMQ to SQL
- Kafka to Kafka Gateway to SMQ to SQL
Use Cases
Operations
- System Metrics
- weed shell
- Data Backup
- Deployment to Kubernetes and Minikube
- Deployment with seaweed-up
Rust Volume Server
Advanced
- Large File Handling
- Optimization
- Optimization for Many Small Buckets
- Volume Management
- Tiered Storage
- Cloud Tier
- Cloud Monitoring
- Load Command Line Options from a file
- SRV Service Discovery
- Volume Files Structure
Security
- Security Overview
- Security Configuration
- Cryptography and FIPS Compliance
- Run Blob Storage on Public Internet