2

POSIX Compliance

Chris Lu edited this page 2026-05-02 11:33:27 -07:00

Table of Contents

• POSIX Compliance for weed mount
• How it runs
• Status
• Running locally

POSIX Compliance for weed mount

weed mount passes 100% of the pjdfstest POSIX compliance suite (236 test files, 8,819 assertions, zero skipped).

SeaweedFS runs the pjdfstest POSIX compliance suite against weed mount on every change to weed/mount/**, weed/filer/**, or the test harness itself. The job is defined in .github/workflows/pjdfstest.yml and the harness lives under test/pjdfstest/.

The suite is pinned to the sanwan/pjdfstest fork, which adds NAME_MAX-aware variants of the upstream tests.

How it runs

1. A SeaweedFS e2e image (master + volume + filer + mount) is built and started via test/pjdfstest/docker-compose.yml.
2. test/pjdfstest/run.sh mounts the filesystem with weed mount -allowOthers=true and clones pjdfstest pinned to an immutable commit for reproducibility.
3. prove -rv runs every tests/**/*.t. Any failure that is not listed in known_failures.txt fails CI.

Status

100% passing. All 236 pjdfstest test files (8,819 individual assertions) pass on weed mount, with zero tests skipped. The known_failures.txt allow-list is empty, so any regression in any test fails CI immediately.

The syscall groups exercised by the suite are:

Group	Coverage
tests/chflags/	BSD file flags (skipped on Linux by the suite itself)
tests/chmod/	chmod(2) permission, errno, and setuid/setgid behavior
tests/chown/	chown(2) ownership, errno, and clearing of set*id bits
tests/link/	link(2) creation, permission, and errno cases
tests/mkdir/	mkdir(2) creation and errno paths
tests/mkfifo/	mkfifo(2) FIFO creation
tests/mknod/	mknod(2) regular/FIFO node creation
tests/open/	open(2) flags, permissions, O_CREAT, O_TRUNC, errno
tests/rename/	rename(2) same/cross-directory, errno cases
tests/rmdir/	rmdir(2) empty-directory and errno cases
tests/symlink/	symlink(2) creation, traversal, errno cases
tests/truncate/	truncate(2) resize, permission, and errno cases
tests/unlink/	unlink(2) removal and errno cases
tests/utimensat/	utimensat(2) atime/mtime/ctime semantics, errno paths
tests/granular/	Granular timestamp update checks

Running locally

# Full suite against a local weed binary (requires sudo, fusermount3,
# autoconf, make, perl TAP::Harness::Archive).
test/pjdfstest/run.sh

# Subset, e.g. only chmod tests
PJDFSTEST_TESTS=tests/chmod test/pjdfstest/run.sh

# Containerized (matches CI exactly)
docker compose -f test/pjdfstest/docker-compose.yml up --wait
docker compose -f test/pjdfstest/docker-compose.yml exec mount /run.sh

See also: FUSE Mount.

Introduction

• Quick Start with weed mini
• Simplest S3 Bucket and User Setup
• Components
• Getting Started
• Production Setup
• A typical step‐by‐step example
• Benchmarks
• FAQ
• Applications

API

• Master Server API
• Volume Server API
• Filer Server API
• Client Libraries
• SeaweedFS Java Client

Configuration

• Replication
• Store file with a Time To Live
• Failover Master Server
• Erasure coding for warm storage
• EC Bitrot Detection
• Server Startup via Systemd
• Environment Variables

Filer

• Filer Setup
• Directories and Files
• File Operations Quick Reference
• Data Structure for Large Files
• Filer Data Encryption
• Filer Commands and Operations
• Filer JWT Use
• TUS Resumable Uploads

Filer Stores

• Filer Cassandra Setup
• Filer Redis Setup
• Super Large Directories
• Path-Specific Filer Store
• Choosing a Filer Store
• Customize Filer Store

Management

• Admin UI
• Admin UI OIDC
• Worker
• Plugin Worker Scheduling

Advanced Filer Configurations

• Migrate to Filer Store
• Add New Filer Store
• Filer Store Replication
• Filer Active Active cross cluster continuous synchronization
• Filer as a Key-Large-Value Store
• Path Specific Configuration
• Filer Change Data Capture
• Filer Operation Serialization

FUSE Mount

• FIO benchmark
• fstab and systemd mount
• POSIX Compliance
• Distributed POSIX Locks
• P2P reading in weed mount

WebDAV

SFTP Server

Cloud Drive

• Cloud Drive Benefits
• Cloud Drive Architecture
• Configure Remote Storage
• Mount Remote Storage
• Cache Remote Storage
• Cloud Drive Quick Setup
• Gateway to Remote Object Storage

AWS S3 API

• Amazon S3 API
• Supported APIs vs Minio
• S3 Lifecycle
• S3 Lifecycle vs Volume TTL
• S3 Conditional Operations
• S3 CORS
• S3 Object Lock and Retention
• S3 Object Versioning
• S3 API Benchmark
• S3 API FAQ
• S3 Bucket Quota
• S3 Rate Limiting
• S3 API Audit log
• S3 Nginx Proxy
• Docker Compose for S3

S3 Table Bucket

• S3 Table Bucket
• S3 Table Bucket Commands
• S3 Tables Security
• SeaweedFS Iceberg Catalog
• Iceberg Table Maintenance

Iceberg Integrations

• Spark Iceberg Integration
• Trino Iceberg Integration
• Dremio Iceberg Integration
• DuckDB Iceberg Integration
• Doris Iceberg Integration
• RisingWave Iceberg Integration
• Lakekeeper Iceberg Integration

S3 Authentication & IAM

• S3 Configuration - Start Here
• S3 Credentials (-s3.config)
• OIDC Integration (-s3.iam.config)
• Kubernetes ServiceAccount Authentication (IRSA-style)
• S3 Policy Variables
• S3 Policy Conditions
• S3 Bucket Policies
• Amazon IAM API
• AWS IAM CLI
• weed shell - Shell IAM Commands

Server-Side Encryption

• Server-Side Encryption
• Server-Side Encryption SSE-KMS
• Server-Side Encryption SSE-C

S3 Client Tools

• AWS CLI with SeaweedFS
• s3cmd with SeaweedFS
• rclone with SeaweedFS
• restic with SeaweedFS
• nodejs with Seaweed S3

Machine Learning

• TensorFlow with SeaweedFS
• Distributing AI Model Files for Multi-GPU Loading

HDFS

• Hadoop Compatible File System
• run Spark on SeaweedFS
• run HBase on SeaweedFS
• run Presto on SeaweedFS
• Hadoop Benchmark
• HDFS via S3 connector

Replication and Backup

• Async Replication to another Filer [Deprecated]
• Async Backup
• Async Filer Metadata Backup
• Async Replication to Cloud [Deprecated]
• Kubernetes Backups and Recovery with K8up

Metadata Change Events

• Filer Metadata Events
• Filer Notification Webhook

Messaging

• Structured Data Lake with SMQ and SQL
• Seaweed Message Queue
• SQL Queries on Message Queue
• SQL Quick Reference
• PostgreSQL-compatible Server weed db
• Pub-Sub to SMQ to SQL
• Kafka to Kafka Gateway to SMQ to SQL

Use Cases

• Use Cases
• Actual Users

Operations

• System Metrics
• weed shell
• Data Backup
• Deployment to Kubernetes and Minikube
• Deployment with seaweed-up
  • Cluster Plan Workflow
  • Cluster Plan Inventory Reference
  • Cluster Plan Day 2 Operations

Rust Volume Server

• Rust Volume Server

Advanced

• Large File Handling
• Optimization
• Optimization for Many Small Buckets
• Volume Management
• Tiered Storage
• Cloud Tier
• Cloud Monitoring
• Load Command Line Options from a file
• SRV Service Discovery
• Volume Files Structure

Security

• Security Overview
• Security Configuration
• Cryptography and FIPS Compliance
• Run Blob Storage on Public Internet

Misc Use Case Examples

• UrBackup with SeaweedFS
• Docker Image Registry with SeaweedFS
• SeaweedFS in Docker Swarm
• Words from SeaweedFS Users
• Independent Benchmarks
• Hardware