Log In
Or create an account ->
Imperial Library
Home
About
News
Upload
Forum
Help
Login/SignUp
Index
OpenStack Object Storage (Swift) Essentials
Table of Contents
OpenStack Object Storage (Swift) Essentials
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Support files, eBooks, discount offers, and more
Why subscribe?
Free access for Packt account holders
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Errata
Piracy
Questions
1. Cloud Storage – Why Can't I Be Like Google?
What constitutes cloud storage?
Reduced TCO
Unlimited scalability
Elastic
On-demand
Universal access
Multitenancy
Data durability and availability
Limitations of cloud storage
Performance
New APIs
Object storage
The importance of being open
OpenStack Swift
Summary
2. OpenStack Swift Architecture
Logical organization of objects
Swift implementation and architecture
Key architectural principles
Physical data organization
Data path software servers
A day in the life of a create operation
A day in the life of a read operation
A day in the life of an update operation
A day in the life of a delete operation
Post-processing software components
Replication
Updaters
Auditors
Other processes
Inline middleware options
Authentication
Other modules
Additional features
Large object support
Metadata
Multirange support
CORS
Server-side copies
Cluster health
Summary
3. Installing OpenStack Swift
Hardware planning
Server setup and network configuration
Pre-installation steps
Downloading and installing Swift
Setting up storage server nodes
Installing services
Formatting and mounting hard disks
RSYNC and RSYNCD
Setting up the proxy server node
The Keystone service
Installing MariaDB
Installing Keystone
The ring setup
Multiregion support
Finalizing the installation
Storage policies
Implementing storage policies
Applying storage policies
Summary
4. Using Swift
Installing clients
Creating a token using Keystone authentication
Displaying metadata information for an account, container, or object
Using the Swift client CLI
Using cURL
Using the specialized REST API client
Listing containers
Using the Swift client CLI
Using cURL
Listing objects in a container
Using the Swift client CLI
Using cURL
Using the REST API
Updating the metadata for a container
Using the Swift client CLI
Using the REST API
Environment variables
The pseudo-hierarchical directories
Container ACLs
Transferring large objects
Amazon S3 API compatibility
Accessing Swift using S3 commands
Accessing Swift using client libraries
Java
Python
Ruby
Summary
5. Additional Swift Interfaces
Using Swift for virtual machine storage
Swift in Sahara
Hadoop Cluster with Sahara
Using Swift with Sahara
Running a job in Sahara
Authenticating with Swift proxy
Summary
6. Monitoring and Managing Swift
Routine management
Swift cluster monitoring
Swift Recon
Swift Informant
Swift dispersion tool
StatsD
Swift metrics
Tulsi – a Swift health monitoring tool
Architecture of Tulsi
Deploying Tulsi
Running Tulsi
Anomaly detection in Tulsi
Logging using rsyslog
Failure management
Detecting drive failures
Handling drive failure
Handling node failure
Proxy server failure
Zone and region failure
Capacity planning
Adding new drives
Adding new storage and proxy servers
Migrations
Summary
7. Docker Intercepts Swift
Swift with Docker
Installation of Docker
Basic commands for the Docker user
Setting up a Swift proxy container using the Docker image
Setting up the storage container using the Docker image
Setting up a Swift cluster using a Dockerfile
Creating a proxy container using a Dockerfile
Creating a storage container using a Dockerfile
Summary
8. Choosing the Right Hardware
The hardware list
The hardware selection criteria
Choosing the storage server configuration
Determining the region and zone configuration
Choosing the account and container server configuration
Selecting the proxy server configuration
Choosing the network hardware
Choosing the ratios of various server types
Heterogeneous hardware
Choosing additional networking equipment
Selecting a cloud gateway
Additional selection criteria
The vendor selection strategy
Branded hardware
Commodity hardware
Summary
9. Tuning Your Swift Installation
Performance benchmarking
Hardware tuning
Software tuning
Ring considerations
Data path software tuning
Post-processing software tuning
Additional tuning parameters
Summary
10. Additional Resources
Use cases
Archival
Backup
Content repository
Collaboration
Data lakes
Operating systems used for OpenStack implementations
Virtualization used for OpenStack implementations
Provisioning and distribution tools
Monitoring and graphing tools
Additional information
Summary
A. Swift CLI Commands
Commands
list
Examples
stat
Examples
post
Examples
upload
Examples
download
Examples
delete
Examples
Index
← Prev
Back
Next →
← Prev
Back
Next →