January 14, 2021
1. Cloud storage architecture
The cloud storage architecture is divided into two categories, one is structured through services, and the other is structured through software or hardware devices.
The traditional system uses a tightly coupled symmetrical architecture, which is designed to solve the HPC (high-performance computing, super computing) problem, and it is now expanding into cloud storage to meet the rapidly emerging market demand. The next-generation architecture has adopted a loosely coupled asymmetric architecture to centralize metadata and control operations. This architecture is not very suitable for high-performance HPC, but this design aims to solve the large-capacity storage requirements of cloud deployment. The summary information of the various architectures is as follows:
1. Tightly coupled symmetric (TCS) architecture
2. Relaxed coupling asymmetric (LCA) architecture
The LCA system uses different methods to scale out. Instead of implementing a strategy to make each node aware of the operations performed by each action, it uses a central metadata control server outside the data path. Centralized control provides many benefits, allowing new levels of expansion:
● The storage node can focus on the requirements for providing read and write services without the need for confirmation from the network node.
●Nodes can use different commodity hardware CPU and storage configurations, and still play a role in cloud storage.
●Users can adjust cloud storage by using hardware performance or virtualized instances.
● Eliminating the large amount of state overhead shared between nodes can also eliminate the need for user computer interconnection, such as Fibre Channel or infiniband, thereby further reducing costs.
●The mixing and matching of heterogeneous hardware enables users to expand storage on the basis of the current economic scale when needed, while also providing permanent data availability.
●Having centralized metadata means that storage nodes can rotate in-depth application archives, and metadata is often available on control nodes.
2. Cloud storage system composition
1. Storage layer
The storage layer is the most basic part of cloud storage. The storage device can be an FC Fibre Channel storage device, an IP storage device such as NAS and iSCSI, or a DAS storage device such as SCSI or SAS. The storage devices in cloud storage are often large in number and distributed in different regions. They are connected to each other through WAN, Internet or FC fiber channel network.
Above the storage device is a unified storage device management system, which can realize logical virtualization management of storage devices, multi-link redundancy management, as well as status monitoring and fault maintenance of hardware devices.
2. Basic management
The basic management layer is the core part of cloud storage and the most difficult part of cloud storage. The basic management layer uses technologies such as clusters, distributed file systems, and grid computing to achieve collaborative work between multiple storage devices in cloud storage, so that multiple storage devices can provide the same service externally, and provide larger and stronger Better data access performance.
The CDN content distribution system and data encryption technology ensure that the data in cloud storage will not be accessed by unauthorized users. At the same time, various data backup and disaster recovery technologies and measures can ensure that the data in cloud storage will not be lost, and the cloud Store its own security and stability.
3. Application interface layer
The application interface layer is the most flexible part of cloud storage. Different cloud storage operating units can develop different application service interfaces and provide different application services according to actual business types. Such as video surveillance application platform, IPTV and video on demand application platform, network hard disk application platform, remote data backup application platform, etc.
4. Access layer
Any authorized user can log in to the cloud storage system through a standard public application interface and enjoy cloud storage services. Different cloud storage operating units have different access types and access methods provided by cloud storage.