Object storage responsibility of cloud computing m

2022-08-26
  • Detail

In the era of data explosion, the application of object storage by cloud computing manufacturers in the field of enterprise storage is in its early stage, but the growth trend is very obvious. IDC has broken through a batch of common key technologies. It is predicted that the compound annual growth rate of the global software defined storage market will reach 13.5% from 2017 to 2021, and the revenue will be close to US $16.2 billion by 2021

since the concept was first proposed in the mid-1990s, object storage has become one of the data storage methods for the largest scale application. In the software defined storage market, the requirements of the next generation cloud data center are effectively promoting the development of object storage

there is no doubt that we are now in an era of data explosion, especially unstructured data (pictures, videos, archives, enterprise backup and other data) has become an important part of enterprise data. This massive amount of data requires corresponding storage, while traditional enterprise storage such as NAS or San cannot cope with this massive amount of unstructured data

object storage looks like

generally, traditional storage technologies can be divided into direct access storage (DAS), storage area network (SAN) and network attached storage (NAS)

from the storage form, DAS and San belong to block storage, that is, the storage system operates on disks (block devices), and the interface of data access is block device driver. NAS belongs to file storage, which mainly manages files and directories. The interface of data access is File protocol, such as NFS. At the abstract level, file storage is higher than block storage

at present, the entire enterprise storage market is developing from "vertical expansion" to "horizontal expansion". There are many terms about the new generation of enterprise storage in the industry, such as software defined storage, distributed storage, horizontally scalable storage, etc. they mean the same, that is, storage management through software on the relatively cheap x86 server

in this kind of horizontal extended storage, we will face the categories of block storage, file storage and object storage, which are applicable to different scenarios. The applicable scenarios of distributed block storage are relatively specific, such as Oracle database, which requires high-performance hard disk for database storage; In addition, distributed file storage and object storage are the most suitable for storing unstructured data, that is, pictures, videos and other types of data

and object storage is different from block storage. Object storage does not have the concepts of logical units (LUNs), volumes, and disk arrays (RAID). Object storage is also different from file storage. Object storage does not query files through directories. Object data is not stored in blocks or LUNs, but in variable size buckets

the core idea of object storage is to separate data path (data read or write) and control path (metadata), and build a storage system based on object storage devices. Each object storage device has a certain intelligence and can automatically manage the data distribution on it

therefore, object storage combines the advantages of block storage and file storage. It has both high performance of block storage and convenient sharing of file storage. It is the most important cloud storage method at present

we can access the data in the object store directly through the rest API, which is as convenient as accessing a network resource file with a URI

from the design idea of object storage, we can see that it adapts to the current development trend of new technologies and the changing needs of enterprise data storage and business applications

for example, in application scenarios, object storage can be widely used in web and mobile applications, enterprise disks, static station hosting, big data analysis, IAAs/PAAS services, image processing, video cloud, backup archiving, data migration, etc

object storage becomes the standard configuration of cloud computing manufacturers

as mentioned above, object storage will be the blue ocean market of enterprise storage. At this stage, it is a very good stage for object storage to enter the enterprise market. It is in the early stage of being widely adopted, and players from all walks of life are laying out their plans

in the object storage market, cloud computing vendors, storage vendors, it vendors, and software vendors all have layout. For example, IBM, HDS, EMC, nutanix and VMware all have their own corresponding products. But public cloud providers are absolutely the main players

the development and commercialization of object storage has been closely linked with the cloud computing industry. After several years of development, the cloud computing market has become mature, and object storage services, which are widely used, have become a basic business of cloud service companies, and there are countless manufacturers who can provide this service on the market

as the earliest cloud storage service in history, the purpose and function of simple storage service of S3 for short is to provide the most basic and simple cloud storage service for future cloud service users of AWS. Whether it is pictures, videos or texts, S3 can provide storage services, which are simple, centralized and cost-effective

Microsoft azure has launched highly scalable unstructured cellular data object storage, blob storage, which widely exists in lower plant fungi and algae. With 10 billion bytes of capacity and huge scalability, blob storage can store hundreds to billions of objects in the "hot", "cold" or "archive" layer according to the data access frequency, Enterprises can easily and cost effectively store any type of unstructured data (images, video, audio, documents, etc.)

domestic cloud manufacturers are also actively deploying object storage. For example, Alibaba cloud object storage service (OSS) has been commercialized for more than five years. It is a massive, safe and highly reliable cloud storage service based on Alibaba cloud Feitian distributed system

ucloud provides Ufile service for object storage. Ufile has the advantages of unlimited storage, high concurrent access, and lower cost; Solve the file storage problem of business architecture, effectively reduce the storage cost of massive files, support high concurrent access to hot data, and improve the end-user access experience

Qingyun qingcloud, an enterprise level cloud service provider, also provides qingstor object storage services based on public cloud, as well as qingstor object storage private cloud integrated solution

the success of storing objects in the public cloud has had an impact on the enterprise storage ecosystem and deployment mode. For example, the popularity of open source object storage such as openstack swift and CEPH, and Amazon S3 becoming the de facto object storage access standard, are all affected by the widespread deployment of public cloud object storage

therefore, object storage is closely related to the rapid development of the cloud computing market, especially the public cloud. Today, with the rapid development of public cloud, object storage has also ushered in its own "spring"

in the enterprise market, object storage has passed the education stage and is in a relatively good period. Object storage will occupy about 75% of the enterprise storage capacity, and it is in the early stage of being widely adopted

however, although object storage has ushered in the "east wind" of rapid development, how to adapt to the development trend and meet customer needs is the key for object storage providers to win the following Jinan new era Gold Testing Instrument Co., Ltd. to talk about the most common failure market

how do cloud computing vendors play with object storage

although object storage will be the blue ocean market of enterprise storage, now cloud computing manufacturers are also laying out object storage, the key to market competition is products and technology. How can object storage help cloud computing manufacturers "attack cities and seize lands", perhaps the following points can be used as a reference

from the interface layer (protocol layer), object storage needs to be compatible with AWS S3 API and support a variety of protocols, including NFS, FTP, HDFS, etc. Only in this way can we meet the application needs of customers. After all, for enterprise applications, the richness of interfaces and protocols is essential

in terms of delivery mode, object storage can be delivered through public cloud, private cloud, hybrid cloud and other modes, and unified management can be achieved. Although object storage was initially introduced by public cloud manufacturers, for some industries, they prefer to build a data pool in their own data center for unified management and subsequent analysis and utilization. Therefore, the diversification of delivery methods is essential, and for object storage manufacturers, they need to have unified management capabilities in a variety of delivery modes

now the enterprise storage market shows a trend of convergence, such as open source storage software CEPH, which outputs block storage, file storage and object storage in the same architecture

however, some cloud computing manufacturers believe that whether it is block storage, file storage or object storage, they have very different problems to solve. Therefore, if you want to solve several storage forms with the same architecture from top to bottom, you will lose sight of each other

the systematization of products is very simple for those who have experienced the same geological layout effect, such as the use of storage API. Generally, object storage manufacturers also provide SDKs in various languages. But this is not enough. For storage manufacturers, product systematization is very important, because your products need to be combined with various application scenarios of users to provide a variety of solutions

at the architecture level, there are two more important trends in object storage: one is the event driven framework, because the user's data is not simply stored, but needs further processing, which requires an event driven framework, which can connect to a variety of data processing services, and even processing applications developed by users themselves

in addition, the integration or connection of object storage and big data platform is very important. In the form of public cloud, the relationship between big data and object storage is very close, and big data is the main source of data stored in object storage. However, it is still missing on the private cloud. Object storage should deepen the integration relationship with big data on the private cloud

again, objects store SaaS services related to data. For example, users want to analyze the use of object storage itself and guide the planning and construction of the entire IT facilities, which belongs to data related SaaS services

finally, the enterprise storage software ecosystem and cooperation. The enterprise storage ecosystem is not only block storage, file storage, object storage, but also many others, such as Dr, disaster recovery, traditional backup software, etc

to sum up, it can be predicted that object storage technology will become an important part of storage technology in the future. With the rapid development of the entire cloud computing market, the development of object storage market will also be accelerated, thereby accelerating the transformation of enterprise storage

Copyright © 2011 JIN SHI