The choice of cloud infrastructure providers is huge. There are the big providers like Amazon AWS, Microsoft Azure, Softlayer (now part of IBM), Rackspace, Google Compute Engine, CenturyLink, GoGrid (now part of Datapipe), Dimension Data, CSC and many other vendors vying aggressively for the $20 billion market.
Choosing the right cloud service provider for your needs is not an easy task. This article focuses on the aspect of choosing the right Infrastructure as a Service (IaaS) for your organization’s needs.
Having choices is much better than not having choices, however multiple alternatives pose a difficult problem of choosing the right service provider with right features and services at right price. Almost all vendors reduce prices on a regular basis, add new functionality all the time, increase their global spread etc., in a bid to out-manoeuvre each other. Some vendors offer very fine grained compute configurations, reserved instances, spot instances, high IOPS, bare metal infrastructure and some of them even throw in basic platform services along with many other attractive options.
So how can one go about selecting the right cloud service provider for their use case? Many users feel that it is very difficult to evaluate various players and choose the “follow the herd” approach and think it is the safest. Well it may work for some customers by sheer coincidence. However every organization’s requirements- both near and far term are different, so one cloud fits all may not work in their favor. That brings us to the topic of how one can evaluate all the major public cloud vendors effectively and objectively.
This article discusses how researchers at RightCloudz Technologies solved this complex problem with their unique (patent pending) evaluation engine. The first step in evaluating any product or service is to list out requirements that product or service needs to be met. This is true with respect to evaluating a cloud service provider. Let us take a look at the high level requirements to be met by a cloud service provider that provides infrastructure as a service.
To evaluate cloud service providers objectively and in their entirety, the requirements needs to be broken down into its constituent measurable parameters. Let us take a brief look at some of the major requirements and their constituent high level parameters.
Compute: The heart of IaaS is compute. Some of the major aspects needed to be considered while evaluating compute requirement are capabilities that the vendor provides in offering flexible and extensible compute resources like memory, disk, virtual CPUs, operating systems, on demand /reserved instances, range and granularity of compute configurations.
Data protection: Data protection is a very important requirement as all of customer data is outside their premises and on public cloud infrastructure. Hence making sure that their data is safe and secure is important to the cloud vendor too. From an evaluation perspective, it is important to check how good the vendor is in giving fine grained control access, having encryption at various states, version controls mechanisms, providing audits, logs, and in providing backup/restore of customer data.
Infrastructure and integration: Infrastructure is responsible for making life simple for you and your customers. Some of the key aspects that a customer need to measure are: Can the vendor provide choice for deploying applications close to your users or customers, ensuring the lowest possible latency and best user experience? How well is the connectivity within and across regions? It is also important to measure the service features and capabilities that help customers to easily integrate their existing infrastructure with Cloud. These include data export/import, backup, hybrid clouds, VPN, clustering, gateways etc.
Operating cost: For most enterprises, cost saving is the prime business driver for adopting cloud. However it is very important to consider all cloud infrastructure related cost parameters including compute, storage, network, support, data transfer / connectivity, monitoring etc. Most top vendors have similar pricing for instances for similar configurations. However operational costs include transaction and management costs and that can vary a lot from vendor to vendor. And are varying amounts of free transactions that are provided by each vendor.
Performance: Performance across all services is important for a pure IaaS offering. However based on technical use case that the service is user, an enterprise can lay more emphasis on certain performance parameters than others. Some of the common performance related parameters to consider are high speed connectivity, cache management, network scaling, load balancing, self-healing mechanisms, auto scaling, managing fail-overs, disk i/o etc.
Storage: Storage capabilities are a key part of IaaS offerings, and most vendors try to provide flexible and extensible storage resources like very wide range of disk space, elasticity of disk space, built-in redundancy, variety of storage options including SSD, archival storage etc.
Security & Compliance: While security and compliance have always been important criteria for cloud users, multi tenanted infrastructure poses higher risks. Vendors have features and capabilities that provide varying levels of security in the Cloud infrastructure to data, users, connections, applications including physical & electronic security to data centers. Hence it is important to look at all aspects of security in closer detail.
Compliance to regulatory requirements and certifications are equally important factors to choose the right IaaS vendor. Cloud compliance issues arise as soon as cloud user decides to make use of cloud storage or backup services. By moving data from their internal storage to someone else’s they are forced to examine closely how that data will be kept so that you remain compliant with laws and industry regulations.
Application services: Many IaaS vendors have begun including basic platform services to add capabilities that support application development including pre-configured applications. In addition vendors try to get edge over other vendors by providing versatile set of APIs, toolkits, mobile app support, various media services and other platform related services. It is important to measure and evaluate these aspects based on end user needs.
RankCloudz is RightCloudz’s patent pending evaluation engine to help enterprises to evaluate and rank top public service providers. This example illustrates how RankCloudz methodology has been used to evaluate cloud vendor services that provide moving in-premise development and test environments to the cloud.
RankCloudz has a large knowledge database that includes very granular raw data on hundreds of parameters for all the top infrastructure cloud service providers. RankCloudz uses this knowledge base and user inputs on priorities for the above requirements and applies normalization techniques on raw data to compare and contrast various service provider offering to come up with a ranked list of service providers dynamically.
The evaluation process looks at each business and technical requirement required for such a business case in great detail, determines vendor services that support those requirements and then evaluates each feature or attribute of those services. RankCloudz has an on-going process to collect fine-grained data about vendor services and features. This up-to-date data helps RankCloudz to rank all vendors fairly and in an unbiased manner at any point in time.
RankCloudz in use – choosing right vendor for development and test
The versatile RankCloudz evaluation engine can be used to evaluate and rank cloud services providers for various cloud usage scenarios.
As an illustration, the paper shows the results from RankCloudz while choosing the right vendor for software development and test environment. The results are graphically represented in the form of a stacked bar chart as shown below.
Each bar represents a Cloud service provider and their scores against each requirement. In the above evaluation, 13 requirements have been used and scores for each requirement is normalized and stacked as shown in the above graph. The top most bar in each bar graph represents scores of how well the “Application Services” requirement is met by each of the cloud service provider. The next bar represents “Compute” requirement and similarly the rest of the eleven requirements are stacked one below the other to form the score for each cloud service provider. In this example, Amazon AWS ranks first followed by Microsoft Azure.
Here is an example of how the evaluation looks like when only Operating Cost of various vendors is considered. You may notice that priority for “Operating Cost” has been set to 10 and rest are set to zero.
Depending on user’s business and technical needs, the various requirements can be set to priority values ranging from 0 to 10 giving a very fine grained control on specifying relative importance of requirements.
Best way to understand how RankCloudz works is to try it yourself by registering free at
or write to info@RightCloudz.com for more details.