Abstract
Keywords
Introduction
As a new network computing service mode, cloud computing has been paid more and more attention in recent years. A large number of computing resources, storage resources, and software resources were integrated by cloud computing through the information technologies such as virtualization and grid computing. Then, a huge virtually shared resource pool was formed to provide the required information service for users.1–3 Generally, with the integration of information resources such as infrastructure, platform, and software, just like social resources such as water, electricity, and gas, cloud computing has changed the traditional information service mode to provide users with on-demand services. Based on the advanced service concept of cloud computing, medical, financial, energy, e-government, education, scientific research, telecommunications, manufacturing, and other industries were in an information revolution.4–6 A new development model based on industry characteristics is gradually formed by the depth integration with cloud computing technology.
Among them, manufacturing industry is a typical application field, and the service-oriented networked manufacturing mode named cloud manufacturing is being generated by the integration of cloud computing into manufacturing industry.7–11 In cloud manufacturing mode, networked manufacturing technology, cloud calculation, networking, high-performance calculation, and other existing technology are integrated to realize the unified and centralized management of manufacturing resources, which can provide in-time, on-demand, safe, and high-quality manufacturing services for the whole life cycle. The two kinds of thought “distributed resources’ concentrated use” and “concentrated resources’ distributed service” can achieve the unified embodiment by cloud manufacturing. Moreover, demonstration, design, production, processing, experiment, simulation, management, and other business processes in life cycle are shown and provided to users in on-demand service form.9,10 The achievement of this goal cannot be separated from the support of virtualization technology. Through Internet of Things (IOT), Cyber-Physical Systems (CPS), calculation virtualization systems, and other technologies, physical manufacturing resources are translated into logical manufacturing resources, which make the services efficient, agile, reliable, safe, and convenient to users.8–12
To provide better services to users, the multi-granularity classifying and clustering of resources will further increase the efficiency and performance of resource virtualization, and sharing and allocation in cloud manufacturing. 13 Cloud manufacturing is different from the existing networked manufacture. On the technology level, it generally has the characteristics of IOT, virtualization, service, coordination, intelligence, and so on. These characteristics can be detailed as service and demand-oriented, transparent and integration, outsourcing, agile, specialization, capacity sharing, green, low carbon, and so on. 14 On the technology management level, it has the characteristics of uncertainty, user-centered, demand-driven, fare-paying, knowledge-based, group innovation-based, virtual organization- supported, intelligent perception, and full coverage of manufacturing resources, dynamic reconstruction of resource supply, intelligent demand, responsibility, and benefit share.12,15,16
Based on the above analysis, manufacturing enterprises or enterprise union can effectively reduce the information cost by cloud manufacturing mode. As a result, the unified management, sharing, and on-demand use of manufacturing resources can be achieved, and the resource utilization rate can be increased. So, the market reaction capability and core competitiveness are enhanced. To deploy and implement cloud manufacturing mode for enterprise or enterprise union, one of the most important challenges is how to choose a suitable cloud service supplier. This is also a public key problem that medical, financial, energy, e-government, and cloud computing industry face. 14
The rest of this article is organized as follows. In section “Related works,” the related works are reviewed and the weakness of the existing approach is analyzed. Section “Research methodology” builds the index framework of cloud service supplier selection and proposes a conjunctive multi-criteria decision-making (MCDM) approach based on integrated weight and improved TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution). In section “Case study,” the case study is reported. We discuss the advantages of the proposed approach by comparing the sorting results of three kinds of weight (objective weight, subjective weight, and integrated weight) and four sorting methods (improved TOPSIS replacing Euclidean distance with connection distance, traditional TOPSIS, angle measure evaluation TOPSIS, and vertical projection TOPSIS) in section “Discussion.” Finally, conclusions are drawn in section “Conclusion.”
Related works
To solve the cloud service supplier selection problem, Cloud Services Measurement Initiative Consortium (CSMIC) from Carnegie Mellon University’s Silicon Valley Campus designed and released the service measurement index framework in which cloud service can be evaluated from seven aspects: accountability, agility, assurance, financial, performance, security privacy, and usability. 15
The cloud service supplier selection problem can be abstracted as a MCDM problem. Therefore, MCDM approach based on this framework has become an important trend of cloud service supplier evaluation.17–20 Generally, MCDM approach can be divided into two stages: index weight determination and comprehensive sequencing by weighted index value.
Analytic hierarchy process (AHP) is a common method for subjective index weight determination. It was proposed by TL Saaty 21 in the early 1970s and is a systematic analysis method based on the combination of qualitative analysis and quantitative analysis. Traditional AHP has the following shortcomings. First, the judgment matrix is obtained by 1–9 levels scale. As the dominant factor in the practical operation, experts’ subjective factor makes the evaluation result easy to be biased. So, it is hard to reach the consistency of judgment matrix. Second, when judgment matrix is not consistent, the adjustment is often with blindness and large calculation.
The common methods used to determinate the objective index weight include entropy weight method, 22 standard deviation method, 23 and CRITIC (CRiteria Importance Through Inter-criteria Correlation). 24 By CRITIC, the objective weight is comprehensively measured by the contrast intensity and conflict between different indexes, which is more scientific and reasonable.
In the stage of comprehensive sequencing by weighted index value, the technique for order preference by similarity to an ideal solution (TOPSIS) is a classic sequencing method for MCDM. 25 Euclidean distances between the evaluation object and two ideal points are used to calculate the closeness in TOPSIS. The evaluation objects on the perpendicular bisector of two ideal points have the same closeness value and cannot be distinguished. Therefore, some improved TOPSIS methods have been proposed. For example, angle measure evaluation method 26 only considers the angle closeness between the evaluation object and two ideal points, and ignores the difference in length. When two evaluation objects have the same angle closeness but different length, it will draw the wrong conclusion. Vertical projection method 27 also cannot distinguish these evaluation objects when two or more objects have the same projective point on the connection line of two ideal points.
Furthermore, Sun et al. analyzed and summarized the existing cloud service selection methods and pointed out these methods’ shortness which is lack of cloud service automatic identification and update engine, advanced multi-criteria user preference measurement, consideration of attribute relationship, processing of qualitative and fuzzy information, long-term performance prediction, and dynamic service. 28
The disadvantages of the researches mentioned above can be divided into two aspects: one is that cloud service is considered more on the technology standard but less on the technology management standard in service measurement index framework, and the other is that the processing of uncertain preference is lacked. Based on the above analysis, we put forward a conjunctive MCDM approach for cloud service supplier selection of manufacturing enterprise. According to the two perspectives of technology and technology management, the index framework of cloud service supplier selection is constructed from four dimensions: cloud service performance (CSP), supplier capability (SC), supplier service level (SSL), and supplier service quality (SSQ). Then, a conjunctive MCDM approach is built. Neural network is used to realize the expert importance degree determination; fuzzy analytic hierarchy process (FAHP) considering the expert importance degree is used to determine the subjective weight; and CRITICis used to determine the objective weight. The multi-weight contribution equilibration model is built to integrate the subjective and objective weight. Finally, the improved TOPSIS replacing Euclidean distance with connection distance is used to sequence the suppliers by their weighted index-value matrix.
Research methodology
Index framework
The index framework is one of the key problems of cloud service supplier selection. Cloud service supplier selection is well abstracted by CSMIC on the technology level, but not on the technology management level. 15 Different suppliers can provide similar or same cloud service, so cloud service supplier selection is different from cloud service selection. Meanwhile, cloud service supplier selection has some inherent relevance to the application industry.
Based on this, considering the cloud manufacturing’s characteristics and other industries, following the principles of systematic, comprehensive, scientific, flexible and operable, review cloud service supplier from two perspectives of technology and technology management, the evaluation criteria of cloud service supplier selection can be defined as four dimensions: CSP, SC, SSL, and SSQ. Among them, CSP embodies the technology perspective which includes the core content of CSMIC’s service measurement index framework, and SC, SSL, and SSQ embody the technology management perspective. Each dimension is further detailed to indexes. The methods of affinity diagram, systematic diagram, Delphi method, and so on, are used to make it hierarchical. After proper simplification, the index framework of cloud service supplier selection is built in Figure 1.

Index framework of cloud service supplier selection.
Based on the index framework built in section “Related works,” cloud service supplier selection can be abstracted as a MCDM problem with the consideration of the index uncertainty. The proposed conjunctive MCDM approach for cloud service supplier selection is shown in Figure 2.

Proposed conjunctive MCDM approach for cloud service supplier selection.
Expert importance degree
The experts have different experiences, abilities, and employment positions; so, their distinguishing of importance degree should be taken into consideration.28,29 In this article, we propose a back propagation (BP) neural network–based method to solve the expert importance degree determination problem in group decision, which has the ability of self-learning and makes the importance degree assignment more scientific and reasonable. 30
In the expert importance degree assignment model based on BP neural network, several successful decisions including sorting judgments and actual sorting results are necessary as the sample data. The prior decision results with exact number subjective weight assignment form is hard to obtain, while indicator-sorting form is easy. So, for a successful decision, every sorting judgment is used as one of the inputs and actual sorting result as the output of BP neural network.
There is a group of

Structure of BP neural network for determining the expert importance degree.
Structure
Input layer
The neuron number of input layer is
Hidden layer
The neuron number of hidden layer is
Output layer
There is only one neuron in the output layer. The connection weight matrix between the hidden layer and the output layer is (1, 1, …, 1)
Reasoning process
For the hidden layer node
For the output layer node, its input is
Error function
For the sample
Learning process
The learning process is shown in Figure 4.

Learning process of BP neural network for determining the expert importance degree.
Calculation of expert importance degree
After the BP neural network has been trained successfully, we need to normalize the connection weights between the input layer and the hidden layer to obtain the expert importance degree as follows:
Subjective weight
To improve AHP method, FAHP has been proposed.31–35 In FAHP, 1–3 levels scale is used to construct the judgment matrix; so, experts can easily make the decision that which one has a higher priority between two indexes. Experts’ fuzzy priority judgment matrixes can be directly transformed to fuzzy consistent matrixes, so there is no need for consistency check or adjustment.
The specific steps of FAHP considering the expert importance degree are as follows:
Objective weight
Under the index
The contrast intensity, which shows the value difference degree of all objects under the same index, is expressed in the form of standard deviation. The bigger the standard deviation of an index, the more the information this index has.
The conflict between, which is based on the correlation relationship between different indexes, is expressed in the form of correlation coefficient. The bigger the negative correlation coefficient between two different indexes, the greater the conflict they have. This shows that the information reflected by the two indexes in the evaluation results has a greater difference, and the weights of two indexes should be bigger.
The correlation coefficient between
where
The conflict degree between
The information volume of
Finally, we get the objective weight vector of the indexes
where the objective weight of the index
Integrated weight
The sequencing result of evaluation objects depends on their weighted index values.
36
Because the subjective weight is equal to the objective weight in comprehensive sequencing process, their contributions to the evaluating result tend to an equilibration. So, we assume that the integrated weight vector is
For the evaluation object
All evaluation objects are equal, so the total multi-weight contribution deviation is
Therefore, the multi-weight contribution equilibration model is built as
We can express
It is known that the minimum of the target function in formula (8) is obtained at the value of
Supplier sequencing
The theory of set pair analysis (SPA), proposed by K Zhao and Xuan 37 in 1996, is a systematic analysis method to solve the uncertainty problem with connection degree. A set pair is constructed from two related sets in the uncertainty system; then the sameness, contrariety, and difference analysis will be done on the uncertainty of the set pair; and finally, the connection degree of the set pair can be obtained. SPA method can be used to describe the relationship in certainty–uncertainty system.
According to the priority value decision matrix
The positive ideal point and the negative ideal point are as follows
The weighted index value of the supplier
We assume that
where
According to SPA theory, the connection vector between
Similarly, we can get the connection distance from
Finally, we can get the relative closeness degree from
The relative closeness degree
If
If
When
Therefore, using the connection distance from the evaluation object to the ideal points fits well with the basic sequencing principles of TOPSIS, so replacing Euclidean distance with the connection distance is reasonable. We can calculate the relative closeness from each evaluation object to the ideal points successively and obtain the final results by sequencing them in the descending order.
Case study
With the rapid development of the automotive electronics technology and the continuous improvement of the customers’ need for entertainment and safety of automotive, the traditional vertical manufacturing mode is gradually hard to guarantee the whole process of automobile’s design, manufacture, and integration under the certain cost and periodic constraints. Cloud manufacturing mode combines the IT capacity with the traditional automotive manufacturing industry on-demand and low-priced and provides an effective solution to this problem and realizes the rapid integrating and updating of the automobile manufacturing enterprise. Cloud manufacturing platform has greatly facilitated the deep collaboration among different enterprises in the automotive industry chain. More importantly, the automotive manufacturing enterprises can gradually shift from the production-oriented pattern to service-oriented pattern through the cloud manufacturing platform, and the enterprise’s independent innovation and core competitiveness can be continuously improved.
To meet the development requirement, the management team of an automotive manufacturing enterprise has decided to introduce cloud manufacturing mode after careful analysis and discussion. After automobile industry cloud services market researching and electronic integration and update demand-oriented preliminary screening for cloud service suppliers, enterprise management team intends to choose the best one from IBM (
There are three experts to sort four objects. There are six samples shown in Table 1. In sample 1, four objects are
Six samples of BP neural network model.
Limited to the text space, the detailed training process of BP neural network is omitted. Finally, the judge importance degree vector is calculated as follows
From up to down, we first use FAHP considering the expert importance degree to determine the relative weight vector of
The matrix
The eigenvalue of
Similarly, we can get
After synthesizing three experts’ judgment results
We repeat the above steps; the relative weight vectors of the indexes
Service resource’s virtualization management and the judgment opinion of seven suppliers: IBM (
Judgment opinion of seven suppliers: IBM (
The judgment opinion made by experts
Limited to the text space, the detailed calculation processes are omitted. We repeat the same steps 2–4 in section “Index framework,” and the priority value of the suppliers
Finally, we get the objective weight vector of the indexes
The standardized decision matrix is shown in formula (25). We can obtain the equilibration coefficients
According to the integrated weight vector
The positive ideal point
As is shown in Table 3, the evaluation results of IBM (
Evaluation results of
Sequencing results using three kinds of weight.
Discussion
Three kinds of weights
As shown in Figure 5, the assignments of the proposed integrated weight, objective weight, 24 and subjective weight 35 are compared. The objective weight, which comes from the actual index values of evaluation objects, is the characterization of the inherent relationships among index values. Instead, the subjective weight, which comes from the human judgment on the effect of each index to the overall evaluation target, is often influenced by the subjective factors of experts.

Through the comparison of three kinds of weights in Figure 5, the findings are as follows:
Objective weight shows a more even distribution characteristics and this is because the index-value fluctuation of 18 indexes among seven suppliers is not very obvious.
The distribution of subjective weight is more irregular.
Integrated weight is in between.
Using the subjective weight, objective weight, and integrated weight, the sequencing results are shown in Table 4.
As shown in Table 4, the overall trends of the sequencing results using the three kinds of weights are consistent. The supplier TEAMSUN (
Four sequencing methods
The sequencing results using the proposed improved TOPSIS replacing Euclidean distance with connection distance, TOPSIS, 25 improved TOPSIS by angle measure evaluation 26 and improved TOPSIS by vertical projection 27 are compared in Table 5.
Sequencing results using four sequencing methods.
From the comparison shown in Table 5, the findings are as follows:
It is known that the sequencing result of the proposed improved TOPSIS replacing Euclidean distance with connection distance is as same as the result of TOPSIS,
25
which confirms the validity of the proposed method. The supplier TEAMSUN (
Improved TOPSIS by angle measure evaluation
26
only considers the angle closeness between the evaluation object and two ideal points, and ignores the difference in length. When two evaluation objects have the same angle closeness but different length, it will draw the wrong conclusion. The sequencing result of Microsoft (
When two or more objects have the same projective point on the connection line of two ideal points, improved TOPSIS by vertical projection
27
cannot distinguish these objects to sequence them. The closeness of Huawei (
Therefore, improved TOPSIS by angle measure evaluation 26 and improved TOPSIS by vertical projection 27 cannot meet the sequencing requirements in some special cases. From the case of this article, we can see that the improved TOPSIS by connection distance can solve the shortages of the improved TOPSIS by angle measure evaluation or vertical projection.
In this section, the application case of proposed approach and other approaches (objective weight, 24 subjective weight, 35 TOPSIS, 25 improved TOPSIS by angle measure, 26 and improved TOPSIS by vertical projection 27 ) are compared and analyzed. Considering the expert importance degree, the integration of objective and subjective weight, and the improved TOPSIS replacing Euclidean distance with connection distance, we explore a scientific and rational solution for cloud service supplier selection of manufacturing enterprise. Under the circumstance of cloud manufacturing, enterprise managers can achieve the goal of more scientific, reliable, and reasonable cloud service supplier selection by the propose approach.
Conclusion
With the development of cloud computing technology, manufacturing industry is rapidly promoting its information revolution, and a new mode named cloud manufacturing has emerged now. An important challenge which the enterprise or enterprise alliance must face under the circumstance of cloud computing technology is how to select the best cloud service supplier.
In this article, based on the analysis of existing researches, the index framework of cloud service supplier selection is built from two perspectives of technology and technology management. Considering the uncertain preference of enterprise or enterprise alliance decision-maker, the cloud service supplier selection is abstracted as an uncertain MCDM problem based on the index framework, and then a conjunctive MCDM approach is put forward based on integrated weight and improved TOPSIS.
The novelty of this article may include the following aspects:
By the aid of BP neural network’s self-learning ability, the expert importance degree can be determined more scientifically and reasonably.
The expert importance degree can make the group decision-making method of FAHP gain a beneficial supplement.
The weighting information loss exists in the individual objective or subjective weight, and the integrated weight can reduce this information loss.
The traditional TOPSIS and the commonly used improved TOPSIS by angle measure evaluation or vertical projection all have some shortages in special situations. The case application proves that the improved TOPSIS by connection distance can solve this problem.
For the possible limitations using a three-grade scale
