Abstract
Keywords
Introduction
With the rapid development of wireless communication technologies and wireless services, the demand for user traffic surges. According to the “5G Vision and Demand White Paper” 1 released by the IMT-2020 (5G) recommendation group, it is expected that the growth of China Mobile’s data traffic will increase by nearly 40,000 times from 2010 to 2030. However, the scarce and low-utilization spectrum resources have become a major bottleneck restricting the development of wireless networks. Through the dense deployment of multi-heterogeneous networks, the use of cognitive radio technology to dynamically access required types of communication spectrum (including high- and low-frequency bands, authorized and unlicensed spectrum, continuous and discontinuous, etc.) can improve data transmission rate and system capacity. It is an effective method to solve the conflict between users’ demand for increased traffic and the shortage of spectrum resources with low utilization rate, and is also the key technology of future 5G networks.2–4 Cognitive radio technology provides an effective technical means to solve the problem of shortage of spectrum resources and its low utilization rate. The user who obtains the spectrum authorization is called the primary user, and the user who does not receive the spectrum authorization is called the secondary user. The primary user has priority access to the spectrum and can use the spectrum at any time. At the same time, the primary network can transfer or lease the idle licensed frequency band to the secondary user, so that the secondary user can share the licensed frequency band. Most of the research results of cognitive radio mainly focus on the allocation of spectrum resources in a single primary network environment where the attributes of each spectrum resource are approximately the same and no need to consider the heterogeneity of spectrum resources of different primary networks.5,6 With the development of wireless communication technology and the diversified business needs of users, dense deployment and integration of multiple different types of networks (such as WiFi, cellular, and WiMax) become an important feature of future wireless networks. In this environment, multiple primary networks overlap and have different network characteristics, such as price, bandwidth, delay, and packet loss rate. Different user services also have different requirements. In the environment where the network domain of multiple networks and the user domain with multiple users are coupled and dynamically changed, and the spectrum allocation between different users interacts, how to efficiently and reasonably allocate idle spectrum resources of the primary network for each secondary user is a challenge.
This article studies the diversity of spectrum resource attributes and the diversification of secondary users’ requirements under the heterogeneous network dense deployment environment, and models the spectrum resource allocation problem as a dual-objective optimization problem. That is, the mathematical model is constructed with the goal of maximizing the total transmission rate and minimizing the total cost, along with the user’s business requirements as constraints. In order to solve this multi-constrained spectrum resource allocation problem, we first try to simplify the optimization objects and multiple constraints, and seek a simple polynomial time algorithm. Second, the traditional multi-objective optimization method non-dominated sorting genetic algorithm II (NSGA-II) is improved, including combining the interference constraints and the service quality requirements of the secondary users into the objective value evaluation, and correcting the chromosomes that do not meet the constraints. And then, making a decision selection on the optimal solution set to select a compromise solution.
The remaining sections of this article are organized as follows: next section introduces related works. Section “Network model and problem derivation” gives the network model and the derivation of problems. The simplification method and the improved non-dominated sorting genetic algorithm II (INSGA-II) are introduced in section “Simplification method and improved intelligent optimization algorithm.” Section “Experimental results analysis” gives the experimental results and analysis. Finally, the article is concluded in section “Conclusion.”
Related works
Domestic and foreign scholars have carried out active research works on the network selection and dynamic spectrum allocation, and have achieved many results, mainly based on graph theory,7–10 spectrum trading,11–14 game theory,15–19 and intelligent optimization algorithms.20–23 They are as follows:
Graph theory–based method: Zhu et al. 9 proposed a spectrum allocation algorithm using multiple-strategies discrete artificial bee colony algorithm, for the problem that the optimal frequency spectrum allocation strategy under the graph theory spectrum allocation model is difficult and time-consuming to search. In the algorithm, a coarse search strategy with strong global exploration capability was introduced to quickly optimize the initial population at the beginning of the search, and a fine search was performed with high-precision one-dimensional updates later. The graph theory-based approach is simple and easy to implement, and is mostly applicable to static network environments. This means that every change to the topology requires a recalculation of the allocation. If the topology changes frequently, the effectiveness of the algorithm will be greatly challenged.
Spectrum trading–based method: Xie et al. 14 proposed a spectrum allocation algorithm for cognitive wireless networks based on the equilibrium price theory. The algorithm uses two stages of inter-cluster and intra-cluster spectrum allocation to theoretically analyze and derive the mathematical expressions of the relationship between the optimal spectrum price and the number of spectrums, the number of cluster heads and cluster member nodes, the priority level of the node service and the number of communication activities of the node itself at different stages. The method based on spectrum trading is applicable to the application scenario based on the lease relationship between the primary user and the secondary user.
Game theory–based method: Tan et al. 19 proposed two new spectrum-sharing strategies to facilitate the formation of a more flexible and reliable monopoly of spectrum-sharing cooperation among all primary networks. By designing two new spectrum pricing strategies for each primary network, multiple primary networks with different interests can form a certain level of cooperative monopolies in the process of spectrum-sharing a single secondary network, thereby improving their long-term transmission utility.
Intelligent optimization method: comprehensively considering the allocation fairness and spectrum resource requirements of inter-cluster code division, Chuanbao et al. 20 converted the maximizing code subdivision spectrum resource efficiency and allocation fairness as a multi-objective discrete optimization problem, and proposed a new discrete combinatorial optimization algorithm, named membrane quantum cuckoo search algorithm. The algorithm uses the potential solution of the quantum bird nest characterization problem and obtains the Pareto front solution set with multi-objective optimal solution by the inter-membrane information sharing and non-dominated hierarchical ranking. Dong et al. 22 aimed at the contradiction between user surge traffic demand and spectrum shortage. Based on cognitive radio technology, an improved Hungarian algorithm was used to achieve rapid allocation of spectrum resources and improve spectrum utilization, however ignored the influence of channel conditions on the transmission rate. Hasan et al. 23 focused on the scenario where multi-heterogeneous primary networks overlap in a new generation network (5G network), and proposed an improved genetic algorithm and improved particle swarm optimization algorithm to solve the network selection and spectrum allocation problem according to the spectral characteristics of the primary network and the needs of the secondary users. However, Hasan et al. 23 only considered the differentiation of the spectrum in different primary networks, but ignored the differences in the attributes of different spectral resource blocks within the same primary network.
As mentioned above, a lot of achievements have been made in the network selection and spectrum allocation, but there is still the problem of scene adaptability. For example, the graph theory–based methods are suitable for a static network environment, and it is difficult to adapt to the requirements of secondary user mobility. The methods based on spectrum trading are suitable for the cognitive radio system in which the primary user and the secondary user are leased. The game theory allocation model is generally used to analyze the competition and cooperation relationship between spectrum users when the subject behaviors interact directly. Furthermore, research objects of most of the above methods are traditional channel allocation problems, that is, the heterogeneity of spectrum resources is not considered. The differentiation of the spectrum in different primary networks was considered by Dong et al. 22 and Hasan et al., 23 but they ignored the difference between spectrums in the same primary network and the influence of channel conditions on the transmission rate. Based on the works of Dong et al. 22 and Hasan et al., 23 this article considers more practical application requirements under the scenario of overlapping coverage of multi-heterogeneous primary networks. That is, each primary network has its own different network characteristics, even if the spectrum resources within the same primary network are different. At the same time, multiple secondary users existing in the secondary network have different service types and quality of service (QoS). Therefore, the above methods are obviously not directly applicable to the network selection and spectrum allocation of this article.
Network model and problem formulation
Network model
The schematic diagram of the multi-heterogeneous wireless network structure is shown in Figure 1, and the network model is as follows:
1. Suppose there are
2. Assuming that the secondary network is based on the cognitive network of the infrastructure. The base station centrally senses the secondary user request information and the status information of spectrum resources, and uses this as a decision basis for the spectrum allocation. The secondary user is a cognitive device–equipped user within the coverage of the base station in the cognitive network and can only access one spectrum at a time. Let secondary user set be
The transmission rate of the secondary user is related to the spectrum bandwidth, transmission power, and signal-to-noise ratio. According to Shannon’s theorem, the transmission rate of user
where
3. The spectrum of different primary networks varies in bandwidth, delay, cost, and packet loss rate. Even in the same primary network, the bandwidth, delay, cost, and packet loss rate of idle spectrum are also different, but they generally float within a certain range. Different secondary users have different businesses, such as voice, video, and file transfer which have different requirements for cost, bandwidth, delay, and packet loss rate. Therefore, the allocation of idle spectrum resources needs to take into consideration the attributes of different spectra and the service requirements of secondary users. In addition, when a secondary user accesses to the spectrum of a primary network, it will cause some interference to the primary network. The primary user’s communication quality will be seriously affected when the interference exceeds a certain threshold of the primary network, so the primary network must set a interference threshold to limit the number of secondary users’ access.

Multi-heterogeneous cognitive wireless network.
Problem formulation
This article focuses on the effective allocation of idle spectrum resources among secondary users after the cognitive network base station effectively perceives the primary network status and the secondary user request information, with the goal of obtaining a larger transmission rate at a lower cost without affecting the communication quality of the primary user. Based on this, the spectrum allocation problem is modeled as a dual-objective optimization model, which aims at maximizing transmission rate and minimizing cost and subjects to the primary network’s interference and secondary user’s business requirements constraint.
According to transmission rate shown in equation (1), the total transmission rate of all secondary users can be derived
The spectrum allocation problem in this article is modeled, as a nonlinear constraint 01 integer programming, as follows
s.t.
where objective function of equation (3) represents maximizing the total transmission rate obtained by all secondary users. The objective function of equation (4) represents minimizing the payment cost.
Problem complexity analysis
Assuming that the number of idle spectrum resources and secondary users are
Simplification method and improved intelligent optimization algorithm
As we can see from the analysis in section “Problem complexity analysis,” the spectrum allocation problem in this article is NP-hard, that is, there is no algorithm available for solving in polynomial time. Therefore, this article attempts to simplify the mathematical model and seeks a simple method to solve the problem. At the same time, for the complex allocation model, this article will also use an improved evolutionary algorithm to solve the problem.
Simplification method
The simplification method will simplify the constraints and objective functions, and use the proposed improved Hungarian algorithm to solve the spectrum allocation problem. The key steps are as follows.
Efficiency matrix construction
The efficiency matrix represents the efficiency value obtained by the secondary user in selecting the corresponding spectrum resource. The goal of this article is to obtain a larger transmission rate at a lower cost. Therefore, this article first constructs the transmission rate efficiency matrix and the cost efficiency matrix. The transmission rate corresponding to the spectrum resource can be calculated using equation (1).
Through the transmission rate efficiency matrix, the corresponding transmission rate when the secondary user selects the spectrum resource can be obtained. In the same way, the cost of the corresponding spectrum can be obtained through the cost–benefit matrix.
Objective function transformation
The objective of this article is to obtain the maximum transmission rate at the lowest cost while satisfying the QoS requirements of secondary user, and this is a dual-objective optimization problem. By introducing the relative transmission rate cost factor
where
Constraint simplification
Equation (5) indicates that the transmission rate of the idle spectrum selected by the secondary user must be greater than or equal to the transmission rate requirement of the secondary user. Therefore, the relative transmission rate factor,
Equation (9) indicates that the secondary user’s interference to the primary network should not exceed the primary network’s interference threshold. With the secondary user’s access, the interference to each primary network is gradually increased. This is a dynamic process, so equation (9) cannot be eliminated here by the same method. However, an improved Hungarian algorithm is proposed in this article, in which the secondary user’s interference to the primary network is considered in the process of assigning 0 elements. See section “Improved Hungarian algorithm” for details.
Standardized processing
Since the number of secondary users requesting services may not be equal to the number of idle spectrum
When
When
When
At the same time, normalization preprocessing also includes converting the relative transmission rate cost factor
Improved Hungarian algorithm
The Hungarian algorithm is a classical algorithm proposed by American mathematician, Kuhn, to solve the assignment problem. It is a polynomial time algorithm with the advantages of simple steps and high efficiency. 26
In this article, the Hungarian algorithm is improved, that is, the interference value constraint of the primary network is merged into the trial assignment step to ensure that the interference threshold of the primary network is not exceeded. At the same time, this article improves the key step “transform efficient matrix” of the traditional Hungarian algorithm to improve the efficiency of the algorithm.
The key steps of the improved Hungarian algorithm are as follows:
Transform efficiency matrix: compared with the traditional Hungarian algorithm, randomly subtracting the smallest element of the row (or column) from the row (or column) to get the 0 element, the improved method first counts the minimum number
Trial assignment: trial assignment includes two sub-steps: (1) independent 0 assignment: first, find the independent 0 element of each row in turn and calculate the primary network
Cover all 0 elements with a minimum line. The number of straight lines is
Transform the matrix to increase 0 elements. Set the minimum value of the elements not covered by the straight line of step 3 to be
By applying the above objective function transformation, constraint condition reduction, and standardized processing, the optimization model in Section “Problem formulation” can be simplified as
s.t.
The above optimization model can be transformed into the following standard matrix form
where
Time complexity analysis
According to the steps of the simplification method, the execution time of the efficiency matrix construction, the dual-objective transformation, the constraint simplification, and the standardization processing is negligible relative to the solution process of the improved Hungarian algorithm, and the following discussion focuses on the time complexity of the improved Hungarian algorithm. Assume that the numbers of secondary users and idle spectrum are both
INSGA-II
The NSGA-II proposed by Deb et al. 27 solves the multi-objective optimization problem using a powerful global search capability. The algorithm searches in parallel in multiple directions in the solution space and ultimately finds the possible solutions. This article proposes an INSGA-II, which integrates the interference constraint of the primary network and the QoS requirements of the secondary user into the objective value assessment of non-dominated sorting, and correct chromosomes that do not meet the constraints. At the same time, makes decision-making on the optimal solution set to get the final spectrum allocation scheme. The specific process of the proposed INSGA-II algorithm is as follows:
The following mainly introduces the improvement of the algorithm in this article.
Non-dominated sorting
The optimization objectives of this article include transmission rate maximization and cost minimization which are used for non-dominated sorting as follows.
Evaluation of chromosome objective values
If the allocation scheme corresponding to the chromosome satisfies the constraint of mathematical model in section “Problem formulation,” the optimization objective values are equal to the sum of the transmission rate and cost of each secondary user. Due to the randomness of the crossover and mutation operations, there are chromosomes that do not satisfy the constraint, such as the same spectrum allocated to multiple secondary users. For non-compliant chromosomes, they are usually removed from the population. In order to avoid eliminating too many non-conforming chromosomes and affecting the optimization effect, this article starts the correction procedure for non-compliant chromosomes as follows:
Non-dominated sorting based on objective values
For the total cost
where
There is at least one objective value that
As mentioned above, non-dominated sorting first requires that all chromosomes of the population be evaluated for objective values. Then, use the non-dominated definition to find all the non-dominated solutions in the population and assign the corresponding ranks, and perform until all the chromosome ranks of the population are allocated.27,28
Decision-making
The non-dominated sorting algorithm is used to obtain a set of optimal Pareto solutions. There is no solution in the set of solutions that can make all the optimization objectives optimal at the same time. However, in this article, a unique solution is required to allocate spectrum resources to each secondary user. Therefore, this article proposes a compromise selection strategy. The strategy is as follows
The above formula expresses the degree of closeness of each objective value of the chromosome to the optimal value, where
Experimental results analysis
Simulation setting
Assume that there are four primary networks (including two cellular networks, one WiMax, and one WiFi network), each with 10 idle spectrums. Suppose the interference caused by the same secondary user to different primary networks is the same, and the secondary user brings at least one unit (a dimensionless scalar) of interference. Therefore, the interference value
As shown in Table 1, the bandwidth, cost, delay, packet loss rate, and interference threshold of the network are all within a certain range. The experimental idle spectrums are randomly and uniformly distributed within this range.
Characteristics of the idle spectrum of each primary network.
Assume that there are three types of service requirements (voice, video, and file transfer) and 10 secondary users. Business-type distribution conforms to random uniform distribution. Different services and users have different service quality requirements, specifically as shown in Table 2.
User service and service quality requirements.
To evaluate the algorithm performance, the proposed methods are compared with the multi-objective artificial bee colony (MOABC) algorithm. Assume that the INSGA-II has a population size of 40, a crossover probability of 0.9, a mutation probability of 0.1, and a maximum iteration number of 1000. At the same time, in order to eliminate the randomness, the experiment was carried out 20 times, and the average value was taken as the experimental result.
Performance evaluation
This article mainly evaluates the effectiveness and time efficiency of three algorithms, and investigates the convergence performance of the proposed INSGA-II.
Effectiveness analysis of optimization results
Figures 2 and 3 compare the optimized objective values of the three algorithms as iterations from 100 to 1000, in which the INSGA-II method gives the results of three different decision selection weights, including cost-priority strategy (transmission rate weight 0.4, cost weight 0.6), transmission rate–priority (transmission rate weight 0.6, cost weight 0.4), and balance strategy (transmission rate weight 0.5, cost weight 0.5). The simplification method does not have an evolutionary iterative process, but it is still put into the figures.

Total transmission rate obtained by different strategies.

Comparison of the total costs of different strategies.
As shown in Figure 2, the transmission rate of the INSGA-II and MOABC algorithms generally increases with the number of iterations. When the number of iterations is greater than 300, the growth is slow and tends to converge. We can also see from Figure 2 that transmission rate of the INSGA-II with transmission rate–priority strategy is significantly higher than other algorithms. Similar to Figure 2, it can be seen from Figure 3 that the cost of the INSGA-II and MOABC algorithms gradually decreases as the number of iterations increases, especially the cost-priority strategy of INSGA-II. When the number of iterations is greater than 300, the costs tend to converge. The simplification method and INSGA-II of cost-priority strategy get the smallest cost.
In summary, for users with high transmission rate of service requirements, choosing the INSGA-II with transmission rate–priority strategy for spectrum allocation can achieve higher transmission rate. And, cost-sensitive users should use the simplification method or the INSGA-II with cost-priority strategy. The MOABC algorithm and the INSGA-II with balance strategy achieve more balanced performance.
Access probability analysis of different network spectrum
Figures 2 and 3 show the optimization results of the total transmission rate and total cost. The following experiments further study spectrum resources of which primary network are selected by different user services at the micro level and try to analyze why it is so selected to explain the results obtained in Figures 2 and 3. The ordinates of Figures 4–6 represent the accessing probability which is calculated by dividing the number of times the secondary user accesses the primary network by the number of experiments. As shown in the Figure 4 of simplification method, users who apply for voice services all choose to access the spectrum of cellular networks 2, because it can meet the high latency requirements of voice services, and its cost is low, thus having a high relative transmission rate–cost ratio compared to cellular network 1. For users who apply for video services, spectrum of WiFi network can provide the maximum relative transmission rate cost factor

Network selection probabilities for simplification method.

Network selection probabilities for INSGA-II with balanced strategy.

Network selection probabilities for MOABC.
Overall, it can be seen from Figures 4–6 that simplification method accesses to the spectrum resource of cellular network 2 and WiFi network with a high probability, while the probability that the INSGA-II with balance strategy and MOABC algorithm access four networks is relatively balanced. From the properties of the primary networks in Table 1, we can see that spectrum resource of cellular network 2 and WiFi network has a lower cost. Therefore, the cost of the simplification method is much lower than those of INSGA-II with balance strategy and MOABC algorithm. This is consistent with the results of Figures 5 and 6.
Comparison of execution efficiency
As shown in Figure 7, the running time of INSGA-II and MOABC algorithms increases linearly with the number of iterations, while the simplification method is almost negligible compared to the INSGA-II and MOABC algorithm because the simplification method mainly performs simpler 0 element search operations. So, the simplification method has obvious advantages in execution efficiency. It can also be seen from Figure 7 that the INSGA-II runs slightly slower than the MOABC algorithm, because the INSGA-II needs to perform large-scale cross-variation operations.

Comparison of execution efficiency.
For two evolutionary algorithms, theoretically, the more the iterations, the better the results, but it is at the expense of time. As shown in Figures 2 and 3 when the number of iterations is small (about less than 300 times), the transmission rate grows faster, while the cost is reduced faster too. But when the number of iterations is greater than 300, the evolutionary speed is getting slower and slower, and tends to converge. Therefore, we can stop iterations when the evolution speed is slow to save time.
Pareto frontier analysis of INSGA-II
Pareto frontier of the INSGA-II under different iteration numbers (100, 200, 300, 400, 500, and 600 iterations) is given below to further observe the convergence of the INSGA-II. The INSGA-II obtains a set of non-dominated solutions at each iteration, which cannot be averaged through multiple experiments. Therefore, we randomly performed 20 experiments, classifying all the results and randomly selecting some images from the classified images for analysis.
As can be seen from Figure 8, experimental results do have some randomness. For example, as shown in Figure 8(a) and (b), the objective values converge slowly as the iteration proceeds. In Figure 8(c) and (d), the objective values converge rapidly and almost overlap when iterated to 200 times. In Figure 8(e) and (f), the objective values have been overlapped from the iteration number 100. The above phenomenon reflects the different convergence speeds of different experiments, but they basically follow the rule that the transmission rate becomes larger and larger for the same cost as the number of iteration increases, and with the same transmission rate, the cost is getting smaller as the iteration proceeds. At the same time, Pareto front tends to converge as the number of iterations increases and basically tends to overlap when the number of iterations reaches 500 or more.

Pareto front of INSGA-II: (a)(b) objective values converge slowly, (c)(d) objective values converge rapidly, and (e)(f) objective values overlap.
Conclusion
In the context of multi-heterogeneous network convergence, this article comprehensively considers the heterogeneity of different network spectrums and the requirements of different user service. With the goal of maximizing user transmission rate and minimizing costs, a dual-objective optimization model for the allocation of idle spectrum resources is established. The complexity of the problem is analyzed and proved to be an NP-hard problem. On this basis, two solutions are proposed: (1) simplification method: first, the complex spectrum allocation problem is transformed into a standard form of the 01 programming problem by preprocessing of objective function, constraint simplification, and standardization. Then, the solution is solved by an improved Hungarian algorithm. (2) Using intelligent algorithms: this article improves the traditional multi-objective optimization algorithm NSGA-II, and proposes an INSGA-II method which integrates the interference constraints of the primary network and the secondary user’s service quality requirements into the objective value evaluation of non-dominated sorting and then correct chromosomes that do not meet the constraints. At the same time, makes decision-making on the optimal solution set to get the final spectrum allocation scheme. Finally, it can be seen from the experimental results that the simplification method has a greater efficiency advantage that its execution time is almost negligible compared to the evolutionary algorithms of INSGA-II and MOABC. In the case of high efficiency and low cost requirement, the simplification method can be prioritized, while INSGA-II, especially the transmission rate–priority strategy, is suitable for high transmission rate required scene.
This article mainly focuses on the spectrum allocation scenario of multi-primary networks and single secondary network, while the user terminal only has a single access capability. However, with the dense deployment of heterogeneous networks, multiple primary networks and multiple secondary networks overlapping scenarios will occur. At the same time, with the development of intelligent user terminals and diversified service requirements, terminals with multiple access capabilities will be deployed on a large scale. In a multi-primary networks and multi-secondary networks overlapping scenario, studying the spectrum resources allocation and switching, and user associations among secondary networks, researching the efficient allocation of spectrum resources among multi-access terminals, and achieving load balancing between networks and maximizing network and user benefits is a difficult problem. It is also a key issue for our future research.
