Abstract
Introduction
Real-time traffic signal control is very important for operation and management of urban transportation systems. During the past several decades, many models have been developed to optimize real-time signal timing parameters, and they can be mainly divided into two groups: mathematical programming method and simulation-based approach.
Most mathematical programming models are formulated based on the interrelations between evaluation indices (delay time, number of stops, queue length, capacity, etc.) and signal parameters (cycle, split, offset, etc.). They focus on seeking timing plan to optimize single or multiple objectives and to satisfy real-time traffic flows. During rather long evolution process, many researches have devoted to oversaturated traffic condition, which is more valuable for practical transportation systems. In pioneering works, minimum delay time has been taken as the optimization objective.1–3 Michalopoulos and Stephanopoulos4–6 further introduced the queue length constraints into intersection control and took the spillback phenomenon into account. Moreover, Ahn and Machemehl 7 integrated two objectives into the signal timing in oversaturated arterial networks: to maximize the number of passed vehicles and to minimize the queue spillback occurrence. All the above objectives have been used widely in traffic signal control in the literature.
Recently, multi-objective traffic control models have been studied extensively due to their good performances. Lieberman et al. 8 formulated a real-time control model for oversaturated arterials, with three objectives, that is, to maximize system throughput, to fully use storage capacity, and to provide equitable service. Ceder and Reshetnik 9 put forward two signal models for undersaturated and oversaturated intersection, respectively, with minimization of maximum queue and accumulative queue as the two objectives. Talmor and Mahalel 10 further introduced the maximum capacity into the objectives of signal control and presented an algorithm for signal design of an isolated intersection during congestion.
Many multi-objective traffic control models have been transformed to single-objective problems using weighted sum method, for instance, Jiao and Sun 11 proposed a multi-objective optimization model to minimize delay time and queue length and to maximize effective capacity and converted the original model into a single-objective problem through three weight coefficients. Meanwhile, some scholars solved the non-inferior solution problems based on Pareto front or fuzzy control methods. Schmöcker et al. 12 developed a multi-objective signal control model for urban junctions and employed fuzzy logic where the membership functions were optimized using the Bellman–Zadeh principle of fuzzy decision-making. Case studies indicated that it led to a Pareto-optimal solution directly, and different objectives could be balanced easily by setting their acceptability and unacceptability thresholds. Shou and Xu 13 used fuzzy control method to minimize delay time, number of stops, and queue length simultaneously for oversaturated intersections. The existing researches have proved that the combination of different objectives led to unfair competitions among evaluation indices, and non-inferior solutions of multi-objective control could realize the general optimization, despite the rather difficult algorithm.
Based on the existing mathematical programming models, some simulation-based approaches have been developed integrating traffic flow interactions. One of the representatives of early simulation-based methods is Traffic Network Study Tool (TRANSYT) described in Robertson, 14 Wallace et al., 15 and Wong. 16 Incorporating time-varying traffic information, some real-time adaptive traffic control systems were further developed, which were also simulation-based approaches, such as Sydney Coordinated Adaptive Traffic System (SCATS),17,18 Optimized Policies for Adaptive Control (OPAC), 19 Split, Cycle and Offset Optimization Technique (SCOOT),20,21 Real-time Hierarchical Optimized Distributed and Effective System (RHODES), 22 and so forth. All the above simulation-based approaches have been applied in practical traffic control all over the world; however, most of them are not applicable to Chinese cities, due to the complex mixed traffic flow conditions.
Unquestionably, time-dependent turning movement flows are very important input data for traffic signal control at intersections; however, they were unavailable from the existing traffic surveillance systems. Fortunately, such turning flows could be estimated using dynamic origin–destination estimation methods, such as Jiao et al.23–26 Therefore, we can employ time-varying turning flows as the input data and formulate the multi-objective real-time traffic signal control models for intersections. Furthermore, traffic parameters based on prediction are also very important for traffic control, which have also been considered in several researches.27–29
Since solution of nonlinear problem is not straightforward, some heuristic algorithms and swarm intelligence–based algorithms have been developed, for example, genetic algorithm (GA), ant colony optimization (ACO) algorithm, and particle swarm optimization (PSO) algorithm. PSO is a kind of swarm intelligence algorithm which was first proposed by Kennedy and Eberhart 30 and Eberhart and Kennedy. 31 PSO algorithm likens the optimization process to the movement process of some particles without weight and volume in the solution space, realizes the influences of historically optimal location of particle swarm to movement velocity and direction of the particles through cooperation and information sharing in particles, and approaches the optimal result in the complex solution space. It has been widely applied to many fields, for example, artificial neural network training 32 and some industrial areas. 33 It has also been used in some transportation-related fields, such as path planning problem.34–37 For multi-objective optimization applications, many approaches have been developed, such as Mostaghim and Teich 38 and Tripathi et al. 39 A rather general review PSO’s applications to multi-objective optimization could be found in Reyes-Sierra and Coello Coello 40 and Yao et al. 41
Especially concerning the solution of multi-objective optimization problems, due to contradicts among different objectives, it is very difficult to optimize all the objectives simultaneously, and sometimes even impossible. Since the most pioneering work of Pareto in late 19th century, Pareto front, namely, non-dominated solution set, has been employed to solve multi-objective optimization problems. 42 Similar work in transportation systems could be found in Cui et al., 43 Meng and Khoo, 44 Stevanovic et al., 45 El-Alfy et al., 46 and so forth. All the above researches have proved the effectiveness of Pareto front method in multi-objective optimization problems.
Focusing on real-time traffic control for intersections, one key feature of this article is to formulate a multi-objective traffic signal control model, utilizing minimum delay time, minimum number of stops, and maximum effective capacity as three objectives. The second key feature is to design a Pareto front–based PSO algorithm for solution of the nonlinear multi-objective model and to obtain real-time signal timing parameters.
We organize the rest of this article in the following five sections. The second section gives the fundamental problem statement and symbol definitions. The third section formulates the multi-objective traffic signal control model, including the detailed formulation of the model, and definitions of three objectives, that is, delay time, number of stops, and effective capacity. The fourth section explains variable definitions, position and velocity updating mechanism, and some important parameters in the PSO algorithm and designs a step-by-step algorithm flow. The fifth section reports the case study results based on actual survey data, including some scenario analyses of the parameters, comparisons of evaluation indices with the current situation and existing models, and robustness experiment of the proposed methodology. The last section summarizes conclusions of the article, as well as some potential research directions.
Problem statement and symbol definitions
This article takes a typical four-leg intersection under a four-phase signal control for representative. Models for other intersection types and signal phases could be formulated easily using the same method.
The signal phase is described in Figure 1. Here, we assume that there is no right-turn restriction, which is consistent with Chinese situations.

Signal phase of the intersection.
Some symbols used in the article are defined as follows:
In each signal cycle, we can formulate the following equations according to the basic principles of traffic signal control
Moreover, since too small green time causes frequent change in signal phases, which results in much start-up lost time, and too big green time leads to rather long waiting time, which brings about intolerable delay and large oil waste; therefore, we further incorporate the following constraint of the green time
Equations (1)–(4) constitute some of the basic formulations of traffic signal control.
Multi-objective traffic signal control model
The following variables are first defined:
Here,
To generally optimize the signal timing plan, we formulate a multi-objective traffic control model based on the above variables. Using phase time
In this article, minimum average delay time, minimum average number of stops, and maximum effective capacity are employed as three optimization objectives, that is
The above three objectives are further illustrated in the following.
Average delay time
The average delay time is formulated as below
Average number of stops
The average number of stops in Akcelik 47 is modified to express this index, as follows
where
Effective capacity
The effective capacity during phase
where
Therefore, the multi-objective traffic signal control model is generally formulated as the following equation
In this model, the time-varying turning movement flows are estimated from detected entering and exiting volumes using dynamic origin–destination estimation methods. Furthermore, since the input data are time-varying, this model could obtain real-time signal timing plan for intersections.
PSO algorithm based on Pareto front
PSO algorithm is a very efficient method especially applicable to multi-objective, nonlinear, discontinuous, and non-differentiable optimization problems. Meanwhile, in this article, we have three objectives in the nonlinear traffic signal control model. There exist interactions and contradicts among different objectives, and optimization of one objective usually causes inferiority of other objectives. Pareto front, that is, non-dominated solution set, has been proved to be very applicable to handle this problem. Therefore, we integrate Pareto front into the PSO algorithm for solution of the multi-objective real-time signal control model in equation (19).
Some key issues in the PSO algorithm based on Pareto front are illustrated as follows. Integration process of Pareto front and PSO algorithm is also presented in detail in this section.
Variable definitions
The global best PSO algorithm is employed in this article. There are totally
Current position:
Historical best position:
Velocity:
where
Position and velocity updating mechanism
During the iterative searching process, each particle updates its position and velocity according to historical individual best position and historical global best position. Position and velocity updating mechanisms are illustrated in the following equations
where
In the velocity updating equation (21), the first item reflects the influence of the current velocity, which relates the status of the particle in last iteration and balances the local and global searches; the second item indicates the influence of the cognitive mode, which relates historical memory of the particle and enables the global search ability; the third item shows global information of particle swarm and reflects information sharing and interactions among particles.
Parameters
Inertia weight
Inertia weight could realize effective control and adjustment of particle’s flying velocity. Rather big inertia weight tends to global search, while rather small inertia weight tends to local search. The most simple inertia weight is a fixed value. Dynamic inertia weight is usually utilized to speed up the global search process with a big value in the early period and to improve the local search accuracy with a small value in the late period. Therefore, dynamic inertia weight is used frequently in PSO algorithm, such as linear descending weight, nonlinear weight, adaptive weight, and random weight. Shrinkage factor is also used in place of inertia weight to avoid too small weight in the late period, which will lose the ability of searching new space.
1. Fixed inertia weight
Fixed inertia weight has been proved effective within the range [0.4, 1.4].
2. Linear descending inertia weight Formulation 1
Formulation 2
where
3. Nonlinear inertia weight Formulation 1
Formulation 2
Formulation 3
4. Adaptive inertia weight
5. Random inertia weight
where
6. Shrinkage factor
where
All the above inertia weights are employed in the case study for scenario analyses, and the best inertia weight is then determined.
Acceleration constant
As defined in the above section,
1. Fixed values: within the range [0, 4], and the sum of
2. Synchronous change
where
3. Asynchronous change
where
All the above three kinds of acceleration constants are employed in the case study for scenario analyses, and the best
Maximum particle velocity
Density distance
The Euclidean distance
Sorting all Euclidean distances between particle
In the same grade of Pareto dominance relation, with the increase in density distance, the particles change to be non-congested, and the diversity of the particles turns to be more obvious. Besides the above parameters, the size of particle swarm and number of iterations are also very important for PSO algorithm. Different values of them are also designed for scenario analyses in the case study, and the best values are then decided. All the above parameters maintain the balance between global and local search abilities and ensure the implementation of PSO algorithm process.
Algorithm flow
Based on the above explanations, a step-by-step flow is designed for the Pareto front–based PSO algorithm. The graphical illustration is shown in Figure 2.

Flow chart of PSO algorithm based on Pareto front.
The flow is further described in detail as follows:
Step 1: let iteration index
Step 2: compute fitness value of the particle according to fitness function, calculate density distance of each particle, and sort particles in the same grade of Pareto dominance relation according to density distance.
Step 3: search local best position of the particle and global best position of particle swarm using tournament selection principle according to ranking based on Pareto dominance relation and density distance.
Step 4: let
Step 5: update fitness value of the particle, calculate density distance of each particle, and sort particles in the same grade of Pareto dominance relation again according to density distance.
Step 6: update local best position of particle and global best position of particle swarm using tournament selection principle again.
Step 7: repeat Steps 4–6 until preset iteration number or accuracy requirement is arrived, and let each particle fall within Pareto front.
Step 8: terminate the algorithm, and output optimal real-time traffic signal timing plan as well as evaluation indices.
The above Pareto front–based PSO algorithm is coded using M language based on MATLAB platform.
Case study
To testify performances of the proposed multi-objective traffic control model and Pareto front–based PSO algorithm, we implemented a survey on a Wednesday morning at the intersection of Zhao Dengyu Road and Pinganli West Street in Beijing, China. We collected real-time link traffic volume and turning movement flow of totally 3 h, including both peak and nonpeak hours. We also gathered geometric features of the intersection, the current signal timing parameters, delay time, saturated time headway, and other necessary information. All the above data provided rather rich input and evaluation indices for the case study. Additionally, we preset the following constants in the signal timing plan: yellow time of each phase, 3 s; all red time of each phase, 1 s; minimum displayed green time, 15 s; maximum displayed green time, 45 s.
We implemented the proposed model and algorithm using MATLAB platform. Here, the case study mainly consists of four parts: scenario analyses of PSO parameters, comparison between the proposed model and current signal timing plan, comparison between the proposed model and traditional method (a pseudo multi-objective traffic control model), and influence of emergency.
Scenario analyses of PSO parameters
To determine the important parameters in the PSO algorithm, we first design some scenarios for the experiments. Here, inertia weight, acceleration constant, particle swarm size, and iteration number are taken for scenario analyses.
Inertia weight
As stated before, there are many kinds of inertia weights. For comparison, we first design some scenarios for fixed inertia weight, and the corresponding evaluation indices of the proposed model are summarized in Table 1.
Comparisons among fixed inertia weights.
The italic values show that the model effect is the best while the fixed inertia weight equals to 0.4.
From Table 1, we can find out that model effect is the best while the fixed inertia weight equals to 0.4. Therefore, 0.4 is employed as the representative of fixed inertia weight in the following analyses.
We further utilize linear descending weight (including Formulations 1 and 2), nonlinear weight (including Formulations 1, 2, and 3), adaptive weight, random weight, and shrinkage factor in the scenario analysis, and the comparisons of the three indices are shown in Table 2.
Scenario analysis of inertia weight.
The italic values indicate that random inertia weight is the best in all alternatives.
Graphical illustrations are further presented in Figures 3–5.

Delay time at different inertia weights.

Number of stops at different inertia weights.

Effective capacity at different inertia weights.
From the above tables and figures, we can find out that random inertia weight is generally the best in all alternatives. Therefore, we employ random inertia weight in the following analyses.
Acceleration constant
As stated in the previous section, we design scenarios in Table 3 for acceleration constant.
Scenarios of acceleration constant.
S-c: synchronous change; As-c: asynchronous change.
Graphical illustrations of evaluation indices at different acceleration constants are reported in Figures 6–8.

Delay time at different acceleration constants.

Number of stops at different acceleration constants.

Effective capacity at different acceleration constants.
From the above three figures, we can find out that the fixed acceleration constant pair 2–2 is the best choice. Therefore, we employ the fixed acceleration constant (2–2) in the following analyses.
Particle swarm size
Particle swarm size influences accuracy and efficiency greatly. Since the size usually falls within the range from 10 to 50, we set it as 10, 20, 30, 40, and 50, respectively, for scenario analysis. Table 4 summarizes the average CPU time for each signal cycle, which is output using MATLAB software.
Average CPU time for each signal cycle at different particle swarm sizes.
Three evaluation indices at different particle swarm sizes are further illustrated in Figures 9–11.

Delay time at different particle swarm sizes.

Number of stops at different particle swarm sizes.

Effective capacity at different particle swarm sizes.
Considering optimization effects and calculation efficiency together, we finally select 20 as the particle swarm size in the following analyses.
Iteration number
Big iteration number usually improves the accuracy of PSO algorithm; however, it will also greatly influence the efficiency. Based on random inertia weight, fixed acceleration, and particle swarm of 20, we further set iteration number as 20, 50, 100, and 200, respectively, for scenario analysis. Table 5 reports the average CPU time for each signal cycle
Average CPU time for each signal cycle at different iteration numbers.
Three evaluation indices at different iteration numbers are further presented in Figures 12–14.

Delay time at different iteration numbers.

Number of stops at different iteration numbers.

Effective capacity at different iteration numbers.
Overall consideration of optimization effects and calculation efficiency obviously shows that 20 is the best choice for iteration number.
Based on the above scenario analyses, we finally set PSO parameters as follows and apply them in the consequent analyses:
Inertia weight: random inertia weight;
Acceleration constant: relative weights of local and global searches are both 2;
Particle swarm size: 20;
Iteration number: 20.
Comparison between the proposed model and current scheme
To testify the effects of the proposed model, we further compare the signal timing plan from it with the current signal scheme. The results show that totally 74 cycles are obtained, as shown in Figure 15.

Real-time cycle length of the proposed model.
Different from current fixed timing, signal cycle from the proposed model is real-time, that is, it is applicable to time-varying travel demand. Furthermore, the average cycle length is 146 s during all 3 h from 7:00 a.m. to 10:00 a.m., 150 s during peak hours from 7:00 a.m. to 8:30 a.m., and 142 s during nonpeak hours from 8:30 a.m. to 10:00 a.m. Obviously, the average cycle length during peak hours is longer than that during nonpeak hours, and the cycle adjusts dynamically along with time-varying traffic flows.
We surveyed the average delay time for control effect comparison. Moreover, we calculated the capacity of the intersection under the existing signal timing. These two indices are employed for comparisons. The average delay time and effective capacity of the proposed model and current signal scheme are compared in Figures 16 and 17, respectively.

Delay time comparison between proposed model and current scheme.

Effective capacity comparison between proposed model and current scheme.
It is obvious that delay time at each entrance leg from the proposed model is less than that of the current scheme, as well as the average delay time. Meanwhile, effective capacity at each entering approach from the proposed model is greater than that of the current scheme except for the east entrance, and the average capacity of the proposed model is much larger than that of the current scheme. Therefore, the real-time signal timing plan from the proposed model is much more effective than the current signal scheme and is applicable to dynamic traffic flows.
Comparison between the proposed model and pseudo multi-objective method
As stated before, the existing multi-objective traffic control model usually converts into single-objective problem using weighted sum method, that is, pseudo multi-objective model. To testify the applicability of Pareto front in the proposed model, we also formulate a pseudo multi-objective model using the proposed objectives for comparison.
The objective of the pseudo method is
where
Using the above three weights, the objective lays particular emphasis on delay time and number of stops during nonpeak hours, while on effective capacity during peak hours. Equations (1)–(4) and (35) constitute the pseudo multi-objective control model together.
Comparisons of some signal parameters are summarized in Table 6.
Signal timing plans from different models.
Obviously, the number of cycles from the pseudo model increases dramatically, together with the sharp decrease in the average cycle length. Three evaluation indices are further illustrated in Figures 18–20.

Delay time comparison between proposed model and pseudo multi-objective model.

Number of stops’ comparison between proposed model and pseudo multi-objective model.

Effective capacity comparison between proposed model and pseudo multi-objective model.
We can find out that delay time at each entering leg from the pseudo multi-objective model is much larger than that of the proposed methodology, as well as the number of stops. Meanwhile, effective capacity at each entering leg from the pseudo model is much smaller than that of the proposed model. All these results indicate that the proposed methodology outperforms the pseudo multi-objective model greatly. The possible reason is that the single objective of the pseudo model is the weighted sum of three objectives during one signal cycle, and total delay time and number of stops will increase quickly with the extension of cycle length, which causes rather small value of cycle. Short signal cycle further induces frequent phase change and big time loss, resulting in unsatisfying effects. The above comparisons also prove advantages of Pareto front approach in multi-objective optimization model.
Influence of emergency
Most input data of signal control system are from traffic detection facilities. Sometime emergencies will happen with detectors, for instance, there are some outliers in the detected traffic volume, or some detectors are damaged and fail to input new data suddenly. To testify the robustness of the proposed methodology under such emergencies, we further design this experiment.
Two scenarios are designed for robustness tests:
There are some outliers in the detected traffic volume at east entrance, within a range of ±100%, that is, from 0 to double.
Detectors at east entrance fail thoroughly, that is, there is detected input data at east entering approach, and we duplicate detections at west entrance for east approach temporarily.
We also implement the above two scenarios using MATLAB code. Signal timing plans are summarized in Table 7.
Average signal timing plans under emergencies.
It is obvious that under Scenario 1, the signal timing plan remains almost unchanged, that is, the proposed model and algorithm work well in the presence of input outliers, even during peak hours. Comparatively, total failure of the detectors influences signal timing more greatly, because traffic volume at east entering approach is much bigger than that at west entrance, as well as the delay time and queue length, and substitution of detections at west approach increases the number of cycles. However, the intersection is still under regular operation, and the delay time does not increase too much, which can be found out from the following analyses.
Three evaluation indices are further illustrated in Table 8.
Evaluation indices under emergencies.
From Table 8, we can further find out that all three evaluation indices fall within very narrow ranges under emergencies. Even under total failure of some detectors, delay time still remains almost unchanged. Therefore, the proposed Pareto front–based multi-objective traffic signal control model using PSO algorithm is robust enough for on-line applications in real-time traffic control systems.
Generally, we reach the following results from the above case studies:
Comprehensively considering accuracy and efficiency, scenario analyses provide the most appropriate PSO parameters for the proposed multi-objective traffic control model, including random inertia weight, fixed acceleration constants (
Comparison between the proposed model and current scheme indicates that the multi-objective traffic control model provides real-time signal timing plan applicable to time-varying traffic flow and obtains better delay time, number of stops, and effective capacity than the current signal scheme.
Comparison with the traditional method shows that the proposed methodology outperforms the existing pseudo multi-objective traffic control model, which converts several objectives into single target using weighted sum method. It also proves the advantages of Pareto front in multi-objective optimization problems.
Under emergencies such as input outliers and total failure of detectors, the proposed methodology still works well, which demonstrates its robustness in on-line traffic control systems.
Conclusion
This article presents a general methodology for real-time traffic control at intersections, including a multi-objective optimization model and the corresponding Pareto front–based PSO algorithm. We first formulate a traffic control model for intersections based on detected time-varying traffic flows with three independent objectives, including minimum average delay time, minimum average number of stops, and maximum effective capacity. Second, according to both nonlinear and multi-objective characteristics of the proposed model, we design a PSO algorithm based on Pareto front for solution. The proposed methodology provides real-time traffic signal timing plan for intersections, including time-varying cycle and split. Using actual survey data, we further implement case studies to testify performances of the methodology, including scenario analyses of PSO parameters, comparison between the proposed model and current situation, comparison between the proposed model and traditional method, and influence of emergency. Scenario analyses give the most appropriate PSO parameters, comparison with the current situation indicates effectiveness of the proposed method, comparison with traditional approach proves the applicability of Pareto front in multi-objective problem, and influence of emergency demonstrates robustness of the proposed methodology. Generally, the Pareto front–based multi-objective real-time traffic signal control model for intersections using PSO algorithm is effective and robust enough for on-line applications.
This article can be developed toward following directions. The first is to comprehensively consider upstream and downstream junctions to formulate multi-objective traffic control models for urban arterial roads. The second is to develop multi-objective models for urban regional coordination control. The third is to design other swarm intelligence algorithms for solution and to compare them with Pareto front–based PSO algorithm.
