Abstract
Keywords
Introduction
Well placement is one of the most important steps in conventional or unconventional field development. Reservoir simulation has been frequently used to determine the optimal locations in well-placement problems. The ideal method is to conduct simulations for all possible drilling locations, called as the exhaustive simulation method, to obtain a true global solution wherein the cumulative production or the economic value is a maximum. However, because of the time and cost required for simulation, various optimisation techniques such as the gradient-based optimisation and stochastic-search algorithm have been developed to reduce the use of reservoir simulation. In the optimisation techniques, the cumulative production of hydrocarbon or the economic value of a reservoir is set as an objective function, and a global solution is searched to maximize the objective function. In case that the objective function is set to negative, the optimisation techniques search for a minimum.
The gradient-based optimisation has been used to obtain the optimum well placement and well trajectory for horizontal wells (Bangerth et al., 2006; Forouzanfar et al., 2010; Sarma and Chen, 2008; Wang et al., 2007). The main advantage of the gradient-based optimisation is that optimal solutions could be found quickly. However, one of the shortcomings of the method is that it depends strongly on the initial guess; hence, it may be trapped in a local optimum because of the initial guess.
To overcome the drawback of the gradient-based methods, the following stochastic-search algorithms have been proposed: simulated annealing (SA), genetic algorithm (GA), particle-swarm optimisation (PSO), and imperialist-competitive algorithm (ICA). The stochastic algorithms are more robust with higher chances of obtaining a global solution compared to the gradient-based methods. By optimizing the schedule and location of horizontal wells with fixed orientations in oilfields, Beckner and Song (1995) first applied the SA algorithm to maximise the net present value (NPV). Norrena and Deutsch (2002) also applied the SA for optimizing the well placement. The GA, which is one of the most popular optimisation algorithms, has been used in well-placement problems (Bittencourt and Horne, 1997; Emerick et al., 2009; Lee et al., 2009; Salmachi et al., 2013; Yeten et al., 2002).
Onwunalu and Durlofsky (2010) applied the PSO for optimizing the well placement and found that the PSO helped in achieving a better performance compared to the GA. Feng et al. (2012) optimised the well placement in a coalbed methane (CBM) reservoir by integrating the reservoir simulation and PSO algorithm. Al Dossary and Nasrabadi (2015) applied the ICA for the first time in oil and gas industry to obtain the optimum well location for maximising the well productivity.
Although the stochastic optimisation method requires fewer runs of reservoir simulation than the exhaustive simulation method, the reservoir simulation has to be performed a significant number of times to calculate the objective function. To reduce further the simulation runs in the stochastic optimisation method, the surrogate model technique has been adopted. In particular, ANNs are widely used to predict the output values of reservoir simulations, which comprise various input data, and provide an optimal prediction through learning techniques based on the nonlinearity between the input and output data (Centilmen et al., 1999; Doraisamy et al., 1998; Foroud et al., 2012; Lee et al., 2011; Min et al., 2011; Shahkarami et al., 2014; Zameer et al., 2017).
Doraisamy et al. (1998) applied ANNs for rectangular, L-shaped, and irregular shapes of reservoirs. They employed the infill well location and distance between the existing wells and an infill well as input data and the cumulative production of each well as output data. Centilmen et al. (1999) employed geological characteristics as the input data for the ANN to optimise the well locations in various gas reservoirs. Min et al. (2011) estimated the production rate using the production-potential map, which reflects the relative productivity of each grid in the reservoir.
The stochastic-search techniques have the following limitations. First, the search process in the stochastic-search techniques is iterative. The objective function is repeatedly calculated for various cases within the search space to minimise or maximise its value. When the global solution is reached for the first time, the solution is perceived as one of the local optima. It is after a sufficient number of iterations that the solution is confirmed as the global solution. During these iterations, a number of reservoir simulations are required in addition, which makes the techniques require cost and time. Even a local optimum could be accepted as the global solution, when there is no change in the obtained optimal solution during a sufficient number of iterations.
Second, in case of using the ANN to minimise the number of simulations, the predicted value using the ANN deviates from the true value obtained in the simulation run. This implies that the optimal solution identified using the ANN might not be the true global solution. To compensate for the deviation in the result of the ANN, the global solution could be determined by performing reservoir simulations on a group of near-optimal solutions resulting from the ANN. However, it cannot be ensured that the true global optimum is always included in the group of the near-optimal solutions.
In this study, a new methodology is proposed to overcome the aforementioned limitations by employing a series of ANNs sequentially. In the proposed method, each ANN is trained by successively increasing the amount of training data, and the search spaces gradually decrease to the global optimum. The proposed method is applied to the well-placement problem in a CBM reservoir.
Artificial neural network
The ANN is one of the most popular and widely used methods. The method is inspired by the intent of having machines that can emulate the human brain. The ANN is a robust approach used to approximate discrete or continuous target values and has been applied in several applications such as pattern recognition, classification, clustering, time-series forecasting, function approximation, optimisation, signal processing, telecommunications, and robotics.
The ANN comprises an input layer, a hidden layer, and an output layer (Figure 1). The training input pattern is transferred to the input layer, and the input pattern is transferred layer by layer until the output pattern is generated in the output layer. The weight of a neuron represents a hidden characteristic in an input pattern. If the output pattern is different from the target pattern, the error is calculated and is propagated backward along the neural network from the output layer to the input layer. The weights are corrected as the error is corrected. The optimal number of nodes in the hidden layer varies with the size of the optimisation problem. A guideline for the number of nodes in the hidden layer is expressed in equation (1).
Schematic of artificial neural network.

Methodology
The proposed sequential ANN method is a method wherein the search space is gradually reduced by sequentially applying a series of ANNs and selecting a search space wherein the objective functions satisfy the predefined criteria. The amount of training data required for subsequent ANNs increases, which comprise the training data used for the preceding network and a certain amount of data selected within the new search space determined by the preceding network. The prediction performance could be improved by repeatedly constructing an ANN with accumulation of training data. When the search space size satisfies the predefined stopping criterion, the reservoir simulations are performed for all cases in the remaining search space and the true global solution can be found.
Figure 2 depicts the flowchart of the sequential ANN method. The detailed procedure is described as follows:
The initial training data are obtained through the reservoir simulation and are used to train an initial ANN model. It is sufficient for the number of the initial training data points to be 10 or 20, but it depends on the size of the problem. After defining the search space for obtaining the global optimum, objective functions are predicted for the data in the search space using the ANN model. The objective functions can be set as the cumulative oil or gas production, NPV, or both. The objective functions, including the values of the training data, are sorted in descending or ascending order, and the top To train the subsequent ANN model, The subsequent ANN model is used to estimate the objective functions in the new search space. To reduce the search space until the stopping criteria is satisfied, step 3 through step 5 is repeated. One of the stopping criteria can be defined as follows: Let the reduced search space Flowchart of sequential artificial neural network method.

Results and discussion
Application to CBM reservoir
The proposed sequential ANN method is applied to the optimal well location problem in a CBM reservoir. The CBM reservoir is producing methane gas for three years through six vertical producers (p1–p6) as shown in Figure 3. The target is to obtain the optimal location of an infill horizontal well to maximise field production for 20 years. The reservoir has dimensions of 6.1 km × 3.7 km comprising 6771 grids with dimensions of 61 × 37 × 3. The length of each grid is 100 m in Sector model of CBM reservoir. Properties of CBM reservoir. CBM: coalbed methane.
The horizontal section of the infill well is set along the east–west or north–south direction. The horizontal interval of the infill well is assumed 300 m located at the centre of the reservoir thickness. Moreover, it is assumed that the well section cannot be located within the boundary grids and grids next to the existing well grids. The total number of cases wherein the infill well could be located in the reservoir is 3550. To verify the sequential ANN method, 3550 reservoir simulations were performed, and the global solution was identified in advance. The simulations were conducted using GEM developed by the Computer Modelling Group Ltd. (CMG, 2016).
Design of sequential artificial neural networks
Input data for artificial neural network.
The number of the initial training data points used to train the initial ANN model is 20 with 10 in the east–west direction and 10 in the south–north direction as shown in Figure 4. The red dot and the red line represent the heel location of the infill well and direction of the well, respectively. Among the training data, 85% of the input data were used for training and 15% for testing. The cutoff value Well locations for initial training data.
Global solution of infill-well placement
The initial ANN model was trained using 20 training data points. Figure 5(a) shows the training result, indicating that the reliability of the model is considerably high. The cumulative gas production is estimated for 3550 cases of the search space using the ANN model. Figure 5(b) shows the plotted result, where the horizontal and vertical axes represent the simulation and ANN results, respectively. To compare the model prediction with the simulation results, both the ANN and simulation results are cross-plotted. The light green points indicate the training data used to train the initial ANN model, and the blue circles indicate the estimation performed using the model. The red circle indicates the true global solution, which means that the gas production is maximised from the simulation result. The pink horizontal line is referred to as the cutoff value (a) Training result of initial ANN model, (b) cross plot of ANN model and simulation results, and (c) top 15% of search space using initial ANN model.
Figure 5(c) shows the new search-space map. The light green rectangles represent the training data, and the red rectangles represent the reduced search space
To train the subsequent ANN model, 10 data points from the reduced search space (a) Training result of 2nd ANN model, (b) cross plot of ANN model and simulation results, and (c) top 20% of search space using 2nd ANN model.
In the next step, additional 10 points in (a) Training result of 3rd ANN model, (b) cross plot of ANN model and simulation results, and (c) top 30% of search space using 3rd ANN model.
The 4th ANN model is trained using 50 training data points after randomly selecting 10 additional points from (a) Training result of 4th ANN model, (b) cross plot of ANN model and simulation results, and (c) top 40% of the search space using 4th ANN model.
Summary of applying the sequential ANN method to the CBM reservoir.
CBM: coalbed methane.
The size of the search space is the union of the top
The size of the search space excluding the training data.
Simulations for the 20 cases in

(a) Optimal infill well location found using the sequential ANN and (b) cumulative gas productions of optimal infill well and existing wells.
Results of repeated application of sequential ANN method.
Comparison with PSO algorithm
The PSO is a stochastic optimisation algorithm proposed by Kennedy and Eberhardt (1995). The PSO was derived from the research on the social behaviours of bird foraging. The detailed description of the algorithm can be found in Appendix. The PSO algorithm was performed for the aforementioned CBM reservoir to compare with the sequential ANN method in terms of the number of simulation runs. After performing the sensitivity study on the parameters of the PSO, the following values were selected. The number of particles is set to 20, and the maximum number of iterations for the PSO algorithm is set to 20. The components of a particle consist of heel position of an infill well and direction of the horizontal section. The weights
Figure 10 shows the trend in the minimum value of the objective function with respect to the number of iterations of the PSO algorithm conducted for the four repeated cases. In cases (a), (b), and (c), shown in Figure 10, the global solution was found as − 7.978 × 108 that was the cumulative gas production multiplied by minus one. However, in case (d), the solution converged to a local minimum of − 7.756 × 108 and the global solution could not be found. Table 5 presents the summary of the results. The simulation runs required for the algorithm to obtain the global solution for the first time for each case are 93, 96, and 125, respectively. However, this is not sufficient to confirm that the global solution has been reached at this point, because it is uncertain whether the obtained minimum value would change further. It can be confirmed that the global solution is obtained only when the minimum value has not changed for a sufficient number of iterations.
Objective functions of PSO with respect to iterations for four repeated cases. Summary of PSO results. Case (d) converges to a local minimum instead of the global solution.
In cases (a), (b), and (c), wherein 20 iterations of the PSO algorithm were performed, the required simulation runs were 124, 131, and 157, respectively (Table 5). It can be confirmed that the global solution was obtained after !!20 iterations in case (a) because the minimum of the objective function had not changed for the last 12 iterations as shown in Figure 10. However, the same is unsure for case (c) because of the slightly short duration (5 iterations) during which the minimum of the objective function is constant. Hence, more iterations may be needed to confirm the global solution for case (c). It should be noted that in case (d), the global solution could not be found despite the long duration of the constant value in the objective function. Compared to the PSO algorithm, the sequential ANN method, which requires at most 70 simulation runs for the same problem, is very efficient in terms of simulation runs required to obtain the global solution.
Conclusions
In this study, a sequential ANN method is proposed to obtain the optimal well placement. In the sequential ANN method, the search space is reduced while constructing the ANN sequentially. The ANNs are newly trained at each iteration using the training dataset that is added gradually with a predefined number of data points within the reduced search space, which improves the estimation performance of the network. As the iteration progresses, the cutoff value, above which the search space narrows down, is increased to reduce the possibility of the global solution dropping out of the subsequent search space.
When applying the sequential ANN method to a CBM reservoir, the ANNs were trained four times sequentially and were successfully used to find the optimal location of a horizontal infill well by performing 70 simulation runs. The result of repeated application to the same problem indicates that the sequential ANN method is reliable. When the PSO was used for the same problem, at least 124 simulation runs were required to recognise that the sought solution could be the global solution. Compared to the PSO, the sequential ANN method was verified as a more efficient algorithm. The performance of the sequential ANN method depends on its parameters. It is noted that the parameters of the sequential ANN method should be adjusted according to the reliability of the ANN training result and the size of the problem. The sequential ANN method can be applied to the problems where the optimal solution should be searched in a finite search space with the hard computing, e.g. an expensive and time-consuming reservoir simulation.
