Abstract
Introduction
Underwater Robotic Vehicles (URV) are used in oceanographich studies and naval and archeological applications. The URV includes both Remotely Operated Vehicles (ROV) and Autonomous Underwater Vehicles (AUV). The ROV is normally used for the repairs of offshore structures or the inspection of the subsea environment (Antonelli et al., 2008, Koh et al., 2002). Actually URV operators are very sceptical about the prospect that AUVs will replace ROVs for inspection or repairs, so modern techniques are dedicated to designing advanced and intelligent ROVs with navigation systems (Ontini, 1998). In conventional operating, a human operator is in control and navigates the ROV by observing the images produced by an underwater camera. But a human in control is not efficient and not satisfactory because it is difficult to obtain a clear visual image from a camera and it is difficult to obtain a mathematical model of the environment around the ROV (Dai et al., 2002). Therefore, the priority of the ROV is to position itself, either tracking curves with autonomous navigation in the environment which has to be inspected, or near the structure of interest, against disturbances. Most ROVs are underactuated, so they have fewer control actuators than the number of independent directions of desired motion and in general, falls into category of so-called non-holonomic systems. However motion control strategies for non-holonomic Unmanned Aerial Vehicles (UAV) (Raimondi & Melluso, 2008) and for non-holonomic ground cars (Raimondi & Melluso, 2009) are not directly applicable to ROVs, because they are subjected to complex hydrodynamic factors (Fossen, 1994), they present unactuated dynamics and have a minimum surge control speed constraint that is greater than zero. Many ROVs operate in a crab-like manner with small roll and pitch angle that can be neglected during normal operations. Therefore it is useful to regard the vehicle's spatial motion as a superposition of two displacements: the motion in the vertical plane and the motion in the horizontal plane, so that it allows the ROV propulsion system to be divided into two independent subsystems responsible for movement in these planes respectively (Dobref & Tarabuta, 2007). For example the VideoRay ROV has two horizontal thrusters for planar motion and one for vertical motion (Miskovic et al., 2009). Motion control methodologies for ROVs have been put forward to handle external disturbances and parametric model uncertainties, i.e robust and adaptive control techniques, introducing the use of sliding-mode control (Yoerger & Slotine, 1985; Yoerger & Slotine, 1991). Hierarchical architecture for the motion control of underwater vehicles, which encompasses strategic, tactical and execution levels of control has been proposed (Valavanis et al., 1997). Horizontal motion control strategies have been developed adopting a dual-loop hierarchical guidance control scheme, based on a set of Lyapunov-based guidance task functions and a PI gain scheduling controller (Caccia & Verruggio, 2000). Vision-based conventional dual-loop hierarchical architecture for kinematic and kinetic control of the two dimensional motion of ROV has been developed (Caccia, 2007). Techniques of intelligent control have not been addressed in any of the above papers. The advantage of intelligent fuzzy systems is that the controller can be designed to apply heuristic rules that reflects the experiences of human experts and the membership functions are generally predefined according to the non-linearities of the system. A Fuzzy like proportional derivative (PD) controller for ROVs to control the yaw and the depth of the vehicle has been developed (Akkizidis et al., 2007). A Fuzzy logic system has been employed in ROV to perform autonomous navigation in 3D space (Day et al., 2002). Precise autonomous navigation remains a significant challenge for all underwater platforms (Hagen P.E. et al, 2009). One strategy is to employ the best possible inertial navigation system (INS) together with internal sensors, like for example accelerometers and gyros, as done by the Hugin navigation system (Jalving et al., 2003). However noise from the internal sensors of the INS is responsible for non-parametric uncertainties which perturb the localization of the ROV. Several alternatives have therefore been included for providing the integrated inertial navigation systems with position updates. Following the ROV with a survey vessel is the preferred method for obtaining maximum position accuracy (Hagen et al., 2009). The survey vessel is tethered to the ROV with an umbilical cable that relays control signals. It is powered down to the vehicle and returns sensor data, and it has to be equipped with a Global Position System (GPS) and Ultra Short Base Line (USLB) for tracking the ROV at all times. To obtain a good estimation of the vehicle's position, an off-line Kalman's Filter (KF) has been employed which processes data provided by exteroceptive (GPS and USLB) and internal sensors (Jwo et al., 2009; Fabrizi et al., 1998).
In this paper, to continue this line of research, a new closed loop fuzzy hierarchical horizontal motion control system with on-line KF for underactuated ROVs is presented. The following contributions are given:
New stochastical continuous time and sampled models for horizontal motion of underactuated ROVs. They are developed using polar coordinates to consider the unactuated sway direction. The continuous time model is necessary to apply the fuzzy guidance commands and the kinetic control laws, while the sampled model describes the transition relationship state during a sampling interval and it is necessary to apply the KF. Hierarchical architecture which merges a new low level kinetic controller with a new high level Fuzzy inference system. The fuzzy controller is responsible for prescribing the ROV guidance laws in terms of the surge speed and yaw rate needed to achieve horizontal motion control objectives in the work space. The kinetic controller gives the surge force and the yaw torque and ensures the convergence of the actual speeds to the guidance commands. Suitably actuator allocation gives the actuator forces. Unlike previous works (Caccia, 2007; Day et al., 2002; Caccia & Verruggio, 2000), an intelligent fuzzy controller has been addressed with a dinamical approach, where asymptotical stability is built on Lyapunov's theory, based on the properties of the fuzzy control surfaces. In other words, the stability theorem provides conditions on the fuzzy control surfaces under which the motion errors are bounded and converge to zero. The fuzzy controller proposed in this paper ensures the robustness of the motion with respect to disturbances due to the marine environment, forward surge speed and saturation of the control signals. A methodology for solving the on-line sensors data fusion using KF. Unlike to previous works (Jwo et al., 2009; Fabrizi et al., 1998), where off-line KF algorithms have been put forward to estimate the location of mobile vehicles, in this paper the KF is located in the feedback of the Fuzzy dynamic motion control system. It fuses data provided by internal and exteroceptive sensors, filters the noises of the internal sensors and obtains a good estimate of the feedback signals. In this way the KF compensates the effects of non-parametric uncertainties due to the noise of the internal sensors, i.e. discontinuities in the dynamics of the motion errors, guidance commands and force control signals.
This paper is organized as it follows. In Subsection 2.1 continuous time kinematic and dynamic models are presented for horizontal motion of an Underactuated ROV. The KF requires a stochastic sampled state space representation to be derived which is developed in subsection 2.2. Section 3.2 presents the new high level fuzzy control guidance commands, where the Lyapunov's theorem is used in order to investigate the asymptotical stability of the motion errors. Section 3.3 presents news kinetic control laws to obtain the surge force and the yaw torque from the guidance commands. Convergence of the actual speeds of the ROV to the fuzzy guidance commands is proved. In Section 3.4 the on-line KF algorithm is developed. Section 4 presents simulation experiments performed in a Matlab environment, where the effectiveness of our motion control system is shown.
This section focuses on the development of continuous and discrete time models for the planar motion of ROVs.
Continuous time dynamic model
Let (
where:
ψ(

ROV with reference systems.
The velocity transformation in the horizontal plane assumes the following form:
where
In extensive form the result is:
Practically all the trajectories are planned with combination of straightlines and arcs of circumference, so in many applications the reference surge velocity is positive and constant, while the reference yaw rate may be constant or null. However in (4) the presence of the sway speed is evident. It is responsible for translational motion with respect to the vehicle's longitudinal axis. In fact, the equations (4) require integration of the unactuated dynamics to obtain the planar trajectory from the surge and angular velocities. Therefore it is necessary to determine the dynamic model of the ROV. Indicate the thruster surge force with τ
Lemma 1
Assume the mass matrix of the ROV as the identity matrix. Then the dynamic model of the ROV assumes the following form:
Proof
The Lagrangian function of the system is given by:
The equations of the planar motion can be obtained using the following Lagrange formulation:
where
From the Lagrange equations (7) it follows that:
Differentiating equations (4) leads to the following model:
Multiplying the first and second equations of (10) by cos ψ(
From the dynamic equations (9) it follows that:
Substituting equation (12) into (11), result is:
Multiplying the first and second equations of (10) by cosψ(
From the dynamic equations (9), the result is:
Substituting (15) into (14), it follows that:
Therefore the complete dynamic model is given by (5). Q.E.D.
Generally, the mass matrix of the ROV is not the identity matrix and the hydrodynamic added mass has to be considered. Indicate the mass of the ROV with
where:
Since the sway force is unavailable, the greatest difficulty for the control of the ROV is how to properly handle the vehicle's sway dynamics. To deal with this problem, the following polar coordinates transformation is defined (see Fig. 1):
where:
is a polar angle and also called the sideslip angle [16].
Since the surge velocity is positive, it gives:
Differentiating the first equation of (19) and considering that:
the ROV kinematic model (4) and the dynamic equations (17) may be rewritten as it follows:
The accelerations of the ROV evaluated in relation to the ERF are given by:
Formula (24) may be written in relation to the body reference system as follows:
Remark 1
The INS calculates the position velocity and acceleration of the ROV from an Inertial Measurement Unit (IMU). An IMU consists of accelerometers measuring specific force and gyros measuring angular rate. The output of the accelerometers gives data on the accelerations (24). Therefore the longitudinal and lateral positions may be evaluated by applying the inverse of (24) and then double integration, once the orientation of the ROV has been calculated from the data of the gyros.
Remark 2
Following the ROV with a survey vessel is the preferred method to obtain maximum position accuracy. The survey vessel is equipped with a Global Position System (GPS) and tracks the ROV with an Ultra Short Base Line (USLB). By combining GPS with USBL the position of the ROV may be estimated. The IMU typically employ data provided by GPS and USBL to correct errors in the IMU state estimate. The KF will combine data obtained from internal and external sensors to localize the ROV with more precision.
Indicate with
where the components are the measurements of noise due to the IMU. Indicate the output vector of the external sensors constituted by GPS and USLB with ξ(
where
In this subsection a discrete time odometric model for planar motion of the ROV is set out. An analogical to digital converter obtains samples of
where Δ

ROV with odometric system
By considering the unactuated sway speed, the incremental distance traveled by the reference point is given by:
Let parameter
where
By assuming that:
where
and after some algebra, the complete odometric model yields:
where:
In this Section a new hierarchical control system for planar motion of underactuated ROVs is developed. A new high level fuzzy control obtains the guidance control laws, while a new low level controller generates the surge force command and the yaw torque control. A KF is inserted into the feedback of hierarchical control system to combine the data given by IMU, GPS and USLB and to obtain good estimates of the feedback position and orientation of the ROV. The fuzzy control system requires a knowledge of the model (23), while the KF requires a knowledge of the discrete time model (36).
Control problem formulation
Indicate the reference surge velocity and the reference yaw rate with
where:
Define the following vectors of the guidance laws:
and:
where
The actual position and orientation of the ROV can be obtained as it follows:
Remark 3
The control velocity
Indicate the surge force and the yaw torque control signals respectively with τ
where
The control system put forward in this paper is made up of two hierarchical levels. The high level controller gives the guidance commands (40), so that the following tracking errors evaluated in relation to the ROV body frame:
are bounded and converge to zero. A new Fuzzy controller will be employed without reference to the forces and moments that generates such motion. However, the dynamics of the ROV are given by the fourth and fifth equations in (27); therefore, the low level controller gives the functions τ
If the virtual controls converge to the guidance control laws, then the high level control ensures the trajectory tracking. When the velocities
Aleatory noises of the IMU made by the components of the vector (26) cause non-parametric uncertainties which perturb the model and, therefore, the measurements of the ROV's position. They can corrupt the performance of the control system in terms of the dynamics of the motion errors given by (43). Measurements obtained by GPS and USLB are necessary to correct the localization of the ROV. The KF will estimate the filtered state from the outputs of the IMU and the outputs of the exteroceptive sensors, i.e. it will estimate the actual feedback position and orientation of the ROV. The filter above requires the linear discrete time stochastic state space representation given by (35) to be obtained. Then, an estimation of the feedback signals, using a ‘Digital to Analogic Converter’ (DAC) with ‘Zero Order Hold’ (ZOH) provides analogical information for generating the motion errors (43) and for applying the high level guidance control laws (40) and the low level control signals.
The problem is to determine the guidance laws given by (39) and (40), where
where the nonlinear functions
The functions S=Small; M=Medium; H=High; Opp=Opposite.
The input and output Fuzzy memberships are generalized bell functions and they are shown in Figs. 3 and 4. The fuzzy rules are shown in Table 1. The fuzzy controller is shown in Fig. 5. Fig. 6–8 show the fuzzy control surfaces.

Input fuzzy membership functions

Output fuzzy membership functions

Fuzzy controller

Fuzzy control surface with constant lateral error

Fuzzy control surface with constant orientation error

Fuzzy control surface with constant longitudinal error
Fuzzy Rules
Fig. 5 and Table 1 show that the inputs of the fuzzification process are the absolute values of the tracking errors given by (42). The implemented method for the logical ‘and’ and for the implication are the ‘minimum’ and the ‘fuzzy minimum’. The consequents of each rule have been recombined using a maximum method. The defuzzyfication method is the ‘centroid’. The input ranges are [0m–0.8m] for the position errors and [0rad- 2rad] for the orientation error. The outputs of the fuzzy system are crisp values that are the numerical values of the functions
To ensure the Lyapunov's stability of the motion errors given by (43), analytical properties of the fuzzy maps must be satisfied.
Assumption 1
The membership functions have to be chosen in order to satisfy the following properties of the fuzzy control surfaces:
Remark 4
The fuzzy control surfaces shown in Figs. 6–8 ensure the satisfaction of the properties given by (48)–(53).
Remark 5
From Fig. 8 it is evident that the function
Remark 6
The property given by (49) ensures that:
where
Remark 7
The following conditions have been satisfied:
Therefore the surge control speed of the ROV may be bounded because it has forward command and the maximum values may be regulated by varying the maximum value of the function
Taking into account the derivative of the errors (43), by suitably replacing (41) and (47) with it, the following closed loop mathematical model is obtained:
Now a reformulation of the theorem presented in Raimondi & Melluso, 2008, is given for the underactuated ROV.
Theorem 1
Consider the mathematical model of the ROV given by (41), in closed loop with the fuzzy control law given by (47). Under assumption 1, the equilibrium state of the closed loop fuzzy navigation system given by (56) is the origin of the state space and it is asymptotically stable.
Proof
If the properties given by (48) are satisfied, then the equilibrium state of the representation (56) is the origin of the state space. We chooose the following Lyapunov's function:
Differentiating the function (57) and considering the analytical properties given by (53) lead to:
Based on the properties (48)–(52), the function (57) is definite positive. Assuming the reference longitudinal
Consequently, function (58) is definite negative. Therefore the equilibrium point of the closed loop system (56) is asymptotically stable. Q.E.D.
In this subsection news thruster surge force and yaw torque control laws are proposed for the underactuated system given by (23). The dynamic effects lead to the error given by (44), where
The problem is to determine a surge force control and a yaw torque control, which ensure the convergence to zero of the error given by (44). The following dynamical control laws are proposed:
Now the following theorem can be formulated.
Theorem 2
Consider the ROV system given by (23) in closed loop with the fuzzy guidance laws (47) and with the kinetic control laws (61). Then the speeds error given by (44) converge asymptotically to zero.
Proof
From the second equation of (60) and first equation of (50) it follows that:
By using ɛ(
the differential equation (62) can be rewritten as it follows:
It appears that, if the value of
It implies that:
so the second component of the vector (44) converges asymptotically to zero. Now, by considering that:
replacing (67) in the first equation of (60), the surge force given by the third equation of (23) is calculated by:
By choosing the surge torque control that results from the second equation of (61), gives:
It follows:
Since the virtual orientation control converges to the fuzzy guidance law (cf. eq. 65), equation (70) in a steady state may be formulated in the following way:
From the first equation of (22) it follows that:
Since the ROV must track straightlines or arcs of circumferences, the steady state value of the actual yaw rate is null or constant. Indicating the value above with
Dividing eq. (72) by
where
have to be real and negative, so the following constraint must be satisfied:
If (76) is verified, then the solution of the equation (73) is a function which converges asymptotically to zero. Q.E.D. Now consider an ROV with two horizontal thrusters (see Fig. 2). This topology can be found in a real vehicle VideoRay ROV. The problem of the actuator allocation is a linear connection between the space of the vehicle's force and moment, i.e. τ
Remark 8
The errors (44) converge for all the values of the hydrodynamic masses.
Remark 9
Here, the fuzzy guidance control laws (47) have been converted into low level dynamic control laws (61). Therefore the low level control laws have been selected in (60), so that the ROV exhibits the desired behaviour thus justifying the choice of the dynamic speeds given by (42). Also, by using the first three equations of the model (23), the dynamic speeds may be converted into actual position and orientation of the ROV. The measurement of the actual position and orientation using IMU can be affected by Gaussian noises due to the accelerometers and gyros. These noises cause non parametric uncertainties in the model of the ROV (cf. eq. 45). Therefore a KF in the feedback of the fuzzy control system has to be inserted, to merge the data provided by IMU and the exteroceptive sensors and obtain good estimates of the feedback signals.
The discrete time KF deals with the case governed by the sampled stochastic odometric model given by (35). From output data provided by the IMU sensors, i.e. the accelerometer and the gyros, information about the actual positions and orientation feedback can be obtained. Since these information is corrupted by noises, a KF has to be introduced into the hierachical control system of the previous subsection. From the data provided by the GPS, USLB and IMU sensors, the KF estimates a filtered position and orientation signal for the feedback. The first equation of (35) gives the sampled state model to elaborate the data provided by the IMU sensors. Furthemore, the second equation of (35) gives GPS and USLB position and orientation measurements. Given the sampled model (35), we want estimates
Note that
Thus it can be write:
We also define the “
The function (80) is the solution of the following equation:
where
Now we seek the optimal gain:
Equation (82) minimizes the sum of the variance of the estimation errors given by:
Differentiating (83), it follows that:
where
Calculating the function (78) in relation to the optimal gain given by (82), it follows that:
Based on the output observation, the following state is estimated:
Let us summarize the discrete time recursive KF algorithm so far. The initial conditions evaluation of the optimal gain using the equation (85); solving the equation of measurement update (87); updating the error variance by using (86); prediction of the future state using the equation (79); prediction of the covariance error (cf. eq. 81) updating the time and returning to step 1.
The KF gives
In this section simulation experiments are developed in a Matlab environment to show the performance of the proposed closed loop control system. The high level Fuzzy guidance control laws and the low level kinetic controller (cf. eqs. 47, 61) have been implemented. The KF algorithm has been implemented using C language with sequential acquisition and filtering of information provided by the IMU and the external sensors which have been simulated in a Matlab environment. Figs 9 and 10 show the block scheme of the hierarchical architecture proposed in this paper without and with KF. In case of hierarchical Fuzzy control without KF, the feedback signals are given by

Hierachical Fuzzy dynamic control system without KF.

Hierachical Fuzzy dynamic control system with KF.
The simulation results are obtained using nominal parameters of a real ROV (Ridao P. et al., 2004), that is:
The initial conditions of the KF are the following:
The sample time of the discretization is:
The numerical values of the fuzzy memberships are shown in Figs. 3 and 4.
Two simulation studies are developed. In the first simulation we compare the following cases:
Note that, if
Case a) The following values are chosen for the reference speeds:
Fig. 11 shows the reference and the actual motion of the ROV by using the hierarchical control architectures shown in Fig. 9 and 10 respectively.

Reference motion, actual motion of the ROV with and without KF
Remark 10
The circular trajectory of Fig. 11 does not violate the kinematic equations given by (37) and it is feasible when the ROV must inspect a limited area or an environment near the structure of interest.
Figs. 12 and 13 show the longitudinal motion errors in case of Fuzzy hierarchical control with and without KF.

Longitudinal motion error with and without KF.

Lateral motion error with and without KF.
Remark 11
Figs. 12 and 13 show that the motion errors are very small. It appears that the KF filters the measurements noises in a good way and improves the transient performance. It implies high accuracy in the horizontal motion control. Aleatory disturbances due to the marine environment have been introduced between 0 and 2s. Since they are not with Gaussian distribution, they are not filtered by the KF, but are compensated by the closed loop fuzzy control system.
In figs. 14 and 15 the high level fuzzy guidance control laws are plotted with and without KF (cf. eqs. 47).

Fuzzy linear speed control with and without KF.

Fuzzy yaw rate control with and without KF
Remark 12
In Fig. 14 the linear control speed appears positive in all the times. Consequently (cf eqs. 21, 22), the surge speed control is a forward command. Also the online KF reduces the discontinuities of the signals above. Note that both the linear control velocity (cf. Fig. 14) and the yaw rate control (cf. Fig. 15) converge to the reference values given by (92).
Figs. 16 and 17 show the low level control signals with and without KF (cf. eqs. 61).

Surge force control with and without KF

Yaw torque control with and without KF
Remark 13
From Figs. 16 and 17 it is possible to observe the remarkable improvement obtained by using the online KF. In case of absence of KF, there are high frequencies of the surge force and torque control, because a random noise of the IMU is present which perturbs the dynamics of the fuzzy control system. By using the KF, the control system is able to offset this noise more easily than in case of absence and the high frequencies of the low level control signals are reduced. In other words, by merging Fuzzy control and KF, the control system is able to compensate the motion errors by lower torque and surge force values than in absence of KF.
Figs. 18 and 19 show the speed errors (44) and the sideslip angle given by (20) with and without KF.

Surge speed, yaw rate error and sideslip angle without KF

Surge speed, yaw rate error and sideslip angle with KF
Remark 14
Figs. 18 and 19 show that the speed errors due to the application of the low level control laws plotted in Figs 16 and 17, converge to zero, as proved in Theorem 2. The sideslip angle is in the range given by (21). The online KF improves both the transient and the steady state. Indicate with

KF errors covariances
Remark 15
The low covariance errors shown in Fig. 20 confirm the goodness of the feedback state estimation.
Now, consider outside disturbance violating the nominal motion of the ROV. Fig. 21 shows the performance of the fuzzy control systems with and without KF. The disturbance can be caused by impact of the ROV with the external marine environment. So the simulation tests consist of generating a step disturbance at the time 4s.

Longitudinal motion error with perturbation
Remark 16
From fig. 21 it is evident that the KF filters the sensorial noises with good performances, but it does not filter the step disturbance. However the disturbance above is compensated by the closed loop fuzzy control both in case of presence of KF and in case of absence.
Case b) In this simulation experiment, results obtained by applying the high level control laws (47), where the functions
The initial conditions of the reference and ROV's positions and orientations are the following:
In case of control law (47), where the functions are given by (91), it is:
The planar reference trajectory and the actual horizontal motion of the ROV are shown in Fig. 22.

Reference planar trajectory and ROV's actual motion using Fuzzy hierarchical architecture with KF
In Figs. 23 and 24 one considers the longitudinal and lateral motion errors for showing the transient state performances, in case of hierarchical control with Fuzzy inference (see Fig. 10) and in case of the same control system with functions given by (91).

Longitudinal error using functions given by (91) and fuzzy approach

Lateral error using functions given by (91) and fuzzy approach
Remark 17
Figs. 23 and 24 show the performance of the initial transient, where there is a lower response time of the motion errors in case of Fuzzy approach than in case of control system using the functions given by (91).
In this paper a new Fuzzy/Kalman closed loop motion control system for underactutated ROVs has been developed. A merging of new high level fuzzy guidance commands, a new low level kinetic controller and an online KF has been presented. The fuzzy guidance commands ensure forward surge speed, saturation of the speeds control signals, robustness with respect to the perturbations due to the marine environment and lower response time of the motion errors than the hierarchical control without fuzzy. The asymptotical stability of the motion errors has been proved by using the Lyapunov's theorem and the properties of the fuzzy maps. The low level kinetic controller also ensures the convergence of the ROV's speeds to the fuzzy guidance commands. However the actual position and orientation of the ROV are corrupted by the sensorial noises of the IMU. Therefore a KF has been inserted in the feedback of the hierarchical fuzzy control. The KF filters the gaussian noises and improves the dynamical performance of the control system in terms of the motion errors and of the surge force and torque controls. Non-gaussian disturbances due to the marine environment and possible impacts of the ROV, can cause high values of the motion errors, but they have been compensated by the closed loop fuzzy control system with good transient and steady state performances, both in case of presence of KF and in absence.
