Abstract: In order to accurately evaluate the hybridradio frequency/ free space optical RF/ FSO (Rradio Frequency/ Free Space Optics) relay system performance, the closed form analytical expression of end to end outage probability of hybrid RF/ FSO relay system is derived by using the Meijer's G function. The hybrid
RF/ FSO relay system uses the amplification and forward relay and the RF(Radio Frequency) dual antenna transmission technology. The fading of the RF channel obeys the Rayleigh distribution, and the fading of the FSO (Free Space Optics) channel obeys the M distribution. The Monte Carlo simulation verifies the accuracy of the derivation.

Key words: radio frequency (RF) communication, free space optics (FSO), M distribution, outage probability