The Fermi Bubbles are two giant gamma-ray emitting lobes, extending 55° below and above the Galactic Center, that were discovered in 2010. While the Northern Bubble has been extensively studied in ultraviolet (UV) absorption, little is known about the UV properties of the Southern Bubble. We use UV absorption-line spectra from the Hubble Space Telescope Cosmic Origins Spectrograph (HST/COS) to probe the Southern Fermi Bubble using two sightlines to background AGN, one passing inside the Bubble (RBS 1768) and one passing just outside (RBS 2000). We used VPFIT, a Voigt profile fitting program to detect the existence of high-velocity absorption components and to measure the column density of different metal ions. We detected two high-velocity absorption components in both sightlines; one at vLSR = -150 km s-1 and one at vLSR = 160 km s -1. We determined that the component at vLSR = 160 km s-1 is due to the Magellanic Stream. Absorption is seen in ions of silicon, carbon and aluminium. The discovery that the high-velocity component is present in both sightlines shows that cool gas can extend further from the Galactic plane than the gamma-ray emitting regions. This could indicate past outflow activity prior to the creation of the Southern Bubble. This project was supported in part by the NSF REU grant AST-1358980 and by the Nantucket Maria Mitchell Association.