What makes SVG so special? Well, compared to other image formats such as JPG, PNG or GIF, SVG images are so-called vector graphics. This contrasts them to the aforementioned raster images.
Raster images are made up from pixels and cannot be scaled bigger without the loss of quality or looking "pixalated". Vector graphics, however, are made up from paths and can thus be scaled bigger without the loss of quality.