You can upload vector files and GIFs to the Brand Library. They aren't supported as uploads in the Files Library however. A list of accepted file types can be found here.
Scroll down to the section titled Elements and you can upload your .svg and .gif files there.