MOSI-Hate speech Project

 

Supervised by Professor Robert Pless

Content:

•Crawled the information from social media like Reddit, Twitter, and other platforms;

•Defined several types of the images like sexuality, violence and etc.,

•Conducted image processing and effectively analyzed images with obvious negative emotions from social networks;

•Classified images by Vision Transformer and detected the emotion of the words in the images by Bert;

•Put the above information into ALBEF and CLIP to train the mode,l, and predicted the emotion of a new image.