Classification of emotions induced by music videos and correlation with participants’ rating

• The DT-CWPT time–frequency features represent user’s emotional state effectively.
• SVD–QRcp and F-Ratio based feature selection eliminate redundant and weak features.
• Features selected are mostly from brain region involved in emotional activities.
• Valance and liking show strong correlation in almost all subbands of DT-CWPT.

Emotional experience and preference play a vital role in selection of multimedia content for an individual. Brain electrical activity bears the emotional cues needed for emotion detection, but very modest research has been done to extract those cues. This paper presents a novel machine learning approach using Dual-Tree Complex Wavelet Packet Transform (DT-CWPT) time–frequency features from electroencephalogram (EEG) to detect emotions together with an analysis of brain activity in different emotional states. Firstly, DT-CWPT is used to extract time–frequency emotional features. Then non-redundant and most discriminating emotional features are selected through singular value decomposition (SVD), QR factorization with column pivoting (QRcp) and F-Ratio based feature selection (FS) method. The reduced emotional feature set is used to classify emotion using support vector machine (SVM) and validated by leave-one-out cross-validation scheme. Results confirm the robustness and consistency in classification of emotions from EEG signals and significant correlation between participants’ self assessed ratings with emotional features. It also gives an analysis of activities in brain region during different emotional states.