Towards Harmonic Extensions of Pulsed Melodic Affective Processing—Further Musical Structures for Increasing Transparency in Emotional Computation
Alexis J. Kirke and Eduardo R. Miranda
Pulsed Melodic Affective Processing (PMAP) is a method for the processing of artificial emotions in affective computing. PMAP is a data stream which can be listened to, as well as computed with. The affective state is represented by numbers which are analogues of musical features, rather than by a binary stream. Previous affective computation has been done with emotion category indices, or real numbers representing positivity of emotion, etc. PMAP data can be generated directly by sound and rhythms (e.g. heart rates or key-press speeds) and turned directly into into music with minimal transformation. This is because PMAP data is music and computations done with PMAP data are computations done with music. Why is this important? Because PMAP is constructed so that the emotion which its data represents at the computational level, will be similar to the emotion which a person “listening” to the PMAP melody hears. So PMAP can be used to calculate “feelings” and the result data will “sound like” the feelings calculated. Harmonic PMAP (PMAPh) is an extension of PMAP allowing harmonies to be used in calculations.
Keywords: Communications, Human-Computer Interaction, Music, Affective Computing, Boolean Logic, Neural Networks, Emotions, Multi-Agent Systems, Robotics, Harmony, Computation