The Effect of Music and Editing Style on Subjective Perception of Time When Watching Videos

An Eye-tracking Study

in Projections
Author:
Kathryn Nicole Sam Christ University, Bengaluru

Search for other papers by Kathryn Nicole Sam in
Current site
Google Scholar
PubMed
Close
and
K. Jayasankara Reddy Associate Dean, Christ University, Bengaluru

Search for other papers by K. Jayasankara Reddy in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Arousal, editing style, and eye movements have been implicated in time perception when watching videos. However, little multimodal research has explored how manipulating both the auditory and visual properties of videos affects temporal processing. This study investigated how editing density and music-induced arousal affect viewers’ time perception. Thirty-nine participants watched six videos varying in editing density and music while their eye movements were recorded. They estimated the videos’ duration and reported their subjective experience of time passage and emotional involvement. Fast-paced editing was associated with the feeling of time passing faster, a relationship mediated by fixation durations. High-arousal background music was also associated with the feeling of time passing faster. The consequences of this study in terms of a possible auditory driving effect are explored.

Contributor Notes

Kathryn Nicole Sam has a master's degree in neuropsychology from CHRIST (Deemed to be University), Bengaluru. She is interested in the experimental study of narratives. Specifically, she is interested in the cognitive and neural processes associated with viewing films.

Dr K. Jayasankara Reddy is an Associate Dean of Social Sciences, professor of psychology, and coordinator for the Centre for Research at CHRIST (Deemed to be University), Bengaluru. He is also in charge of the Cognitive Lab. He is an active teacher, researcher, and practitioner in the fields of health, cognitive neuropsychology, and neuroscience.

  • Collapse
  • Expand

Projections

The Journal for Movies and Mind

  • Ansani, Alessandro, Marco Marini, Francesca D'Errico, and Isabella Poggi. 2020. “How Soundtracks Shape What We See: Analyzing the Influence of Music on Visual Scenes Through Self-Assessment, Eye Tracking, and Pupillometry.Frontiers in Psychology 11 (October). https://doi.org/10.3389/fpsyg.2020.02242.

    • Search Google Scholar
    • Export Citation
  • Ansani, Alessandro, Marco Marini, Luca Mallia, and Isabella Poggi. 2021. “Music and Time Perception in Audiovisuals: Arousing Soundtracks Lead to Time Overestimation No Matter Their Emotional Valence.” Multimodal Technologies and Interaction 5 (11): 68. https://doi.org/10.3390/mti5110068.

    • Search Google Scholar
    • Export Citation
  • Appelqvist-Dalton, Mattis, James P. Wilmott, Mingjian He, and Andrea Megela Simmons. 2022. “Time Perception in Film Is Modulated by Sensory Modality and Arousal.” Attention, Perception, & Psychophysics 84 (March): 926–942. https://doi.org/10.3758/s13414-022-02464-9.

    • Search Google Scholar
    • Export Citation
  • Asutay, Erkin, and Daniel Västfjäll. 2017. “Exposure to Arousal-Inducing Sounds Facilitates Visual Search.” Scientific Reports 7 (1): 10363. https://doi.org/10.1038/s41598-017-09975-8.

    • Search Google Scholar
    • Export Citation
  • Balzarotti, Stefania, Federica Cavaletti, Adriano D'Aloia, Barbara Colombo, Elisa Cardani, Maria Rita Ciceri, Alessandro Antonietti, and Ruggero Eugeni. 2021. “The Editing Density of Moving Images Influences Viewers’ Time Perception: The Mediating Role of Eye Movements.” Cognitive Science 45 (4): e12969. https://doi.org/10.1111/cogs.12969.

    • Search Google Scholar
    • Export Citation
  • Bausenhart, Karin M., Maria Dolores de la Rosa, and Rolf Ulrich. 2014. “Multimodal Integration of Time: Visual and Auditory Contributions to Perceived Duration and Sensitivity.Experimental Psychology 61 (4): 310322. https://doi.org/10.1027/1618-3169/a000249

    • Search Google Scholar
    • Export Citation
  • Block, Richard A., Simon Grondin, and Dan Zakay. 2018. “Prospective and Retrospective Timing Processes: Theories, Methods, and Findings.” In Timing and Time Perception: Procedures, Methods & Applications, ed. Argiro Vatakis, Fuat Balcı, Massimiliano Di Luca, and Ángel Correa, 3251. Leiden, The Netherlands: Brill.

    • Search Google Scholar
    • Export Citation
  • Boltz, Marilyn G. 2017. “Auditory Driving in Cinematic Art.Music Perception 35 (1): 7793. https://doi.org/10.1525/mp.2017.35.1.77

    • Search Google Scholar
    • Export Citation
  • Brighouse, Carolyn, Jess Hartcher-O'Brien, and Carmel A. Levitan. 2014. “Encoding of Duration and Rate by an Integrative Model of Temporal Processing.Timing & Time Perception Reviews 1 (3): 111. https://doi.org/10.1163/24054496-00101003

    • Search Google Scholar
    • Export Citation
  • Cáceda, Ricardo, Jessica M. Carbajal, Ronald M. Salomon, Jordan E. Moore, Greg Perlman, Prasad R. Padala, Abdullah Hasan, and Pedro L. Delgado. 2020. “Slower Perception of Time in Depressed and Suicidal Patients.” European Neuropsychopharmacology 40 (November): 4–16. https://doi.org/10.1016/j.euroneuro.2020.09.004.

    • Search Google Scholar
    • Export Citation
  • Cocenas-Silva, Raquel, José Lino Oliveira Bueno, Paul Molin, and Emmanuel Bigand. 2011. “Multidimensional Scaling of Musical Time Estimations.Perceptual and Motor Skills 112 (3): 737748. https://doi.org/10.2466/11.24.PMS.112.3.737-748

    • Search Google Scholar
    • Export Citation
  • Dowiasch, Stefan, Svenja Marx, Wolfgang Einhäuser, and Frank Bremmer. 2015. “Effects of Aging on Eye Movements in the Real World.” Frontiers in Human Neuroscience 9 (February). https://doi.org/10.3389/fnhum.2015.00046.

    • Search Google Scholar
    • Export Citation
  • Droit-Volet, Sylvie, and John Wearden. 2016. “Passage of Time Judgments Are Not Duration Judgments: Evidence from a Study Using Experience Sampling Methodology.” Frontiers in Psychology 7 (February). https://doi.org/10.3389/fpsyg.2016.00176.

    • Search Google Scholar
    • Export Citation
  • Droit-Volet, Sylvie, Danilo Ramos, José L. O. Bueno, and Emmanuel Bigand. 2013. “Music, Emotion, and Time Perception: The Influence of Subjective Emotional Valence and Arousal?Frontiers in Psychology 4 (July). https://doi.org/10.3389/fpsyg.2013.00417.

    • Search Google Scholar
    • Export Citation
  • Eugeni, Ruggero, Stefania Balzarotti, Frederica Cavaletti, and Adriano D'Aloia. 2016. “It Doesn't Seem It, But It Is: A Neurofilmological Approach to the Subjective Experience of Moving-Image Time.” In The Extended Theory of Cognitive Creativity: Interdisciplinary Approaches to Performativity, ed. Antonino Pennisi and Alessandra Falzone, 243265. Cham, Switzerland: Springer Nature.

    • Search Google Scholar
    • Export Citation
  • Goldberg, David P. 1972. The Detection of Psychiatric Illness by Questionnaire: A Technique for the Identification and Assessment of Non-psychotic Psychiatric Illness. Oxford: Oxford University Press.

    • Search Google Scholar
    • Export Citation
  • Goldberg, David P., and Paul Williams. 1988. A User's Guide to the General Health Questionnaire. Berkshire: NFER-Nelson.

  • Grall, Clare, and Emily S. Finn. 2022. “Leveraging the Power of Media to Drive Cognition: A Media-Informed Approach to Naturalistic Neuroscience.Social Cognitive and Affective Neuroscience 17 (6): 598608. https://doi.org/10.1093/scan/nsac019

    • Search Google Scholar
    • Export Citation
  • Grühn, Daniel, and Susanne Scheibe. 2008. “Age-Related Differences in Valence and Arousal Ratings of Pictures from the International Affective Picture System (IAPS): Do Ratings Become More Extreme with Age?Behavior Research Methods 40 (2): 512521. https://doi.org/10.3758/BRM.40.2.512

    • Search Google Scholar
    • Export Citation
  • Ibáñez, María Blanca, Ángela Di Serio, Diego Villarán, and Carlos Delgado Kloos. 2014. “Experimenting with Electromagnetism Using Augmented Reality: Impact on Flow Student Experience and Educational Effectiveness.” Computers & Education 71 (February): 1–13. https://doi.org/10.1016/j.compedu.2013.09.004.

    • Search Google Scholar
    • Export Citation
  • Jackson, C. 2007. “The General Health Questionnaire.” Occupational Medicine 57 (1): 79. https://doi.org/10.1093/occmed/kql169.

  • Juvrud, Joshua, Gabriel Ansgariusson, Patrik Selleby, and Magnus Johansson. 2022. “Game or Watch: The Effect of Interactivity on Arousal and Engagement in Video Game Media.IEEE Transactions on Games 14 (2): 308317. https://doi.org/10.1109/TG.2021.3073084

    • Search Google Scholar
    • Export Citation
  • Kovarski, Klara, Joanna Dos Reis, Claire Chevais, Anaïs Hamel, Dominique Makowski, and Marco Sperduti. 2022. “Movie Editing Influences Spectators’ Time Perception.” Scientific Reports 12 (November). https://doi.org/10.1038/s41598-022-23992-2.

    • Search Google Scholar
    • Export Citation
  • Kunzmann, Ute, Cenita S. Kupperbusch, and Robert W. Levenson. 2005. “Behavioral Inhibition and Amplification During Emotional Arousal: A Comparison of Two Age Groups.Psychology and Aging 20 (1): 144158. https://doi.org/10.1037/0882-7974.20.1.144

    • Search Google Scholar
    • Export Citation
  • Lake, Jessica I., Kevin S. LaBar, and Warren H. Meck. 2016. “Emotional Modulation of Interval Timing and Time Perception.” Neuroscience & Biobehavioral Reviews 64 (May): 403–420. https://doi.org/10.1016/j.neubiorev.2016.03.003.

    • Search Google Scholar
    • Export Citation
  • Latulipe, Celine, Erin A Carroll, and Danielle Lottridge. 2011. “Love, Hate, Arousal and Engagement: Exploring Audience Responses to Performing Arts.” In CHI ‘11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1845–1854. New York: Association for Computing Machinery. https://doi.org/10.1145/1978942.1979210.

    • Search Google Scholar
    • Export Citation
  • Nather, Francisco C., José L. O. Bueno, Emmanuel Bigand, and Sylvie Droit-Volet. 2011. “Time Changes with the Embodiment of Another's Body Posture.” PLoS ONE 6 (5): e19818. https://doi.org/10.1371/journal.pone.0019818.

    • Search Google Scholar
    • Export Citation
  • Peifer, Corinna, André Schulz, Hartmut Schächinger, Nicola Baumann, and Conny H. Antoni. 2014. “The Relation of Flow-Experience and Physiological Arousal under Stress — Can u Shape It?Journal of Experimental Social Psychology 53 (July): 62–69. https://doi.org/10.1016/j.jesp.2014.01.009.

    • Search Google Scholar
    • Export Citation
  • Pek, Jolynn, and David B. Flora. 2018. “Reporting Effect Sizes in Original Psychological Research: A Discussion and Tutorial.Psychological Methods 23 (2): 208225. https://doi.org/10.1037/met0000126

    • Search Google Scholar
    • Export Citation
  • Ptacek, Radek, Simon Weissenberger, Ellen Braaten, Martina Klicperova-Baker, Michal Goetz, Jiri Raboch, Martina Vnukova, and George B. Stefano. 2019. “Clinical Implications of the Perception of Time in Attention Deficit Hyperactivity Disorder (ADHD): A Review.” Medical Science Monitor 25 (May): 3918–3924. https://doi.org/10.12659/MSM.914225.

    • Search Google Scholar
    • Export Citation
  • Rights, Jason D., and Sonya K. Sterba. 2019. “Quantifying Explained Variance in Multilevel Models: An Integrative Framework for Defining R-Squared Measures.Psychological Methods 24 (3): 309338. https://doi.org/10.1037/met0000184

    • Search Google Scholar
    • Export Citation
  • Sandstrom, Gillian M., and Frank A. Russo. 2010. “Music Hath Charms: The Effects of Valence and Arousal on Recovery Following an Acute Stressor.Music and Medicine 2 (3): 137143. https://doi.org/10.1177/1943862110371486

    • Search Google Scholar
    • Export Citation
  • Shivakumar, Prafulla, Shilpa Sadanand, Srikala Bharath, N Girish, and Mathew Varghese. 2015. “Identifying Psychological Distress in Elderly Seeking Health Care.” Indian Journal of Public Health 59 (1): 18. https://doi.org/10.4103/0019-557X.152849.

    • Search Google Scholar
    • Export Citation
  • SR Research. Experiment Builder. V. 2.2.299. SR Research. 2020.

  • Streubel, Berit, and Ute Kunzmann. 2011. “Age Differences in Emotional Reactions: Arousal and Age-Relevance Count.Psychology and Aging 26 (4): 966978. https://doi.org/10.1037/a0023424

    • Search Google Scholar
    • Export Citation
  • Thönes, Sven, and Daniel Oberfeld. 2015. “Time Perception in Depression: A Meta- Analysis.Journal of Affective Disorders 175 (1): 359372. https://doi.org/10.1016/j.jad.2014.12.057

    • Search Google Scholar
    • Export Citation
  • Thoenes, Sven, and Daniel Oberfeld. 2017. “Meta-Analysis of Time Perception and Temporal Processing in Schizophrenia: Differential Effects on Precision and Accuracy.” Clinical Psychology Review 54 (June): 44–64. https://doi.org/10.1016/j.cpr.2017.03.007.

    • Search Google Scholar
    • Export Citation
  • Turgeon, Martine, Cindy Lustig, and Warren H. Meck. 2016. “Cognitive Aging and Time Perception: Roles of Bayesian Optimization and Degeneracy.” Frontiers in Aging Neuroscience 8 (May). https://doi.org/10.3389/fnagi.2016.00102.

    • Search Google Scholar
    • Export Citation
  • van der Linden, Dimitri, Mattie Tops, and Arnold B. Bakker. 2021. “Go with the Flow: A Neuroscientific View on Being Fully Engaged.European Journal of Neuroscience 53 (4): 94763. https://doi.org/10.1111/ejn.15014

    • Search Google Scholar
    • Export Citation
  • Vuorre, Matti, and Niall Bolger. 2018. “Within-Subject Mediation Analysis for Experimental Data in Cognitive Psychology and Neuroscience.” Behavior Research Methods 50 (October): 2125–2143. https://doi.org/10.3758/s13428-017-0980-9.

    • Search Google Scholar
    • Export Citation
  • Wallengren, Ann-Kristin, and Alexander Strukelj. 2015. “Film Music and Visual Attention: A Pilot Experiment Using Eye-Tracking.Music and the Moving Image 8 (2): 6980. https://doi.org/10.5406/musimoviimag.8.2.0069

    • Search Google Scholar
    • Export Citation
  • Wang, Xinyue, Clemens Wöllner, and Zhuanghua Shi. 2021. “Perceiving Tempo in Incongruent Audiovisual Presentations of Human Motion: Evidence for a Visual Driving Effect.Timing & Time Perception 10 (1): 7595. https://doi.org/10.1163/22134468-bja10036

    • Search Google Scholar
    • Export Citation
  • Wittmann, Marc. 2014Embodied Time: The Experience of Time, the Body, and the Self.” In Subjective Time: The Philosophy, Psychology, and Neuroscience of Temporality, ed. Valtteri Arstila and Dan Lloyd, 507523. Cambridge: MIT Press.

    • Search Google Scholar
    • Export Citation

Metrics

All Time Past Year Past 30 Days
Abstract Views 1345 540 21
Full Text Views 109 61 1
PDF Downloads 107 46 1