Predicting Webpage Aesthetics with Heatmap Entropy

Abstract: Today, eye trackers are extensively used in user interface evaluations. However, it's still hard to analyze and interpret eye tracking data from the aesthetic point of view. To find quantitative links between eye movements and aesthetic experience, we tracked 30 observers' initial landings for 40 web pages (each displayed for 3 seconds). The web pages were also rated based on the observers' subjective aesthetic judgments. Shannon entropy was introduced to analyze the eye-tracking data. The result shows that the heatmap entropy (visual attention entropy, VAE) is highly correlated with the observers' aesthetic judgements of the web pages. Its improved version, relative VAE (rVAE), has a more significant correlation with the perceived aesthetics. (r=-0.65, F= 26.84, P$<$0.0001). This single metric alone can distinguish between good- and bad-looking pages with an approximate 85\% accuracy. Further investigation reveals that the performance of both VAE and rVAE became stable after 1 second. The curves indicate that their performances could be better, if the tracking time was extended beyond 3 seconds.