SIGMM Test of Time Paper Award

Award Description

This award is presented every year, starting in 2020, to the authors of the paper published either 10, 11 or 12 years previously at an SIGMM sponsored or co-sponsored conference (so the 2020 award would be for papers at a 2008, 2009 or 2010 SIGMM conference). The award recognizes the paper that has had the most impact and influence on the field of Multimedia in terms of research, development, product or ideas, during the intervening years, as selected by a selection committee. The contributions the selection committee will focus on may be theoretical advances, techniques and/or software tools that have been widely used, and/or innovative applications that have had impact on multimedia computing.

The rationale behind choosing 10, 11 or 12 years is that in any one year there might be 2 or 3 really impactful papers and in another year there may be none so choosing this window allows some flexibility here.
The Award Selection Committee may choose not to make an award in a given year.

Award Selection Committee

The selection committee consists of 5 members appointed by the current SIGMM elected officers (Chair, Vice-Chair and Conference Director) who serve staggered 3-year terms (initial members serve either 2, 3, or 4 years, subsequent members serve 3 years guaranteeing a rotation in/out each year), plus one of the general and one of the program co-chairs for that year’s Multimedia Conference. The 5-member committee is constituted no later than April 1st in a given year and their deliberations will be completed by October that year in time for the SIGMM Annual Business Meeting at the ACM Multimedia Conference, usually taking place in October or November.

The Award Committee will initially form a set of candidate papers for more detailed consideration, drawn from the eligible set published at a SIGMM sponsored event during the selection period. An individual is defined as being in conflict with a candidate paper if:

the individual is a co-author of the candidate paper or a close collaborator, past or present, or an author of the candidate paper,
the individual was at the same institution as a co-author of the candidate paper when the paper was published,
the individual is at the same institution as a co-author of the candidate paper currently,
the individual is at the same institution as a co-author of the candidate paper when the paper was published, or
the individual is a relative of a co-author of the candidate paper.

In defining a conflict we are guided by the principles of the ACM Conflict of Interest Policy for ACM publications ( https://www.acm.org/publications/policies/conflict-of-interest) and we refer to those in cases of doubt.
A Test of Time Award Selection Committee Member who has a conflict of interest with a paper that is in the candidate set will recuse himself/herself from the discussion process and a substitute will be selected by the Committee Chair in consultation with the SIGMM Executive Committee.

Funding

The award includes an honorarium of $1,000 and a certificate sponsored by SIGMM, and will be announced at the SIGMM Business Meeting each year.

Nomination Process

Nominations consist of the top papers from each SIGMM-sponsored conference for the years under consideration, ranked by number of citations according to the ACM Digital Library. Committee members may also nominate additional papers.

Previous Years Awards

2024

Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell.
Caffe: Convolutional architecture for fast feature embedding.
In Proceedings of the 22nd ACM International Conference on Multimedia, MM ’14, page 675–678, New York, NY, USA, 2014. ACM.
Link: https://dl.acm.org/doi/10.1145/2647868.2654889

2023

Damian Borth, Rongrong Ji, Tao Chen, Thomas Breuel, and Shih-Fu Chang.
Large-scale visual sentiment ontology and detectors using adjective noun pairs.
In Proceedings of the 21st ACM International Conference on Multimedia, MM ’13, page 223–232, New York, NY, USA, 2013. ACM.
Link: https://dl.acm.org/doi/10.1145/2502081.2502282

Honorable Mentions:

In the category of “MM Interfaces & Applications”

Florian Eyben, Felix Weninger, Florian Gross, and Bjoern Schuller.
Recent developments in opensmile, the munich open-source multimedia feature extractor.
In Proceedings of the 21st ACM International Conference on Multimedia, MM ’13, page 835–838, New York, NY, USA, 2013. ACM.
Link: https://dl.acm.org/doi/10.1145/2502081.2502224

In the category of “MM Systems & Networking”
Stefan Lederer, Christopher Mueller, and Christian Timmerer.
Dynamic adaptive streaming over http dataset.
In Proceedings of the 3rd Multimedia Systems Conference, MMSys ’12, page 89–94, New York, NY, USA, 2012. ACM.
Link: https://dl.acm.org/doi/10.1145/2155555.2155570

In the category of “MM Security and Privacy”
Vojtech Holub and Jessica Fridrich. Digital image steganography using universal distortion. In Proceedings of the First ACM Workshop on Information Hiding and Multimedia Security, IH&MMSec ’13, page 59–68, New York, NY, USA, 2013. ACM
Link: https://dl.acm.org/doi/10.1145/2482513.2482514

Selection Committee:

Ralf Steinmetz, Technical University of Darmstadt
Mohan Kankanhalli, National University of Singapore
Tao Mei, HiDream.ai
Laura Toni, University College London
Marco Bertini, Università di Firenze

2022

Jana Machajdik and Allan Hanbury.
Affective image classification using features inspired by psychology and art theory.
In Proceedings of the 18th ACM International Conference on Multimedia, page 83-92, 2010.
Link: https://dl.acm.org/doi/10.1145/1873951.1873965

Honorable Mentions:

In the category of “Multimedia Systems- Networks”

Saamer Akhshabi, Ali Begen, and Constantine Dovrolis. An experimental evaluation of rate-adaptation algorithms in adaptive streaming over http. In Proceedings of the 2nd Annual ACM Conference on Multimedia Systems, MMSys, page 157-168, 2011.
Link: https://dl.acm.org/doi/10.1145/1943552.1943574

In the category of “Multimedia Security and Privacy”

Mauro Barni, Tiziano Bianchi, Dario Catalano, Mario Di Raimondo, Ruggero Donida Labati, Pierluigi Failla, Dario Fiore, Riccardo Lazzeretti, Vincenzo Piuri, Fabio Scotti, and Alessandro Piva. Privacy-preserving fingercode authentication. In Proceedings of the 12th ACM Workshop on Multimedia and Security, MM&Sec, page 231-240, 2010.
Link: https://dl.acm.org/doi/10.1145/1854229.1854270

In the category of “Multimedia Interfaces and Applications”

Jörg Müller, Florian Alt, Daniel Michelis, and Albrecht Schmidt. Requirements and design space for interactive public displays. In Proceedings of the 18th ACM International Conference on Multimedia, page 1285-1294, 2010.
Link: https://dl.acm.org/doi/10.1145/1873951.1874203

Selection Committee:

Klara Nahrstedt, University of Illinois at Urbana-Champaign, US
Mohan Kankanhalli, National University of Singapore, Singapore
Shih-Fu Chang, Columbia University, US
Shin’ichi Satoh, NII Japan, General Co-Chair, ACM MULTMEDIA 2022
Laura Toni, UCL, UK, Technical Program Co-Chair, ACM MULTMEDIA 2022

2021

Winner (MM Systems & Networking):
Thomas Stockhammer,
Dynamic Adaptive Streaming over HTTP – Standards and Design Principles,
In Proceedings of the 2nd ACM Conference on Multimedia Systems, MMSys, pp. 133-144, 2011.
https://dl.acm.org/doi/10.1145/1943552.1943572

Honorable Mentions:

In the category of “MM Interfaces & Applications”:
Florian Eyben, Martin Wöllmer, and Björn Schuller, Opensmile: The Munich versatile and fast open-source audio feature extractor. In Proceedings of the 18th ACM InternationalConference on Multimedia, MM pp. 1459-1462, 2010.
Link: https://dl.acm.org/doi/10.1145/1873951.1874246
In the category of “MM Content Analysis, Retrieval, Query“:
Nikhil Rasiwasia, Jose Costa Pereira, Emanuele Coviello, Gabriel Doyle, Gert R.G. Lanckriet, Roger Levy, and Nuno Vasconcelos. A new approach to cross-modal multimedia retrieval. In Proceedings of the 18th ACM International Conference on Multimedia, MM '10, pp. 251-260, 2010.
Link: https://dl.acm.org/doi/10.1145/1873951.1873987
In the category of “MM Security and Privacy”:
Jan Kodovsky̒ and Jessica Fridrich, Calibration revisited, In Proceedings of the 11th ACM Workshop on Multimedia and Security, MM&Sec '09, pp. 63-74, 2009.
Link: https://dl.acm.org/doi/10.1145/1597817.1597830

Selection Committee:

Klara Nahrstedt, University of Illinois at Urbana-Champaign, US
Mohan Kankanhalli, National University of Singapore, Singapore
Shih-Fu Chang, Columbia University, US
John R Smith, General Co-Chair, ACM MULTIMEDIA 2021
Yang Yang, Program Co-Chair, ACM MULTIMEDIA 2021

2020

Andrea Vedaldi and Brian Fulkerson.
Vlfeat: An open and portable library of computer vision algorithms.
In Proceedings of the 18th ACM International Conference on Multimedia, MM ’10, page 1469-1472, New York, NY, USA, 2010.

Honorable Mention: Gabriel Takacs, Vijay Chandrasekhar, Natasha Gelfand, Yingen Xiong, Wei-Chao Chen, Thanos Bismpigiannis, Radek Grzeszczuk, Kari Pulli, and Bernd Girod. Outdoors augmented reality on mobile phone using loxel-based visual feature organization. In Proceedings of the 1st ACM International Conference on Multimedia Information Retrieval, MIR ’08, page 427-434, New York, NY, USA, 2008.

Selection Committee:

Klara Nahrstedt, University of Illinois at Urbana-Champaign, US
Mohan Kankanhalli, National University of Singapore, Singapore
Shih-Fu Chang, Columbia University, US
Elisa Ricci, Program Co-Chair, ACM MULTIMEDIA 2020
Rita Cucchiara, General Co-Chair, ACM MULTIMEDIA 2020

Faced with the issue of recognising papers published prior to the window of consideration, in the inaugural year, we also announce a set of up to 15 papers published at SIGMM conferences each year prior to 2008 as “honourable mentions” which could have been considered as strong candidates in their respective year of publication, if there had been an award for that year. The first SIGMM MULTIMEDIA Conference was held in 1993 and so these up to 15 honourable mentions cover the years 1993 to 2007 inclusive.

Year	Decision
1994	Dan, D. Sitaram, and P. Shahabuddin. Scheduling policies for an on-demand video server with batching. In Proceedings of the Second ACM International Conference on Multimedia, MULTIMEDIA ’94, page 15–23, New York, NY, USA, 1994.A. Hampapur, T. Weymouth, and R. Jain. Digital video segmentation. In Proceedings of the Second ACM International Conference on Multimedia, MULTIMEDIA ’94, page 357–364, New York, NY, USA, 1994.
1995	Asif Ghias, Jonathan Logan, David Chamberlin, and Brian C. Smith. Query by humming: Musical information retrieval in an audio database. In Proceedings of the Third ACM International Conference on Multimedia, MULTIMEDIA ’95, page 231–236, New York, NY, USA, 1995.Steven McCanne and Van Jacobson. Vic: A flexible framework for packet video. In Proceedings of the Third ACM International Conference on Multimedia, MULTIMEDIA ’95, page 511–522, New York NY, USA, 1995.
1996 1997	Greg Pass, Ramin Zabih, and Justin Miller. Comparing images using color coherence vectors. In Proceedings of the Fourth ACM International Conference on Multimedia, MULTIMEDIA ’96, page 65–73, New York, NY, USA, 1997.John R. Smith and Shih-Fu Chang. Visualseek: A fully automated content-based image query system. In Proceedings of the Fourth ACM International Conference on Multimedia, MULTIMEDIA ’96, page 87–98, New York, NY, USA, 1997.
1998	Kien A. Hua, Ying Cai, and Simon Sheu. Patching: A multicast technique for true video-on-demand services. In Proceedings of the Sixth ACM International Conference on Multimedia, MULTIMEDIA ’98, page 191–200, New York, NY, USA, 1998.
1999	Shingo Uchihashi, Jonathan Foote, Andreas Girgensohn, and John Boreczky. Video manga: Generating semantically meaningful video summaries. In Proceedings of the Seventh ACM International Conference on Multimedia (Part 1), MULTIMEDIA ’99, page 383–392, New York, NY, USA, 1999.
2000	Yong Rui, Anoop Gupta, and Alex Acero. Automatically extracting highlights for tv baseball programs. In Proceedings of the Eighth ACM International Conference on Multimedia, MULTIMEDIA ’00, page 105–115, New York, NY, USA, 2000.
2001	Simon Tong and Edward Chang. Support vector machine active learning for image retrieval. In Proceedings of the Ninth ACM International Conference on Multimedia, MULTIMEDIA ’01, page 107–118, New York, NY, USA, 2001.
2002	Venkata N. Padmanabhan, Helen J. Wang, Philip A. Chou, and Kunwadee Sripanidkulchai. Distributing streaming media content using cooperative networking. In Proceedings of the 12th International Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV ’02, page 177–186, New York, NY, USA, 2002.
2003	Yu-Fei Ma and Hong-Jiang Zhang. Contrast-based image attention analysis by using fuzzy growing. In Proceedings of the Eleventh ACM International Conference on Multimedia, MULTIMEDIA ’03, page 374–381, New York, NY, USA, 2003.
2004	Catherine Plaisant. The challenge of information visualization evaluation. In Proceedings of the Working Conference on Advanced Visual Interfaces, AVI ’04, page 109–116, New York, NY, USA, 2004.
2005	Cees G. M. Snoek, Marcel Worring, and Arnold W. M. Smeulders. Early versus late fusion in semantic video analysis. In Proceedings of the 13th Annual ACM International Conference on Multimedia, MULTIMEDIA ’05, page 399–402, New York, NY, USA, 2005.
2006	Yun Zhai and Mubarak Shah. Visual attention detection in video sequences using spatiotemporal cues. In Proceedings of the 14th ACM International Conference on Multimedia, MM ’06, page 815–824, New York, NY, USA, 2006.
2007	Anna Bosch, Andrew Zisserman, and Xavier Munoz. Representing shape with a spatial pyramid kernel. In Proceedings of the 6th ACM International Conference on Image and Video Retrieval, CIVR ’07, page 401–408, New York, NY, USA, 2007.