Wednesday 19 September 2007 (room Brussels)

The CLEF 2007 Workshop was held from 19-21 September in Budapest , Hungary , immediately following the eleventh European Conference on Digital Libraries (ECDL 2007). Working Notes containing a description of the organisation of the campaign, reports on the experiments of the participating groups and a first analysis of their results are now available.

The aim of the Workshop was to present and discuss the results of the CLEF 2007 evaluation campaign and allow researchers and developers to compare performance between systems using different approaches and strategies.

CLEF 2007 Workshop Programme

Wednesday 19 September 2007
14:00	Welcome – Carol Peters, ISTI-CNR, Pisa, Italy
14:30	Ad Hoc Overview Main Mono and Bilingual Tasks: Track Organisation and Results Analysis – Nicola Ferro, U. Padua, Italy Overview of Results and Lessons Learned from Robustness Evaluation – Thomas Mandl, U. Hildesheim, Germany
15:20	Domain-Specific Overview – Vivien Petras, GESIS – Social Science Information Centre, Germany
15:40	What’s happening in iCLEF? – Julio Gonzalo LSI-UNED, Madrid, Spain
16:00	Break
16:30	Use Cases for Interactive Multimedia Access – Jussi Karlgren, SICS, Stockholm, Sweden
16:50	QA@CLEF Overview Main Mono and Bilingual Tasks and Answer Validation Exercise Overview – Anselmo Peñas, Lsi-Uned, Madrid, Spain Overview of QAST 2007 – Christelle Ayache, ELDA, Paris, France
17:30	ImageCLEF Overview ImageCLEFPhoto Task – Michael Grubinger, Victoria University, Melbourne, Australia ImageCLEFMed Task – Henning Müller, U and U Hospital of Geneva, Switzerland ImageCLEF Medical Annotation and Object Retrieval – Thomas Deselaers, RWTH Aachen University, Germany
20:00	Workshop Dinner – Restaurant Lugas, Budapest

Thursday 20 September 2007, Morning Session
09:00	GeoCLEF Overview Track Overview: Query Classification and Geographic Search – Thomas Mandl, U. Hildesheim, Germany; Diana Santos, Linguateca, SINTEF ICT, Norway; Mark Sanderson U. Sheffield, UK. Results and Analysis – Giorgio Di Nunzio, U. Padua, Italy
09:40	CL-SR Overview The CLEF 2007 Cross-Language Speech Retrieval Track – Gareth J.F. Jones, Dublin City U., Ireland; Douglas W. Oard, U. Maryland, USA; Pavel Pecina, Charles University, Czech Republic
10:20	CLEF@SemEVAL: Eneko Agirre, IXA NLP Group, University of the Basque Country, Spain
10:40	CLEF@MorphoChallenge: Mikko Kurimo, Adaptive Informatics Research Centre, Helsinki University of Technology, Finland
11:00	Break
	11:30 - 13:00 Parallel sessions
11:30 - 13:00	Cross-Language Speech Retrieval Chair: Douglas W. Oard Brown at CL-SR’07: Retrieving Conversational Speech in English and Czech – Matthew Lease, Brown Laboratory for Linguistic Information Processing, Brown University, USA Dublin City University at CLEF 2007:Cross-Language Speech Retrieval Experiments – Gareth J.F. Jones, Dublin City U., Ireland Model Fusion Experiments for the Cross-Language Speech Retrieval Task at CLEF 2007 – Muath Alzghool, School of Information Technology and Engineering University of Ottawa, Canada Attempts to Search Czech Spontaneous Spoken Interviews: the University of West Bohemia at CLEF 2007 CL-SR track – Pavel Ircing, University of West Bohemia, Czech Republic
11:30 - 13:00	Ad-Hoc with Domain-specific Chair: Thomas Mandl Stemming and Search Strategies for East European Languages – Ljiljana Dolamic, Computer Science Dept., University of Neuchâtel, Switzerland Performing Cross-Language Retrieval with Wikipedia – Peter Schönhofen, Computer and Automation Research Institute of the Hungarian Academy of Sciences Cross-Lingual Information Retrieval System for Indian Languages – Jagadeesh Jagarlamudi, Multilingual Systems Research, Microsoft Research India CoLesIR at CLEF 2007: from English to French via Character N-Grams – Jesus Vilares, U. Coruna, Spain XRCE at Domain Specific Task: Adapting Dictionaries Technology Evaluation for Multilingual and Multimodal – Gabriela Csurka, Xerox Research Centre Europe, France
13:00	Lunch

Thursday 20 September 2007, Afternoon Session
	14:30 - 16:00 Parallel sessions
14:30 - 16:00
14:30 - 16:00

Centre, Germany

Madrid, Spain

	LSI-UNED, Madrid, Spain ELDA, Paris, France

	Budapest


	,



	QA@CLEF (room Strasbourg) Chair: Danilo Giampiccolo DFKI at QA@Clef 2007 – Günter Neumann, LT-lab DFKI, Saarbrücken, Germany The Senso Question Answering Approach to Portuguese QA@CLEF-2007, José Saias, Universidade de Évora, Portugal Choosing the right answer - combining answer validation and information fusion for improved answer selection – Ingo Glöckner, IICS, FernUniversität in Hagen, Germany Robust Question Answering for Speech Transcriptions using Minimal Syntactic Analysis – Pere R. Comas, TALP Research Centre - UPC, Barcelona, Spain
	ImageCLEF (room Brussels) Chair: Henning Müller Towards an Annotation-based Query/Document Expansion Method for Image Collections – Manuel Montes y Gómez, TIA-INAOE, Mexico XRCE at ImageCLEF – Gabriela Csurka, Xerox Research Centre Europe, France IPAL at ImageCLEF 2007 Mixing Features, Models and Knowledge – Sheng Gao, IPAL French-Singaporean Joint Lab, I2R & CNRS, Singapore Image Annotation Task: an SVM-based Cue Integration Approach – Tatiana Tommasi and Barbara Caputo, IDIAP Research Institute, Switzerland Re-Segmented Pre-Classified Images for Object Retrieval – Matyas Brendel, Computer and Automation Research Institute of the Hungarian Academy of Sciences, Hungary
16:00	Break
16:30	Invited Talk: Lessons from NTCIR-6 and a Plan of Task Cluster-Based Coordination for NTCIR-7 – Noriko Kando, NII, Tokyo, Japan
17:00	Invited Talk: FIRE: Forum for Information Retrieval Evaluation for Indian Languages – Mandar Mitra, Indian Statistical Institute, Kolkata, India
17:20 - 19:30	Poster Boaster and Poster Session
19:00 - 21:00	Steering Committee Meeting (room Strasbourg)

Friday 21 September 2007
	09:00-10:30 Parallel sessions
09:00 - 10:30	GeoCLEF (room Brussels) Chair: Mark Sanderson Query Classification Task: A Heuristic Approach to the GeoCLEF Query Parsing Task – Jochen Leidner, Linguit, UK Search Tasks: TALP at GeoCLEF 2007: Using Terrier with Geographical Knowledge Filtering – Daniel Ferrés, Universitat Politècnica de Catalunya, Barcelona, Spain The University of Lisbon at GeoCLEF 2007 – Nuno Cardoso, University of Lisbon, Portugal University of Groningen at GeoCLEF 2007 – Geoffrey Andogah, University of Groningen, The Netherlands GIR experiments with Forostar at GeoCLEF 2007 – Simon Overell, Imperial College London, UK Cheshire at GeoCLEF 2007: Retesting Text Retrieval Baselines – Ray R. Larson, University of California, Berkeley, USA Exploring Location Indicators for Geographic Information Retrieval – Johannes Leveling, University of Hagen, Germany
09:30 - 10:30	WebCLEF (room Strasbourg) Chair: Maarten de Rijke Track Overview – Maarten de Rijke, U. Amsterdam, The Netherlands Using Centrality to Rank Web Snippets – Valentin Jijkoun, U. Amsterdam, The Netherlands
10:30	Break
11:00 - 12:00	Breakout discussion sessions: ImageCLEF (room Brussels) GeoCLEF (room Strasbourg) QA@CLEF (room Maastricht)
12:00 - 13:00	Breakout discussion sessions: Adhoc plus Domain Specific (room Brussels) WebCLEF (room Strasbourg)
13:00	Lunch
	Concluding Session (room Brussels)
14:30	Invited Talk: Technology Evaluation for Multilingual and Multimodal Content Processing in Quaero – Edouard Geoffrois, DGA-CEP, France
15:00	Towards CLEF 2008 Chair: Martin Braschler Reports from Breakout Sessions
16:30	END OF WORKSHOP