Dimension Projection among Languages based on Pseudo-relevant Documents for Query Translation

05/25/2016
by   Javid Dadashkarimi, et al.
0

Using top-ranked documents in response to a query has been shown to be an effective approach to improve the quality of query translation in dictionary-based cross-language information retrieval. In this paper, we propose a new method for dictionary-based query translation based on dimension projection of embedded vectors from the pseudo-relevant documents in the source language to their equivalents in the target language. To this end, first we learn low-dimensional vectors of the words in the pseudo-relevant collections separately and then aim to find a query-dependent transformation matrix between the vectors of translation pairs appeared in the collections. At the next step, representation of each query term is projected to the target language and then, after using a softmax function, a query-dependent translation model is built. Finally, the model is used for query translation. Our experiments on four CLEF collections in French, Spanish, German, and Italian demonstrate that the proposed method outperforms a word embedding baseline based on bilingual shuffling and a further number of competitive baselines. The proposed method reaches up to 87 considerable improvements in verbose queries.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/04/2016

UsingWord Embeddings for Query Translation for Hindi to English Cross Language Information Retrieval

Cross-Language Information Retrieval (CLIR) has become an important prob...
research
07/16/2019

Quality-aware skill translation models for expert finding on StackOverflow

StackOverflow has become an emerging resource for talent recognition in ...
research
07/20/2017

Toward Incorporation of Relevant Documents in word2vec

Recent advances in neural word embedding provide significant benefit to ...
research
04/29/2023

Synthetic Cross-language Information Retrieval Training Data

A key stumbling block for neural cross-language information retrieval (C...
research
09/07/2021

Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval

Pretrained contextualized representations offer great success for many d...
research
03/10/2023

Naver Labs Europe (SPLADE) @ TREC NeuCLIR 2022

This paper describes our participation in the 2022 TREC NeuCLIR challeng...
research
10/23/2018

Bridging Semantic Gaps between Natural Languages and APIs with Word Embedding

Developers increasingly rely on text matching tools to analyze the relat...

Please sign up or login with your details

Forgot password? Click here to reset