A parallel corpus for machine translation from the proceedings of the European Parliament
The Europarl dataset contains text corpora from 21 languages from the proceedings of the European Parliament between 1996 and 2011. The English-French corpus contains 2 million training and 45,000 test sentences. Training examples are taken from the originally distributed parallel corpus, while test examples are extracted from the Q4/2000 portion of the data, following the publisher's suggestion. The "ContentElements" field contains four options: "TrainingData", "TestData", "TrainingDataset" and "TestDataset". "TrainingData" and "TestData" are structured as associations. "TrainingDataset" and "TestDataset" are structured as datasets. Duplicate examples have been removed from the test set.
Retrieve the resource:
Obtain the first three training examples:
Obtain the first three test examples:
Obtain ten random pairs from the training set in Dataset form:
Obtain ten random pairs from the test set in Dataset form:
Obtain a character-level histogram of test example lengths:
Obtain a word-level histogram of test example lengths:
"Europarl English-French Machine Translation Dataset V7"
from the Wolfram Data Repository
Reproduction is authorized, provided that the source is acknowledged
Data Resource History