Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmark

10/02/2021
by   Joel Niklaus, et al.
9

In many jurisdictions, the excessive workload of courts leads to high delays. Suitable predictive AI models can assist legal professionals in their work, and thus enhance and speed up the process. So far, Legal Judgment Prediction (LJP) datasets have been released in English, French, and Chinese. We publicly release a multilingual (German, French, and Italian), diachronic (2000-2020) corpus of 85K cases from the Federal Supreme Court of Switzerland (FSCS). We evaluate state-of-the-art BERT-based methods including two variants of BERT that overcome the BERT input (text) length limitation (up to 512 tokens). Hierarchical BERT has the best performance (approx. 68-70 German and French). Furthermore, we study how several factors (canton of origin, year of publication, text length, legal area) affect performance. We release both the benchmark dataset and our code to accelerate future research and ensure reproducibility.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2019

Neural Legal Judgment Prediction in English

Legal judgment prediction is the task of automatically predicting the ou...
research
06/03/2023

MultiLegalPile: A 689GB Multilingual Legal Corpus

Large, high-quality datasets are crucial for training Large Language Mod...
research
11/01/2022

ClassActionPrediction: A Challenging Benchmark for Legal Judgment Prediction of Class Action Cases in the US

The research field of Legal Natural Language Processing (NLP) has been v...
research
11/15/2022

DeepParliament: A Legal domain Benchmark Dataset for Parliament Bills Prediction

This paper introduces DeepParliament, a legal domain Benchmark Dataset t...
research
05/12/2023

LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development

In this work, we conduct a detailed analysis on the performance of legal...
research
09/15/2023

Resolving Legalese: A Multilingual Exploration of Negation Scope Resolution in Legal Documents

Resolving the scope of a negation within a sentence is a challenging NLP...
research
10/25/2022

Deconfounding Legal Judgment Prediction for European Court of Human Rights Cases Towards Better Alignment with Experts

This work demonstrates that Legal Judgement Prediction systems without e...

Please sign up or login with your details

Forgot password? Click here to reset