research
∙
08/28/2023
Identifying and Mitigating the Security Risks of Generative AI
Every major technical invention resurfaces the dual-use dilemma – the ne...
share
research
∙
06/20/2023
DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models
Generative Pre-trained Transformer (GPT) models have exhibited exciting ...
research
∙
04/06/2023
Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmark
Artificial agents have traditionally been trained to maximize reward, wh...
research
∙
01/02/2023
MAUD: An Expert-Annotated Legal NLP Dataset for Merger Agreement Understanding
Reading comprehension of legal text can be a particularly challenging ta...
research
∙
10/13/2022
OpenOOD: Benchmarking Generalized Out-of-Distribution Detection
Out-of-distribution (OOD) detection is vital to safety-critical machine ...
research
∙
06/13/2022
X-Risk Analysis for AI Research
Artificial intelligence (AI) has the potential to greatly improve societ...
research
∙
03/10/2021
CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review
Many specialized domains remain untouched by deep learning, as large lab...
research
∙
03/05/2021
Measuring Mathematical Problem Solving With the MATH Dataset
Many intellectual endeavors require mathematical problem solving, but th...
research
∙
06/29/2020
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization
We introduce three new robustness benchmarks consisting of naturally occ...
research
∙
12/11/2018
Deep Anomaly Detection with Outlier Exposure
It is important to detect and handle anomalous inputs when deploying mac...
research
∙
07/04/2018
