Issues

• ModuleNotFoundError: No module named 'pip'

  Yale-LILY/SummEval#57 · Filter by author vinifrancioni opened on Jan 21, 2025

• human annotation file no longer avaliable

  Yale-LILY/SummEval#56 · Filter by author guihuzhang opened on Dec 15, 2024
  2

• Where do the references come from?

  Yale-LILY/SummEval#55 · Filter by author slvcsl opened on Nov 5, 2024

• How to match reference summary that was used by the expert to grade a given machine summary.

  Yale-LILY/SummEval#53 · Filter by author erastogi opened on Jun 8, 2024
  3

• summa_qa is not working

  Yale-LILY/SummEval#49 · Filter by author nilanjansircar80 opened on Nov 1, 2023

• ROUGE-WE relies on a download link that no longer works

  Yale-LILY/SummEval#48 · Filter by author alichte opened on Oct 24, 2023
  2

• Can not reproduce the rouge score.

  Yale-LILY/SummEval#44 · Filter by author SefaZeng opened on Jul 20, 2023
  1

• which 16 models to generate the human annotation results

  Yale-LILY/SummEval#43 · Filter by author dzf0023 opened on Jul 12, 2023

• Cost spent on human annotation

  Yale-LILY/SummEval#42 · Filter by author LiyingCheng95 opened on Jun 15, 2023

• Unittests fail

  Yale-LILY/SummEval#40 · Filter by author oriern opened on Oct 9, 2022
  2

• Unable to import the package

  Yale-LILY/SummEval#39 · Filter by author 29riyasaxena opened on Oct 2, 2022
  2

• Error running Meteor metric

  Yale-LILY/SummEval#38 · Filter by author JeetRoy97 opened on Jun 29, 2022

• SupertMetric: sentence_transformers module not found

  Yale-LILY/SummEval#36 · Filter by author ankitk2109 opened on Apr 5, 2022
  2

• Can't install the package

  Yale-LILY/SummEval#35 · Filter by author stefcon opened on Mar 21, 2022

• Says Illegal instruction for running command line argument

  Yale-LILY/SummEval#33 · Filter by author shankyemcee opened on Mar 3, 2022

• Errors after installing via pip and fixes

  Yale-LILY/SummEval#32 · Filter by author ankitk2109 opened on Feb 8, 2022

• ValueError: Found array with 0 sample(s) (shape=(0, 1024)) while a minimum of 1 is required by check_pairwise_arrays.

  Yale-LILY/SummEval#31 · Filter by author paluchasz opened on Jan 24, 2022

• Error during installation

  Yale-LILY/SummEval#28 · Filter by author darioTecchia opened on Dec 3, 2021
  3

• PR to add new metric results

  Yale-LILY/SummEval#27 · Filter by author PierreColombo opened on Nov 30, 2021
  1

• mover metric

  Yale-LILY/SummEval#25 · Filter by author martin6336 opened on Aug 24, 2021

• Unable to install

  Yale-LILY/SummEval#20 · Filter by author amanyakhyar opened on Jun 14, 2021
  2

• Unable to install dependency (wmd)

  Yale-LILY/SummEval#14 · Filter by author anjalibshah opened on Mar 9, 2021
  3

• Punctuation not consistent for M19 (Text Summarization with Pretrained Encoders)

  Yale-LILY/SummEval#7 · Filter by author artidoro opened on Sep 29, 2020
  3

• Is the BertScore metric used with idf weighted averaging or not

  Yale-LILY/SummEval#3 · Filter by author La-SilverLand opened on Aug 21, 2020
  4