← Back to benchmarks

LongMemEval Benchmark - Overall Performance

Overall Accuracy

91.40%

Correct Answers

457 / 500

Items

500

Accuracy by Category

knowledge-update

94.9%

74 / 78

multi-session

87.2%

116 / 133

single-session-assistant

96.4%

54 / 56

single-session-preference

80.0%

24 / 30

single-session-user

97.1%

68 / 70

temporal-reasoning

91.0%

121 / 133

Filters

Search by ID

Correctness

Category

Showing 500 of 500 items

🟢 e47becba

Accuracy

100.0%

Correct

1/1

🟢 118b2229

Accuracy

100.0%

Correct

1/1

🟢 51a45a95

Accuracy

100.0%

Correct

1/1

🟢 58bf7951

Accuracy

100.0%

Correct

1/1

🟢 1e043500

Accuracy

100.0%

Correct

1/1

🟢 c5e8278d

Accuracy

100.0%

Correct

1/1

🟢 6ade9755

Accuracy

100.0%

Correct

1/1

🟢 6f9b354f

Accuracy

100.0%

Correct

1/1

🟢 58ef2f1c

Accuracy

100.0%

Correct

1/1

🟢 f8c5f88b

Accuracy

100.0%

Correct

1/1

🟢 5d3d2817

Accuracy

100.0%

Correct

1/1

🟢 7527f7e2

Accuracy

100.0%

Correct

1/1

🟢 c960da58

Accuracy

100.0%

Correct

1/1

🔴 3b6f954b

Accuracy

0.0%

Correct

0/1

🟢 726462e0

Accuracy

100.0%

Correct

1/1

🟢 94f70d80

Accuracy

100.0%

Correct

1/1

🟢 66f24dbb

Accuracy

100.0%

Correct

1/1

🟢 ad7109d1

Accuracy

100.0%

Correct

1/1

🟢 af8d2e46

Accuracy

100.0%

Correct

1/1

🟢 dccbc061

Accuracy

100.0%

Correct

1/1

🟢 c8c3f81d

Accuracy

100.0%

Correct

1/1

🟢 8ebdbe50

Accuracy

100.0%

Correct

1/1

🟢 6b168ec8

Accuracy

100.0%

Correct

1/1

🟢 75499fd8

Accuracy

100.0%

Correct

1/1

🟢 21436231

Accuracy

100.0%

Correct

1/1

🟢 95bcc1c8

Accuracy

100.0%

Correct

1/1

🟢 0862e8bf

Accuracy

100.0%

Correct

1/1

🟢 853b0a1d

Accuracy

100.0%

Correct

1/1

🟢 a06e4cfe

Accuracy

100.0%

Correct

1/1

🟢 37d43f65

Accuracy

100.0%

Correct

1/1

🟢 b86304ba

Accuracy

100.0%

Correct

1/1

🟢 d52b4f67

Accuracy

100.0%

Correct

1/1

🟢 25e5aa4f

Accuracy

100.0%

Correct

1/1

🟢 caf9ead2

Accuracy

100.0%

Correct

1/1

🟢 8550ddae

Accuracy

100.0%

Correct

1/1

🟢 60d45044

Accuracy

100.0%

Correct

1/1

🟢 3f1e9474

Accuracy

100.0%

Correct

1/1

🟢 86b68151

Accuracy

100.0%

Correct

1/1

🟢 577d4d32

Accuracy

100.0%

Correct

1/1

🔴 ec81a493

Accuracy

0.0%

Correct

0/1

🟢 15745da0

Accuracy

100.0%

Correct

1/1

🟢 e01b8e2f

Accuracy

100.0%

Correct

1/1

🟢 bc8a6e93

Accuracy

100.0%

Correct

1/1

🟢 ccb36322

Accuracy

100.0%

Correct

1/1

🟢 001be529

Accuracy

100.0%

Correct

1/1

🟢 b320f3f8

Accuracy

100.0%

Correct

1/1

🟢 19b5f2b3

Accuracy

100.0%

Correct

1/1

🟢 4fd1909e

Accuracy

100.0%

Correct

1/1

🟢 545bd2b5

Accuracy

100.0%

Correct

1/1

🟢 8a137a7f

Accuracy

100.0%

Correct

1/1

🟢 76d63226

Accuracy

100.0%

Correct

1/1

🟢 86f00804

Accuracy

100.0%

Correct

1/1

🟢 8e9d538c

Accuracy

100.0%

Correct

1/1

🟢 311778f1

Accuracy

100.0%

Correct

1/1

🟢 c19f7a0b

Accuracy

100.0%

Correct

1/1

🟢 4100d0a0

Accuracy

100.0%

Correct

1/1

🟢 29f2956b

Accuracy

100.0%

Correct

1/1

🟢 1faac195

Accuracy

100.0%

Correct

1/1

🟢 faba32e5

Accuracy

100.0%

Correct

1/1

🟢 f4f1d8a4

Accuracy

100.0%

Correct

1/1

🟢 c14c00dd

Accuracy

100.0%

Correct

1/1

🟢 36580ce8

Accuracy

100.0%

Correct

1/1

🟢 3d86fd0a

Accuracy

100.0%

Correct

1/1

🟢 a82c026e

Accuracy

100.0%

Correct

1/1

🟢 0862e8bf_abs

Accuracy

100.0%

Correct

1/1

🟢 15745da0_abs

Accuracy

100.0%

Correct

1/1

🟢 bc8a6e93_abs

Accuracy

100.0%

Correct

1/1

🟢 19b5f2b3_abs

Accuracy

100.0%

Correct

1/1

🟢 29f2956b_abs

Accuracy

100.0%

Correct

1/1

🟢 f4f1d8a4_abs

Accuracy

100.0%

Correct

1/1

🔴 0a995998

Accuracy

0.0%

Correct

0/1

🔴 6d550036

Accuracy

0.0%

Correct

0/1

🟢 gpt4_59c863d7

Accuracy

100.0%

Correct

1/1

🟢 b5ef892d

Accuracy

100.0%

Correct

1/1

🟢 e831120c

Accuracy

100.0%

Correct

1/1

🔴 3a704032

Accuracy

0.0%

Correct

0/1

🟢 gpt4_d84a3211

Accuracy

100.0%

Correct

1/1

🟢 aae3761f

Accuracy

100.0%

Correct

1/1

🟢 gpt4_f2262a51

Accuracy

100.0%

Correct

1/1

🟢 dd2973ad

Accuracy

100.0%

Correct

1/1

🟢 c4a1ceb8

Accuracy

100.0%

Correct

1/1

🟢 gpt4_a56e767c

Accuracy

100.0%

Correct

1/1

🟢 6cb6f249

Accuracy

100.0%

Correct

1/1

🟢 46a3abf7

Accuracy

100.0%

Correct

1/1

🟢 36b9f61e

Accuracy

100.0%

Correct

1/1

🟢 28dc39ac

Accuracy

100.0%

Correct

1/1

🔴 gpt4_2f8be40d

Accuracy

0.0%

Correct

0/1

🟢 2e6d26dc

Accuracy

100.0%

Correct

1/1

🟢 gpt4_15e38248

Accuracy

100.0%

Correct

1/1

🔴 88432d0a

Accuracy

0.0%

Correct

0/1

🟢 80ec1f4f

Accuracy

100.0%

Correct

1/1

🟢 d23cf73b

Accuracy

100.0%

Correct

1/1

🔴 gpt4_7fce9456

Accuracy

0.0%

Correct

0/1

🟢 d682f1a2

Accuracy

100.0%

Correct

1/1

🔴 7024f17c

Accuracy

0.0%

Correct

0/1

🟢 gpt4_5501fe77

Accuracy

100.0%

Correct

1/1

🔴 gpt4_2ba83207

Accuracy

0.0%

Correct

0/1

🔴 2318644b

Accuracy

0.0%

Correct

0/1

🟢 2ce6a0f2

Accuracy

100.0%

Correct

1/1

🟢 gpt4_d12ceb0e

Accuracy

100.0%

Correct

1/1

🟢 00ca467f

Accuracy

100.0%

Correct

1/1

🟢 b3c15d39

Accuracy

100.0%

Correct

1/1

🟢 gpt4_31ff4165

Accuracy

100.0%

Correct

1/1

🟢 eeda8a6d

Accuracy

100.0%

Correct

1/1

🟢 2788b940

Accuracy

100.0%

Correct

1/1

🟢 60bf93ed

Accuracy

100.0%

Correct

1/1

🔴 9d25d4e0

Accuracy

0.0%

Correct

0/1

🟢 129d1232

Accuracy

100.0%

Correct

1/1

🟢 60472f9c

Accuracy

100.0%

Correct

1/1

🟢 gpt4_194be4b3

Accuracy

100.0%

Correct

1/1

🟢 a9f6b44c

Accuracy

100.0%

Correct

1/1

🟢 d851d5ba

Accuracy

100.0%

Correct

1/1

🟢 5a7937c8

Accuracy

100.0%

Correct

1/1

🔴 gpt4_ab202e7f

Accuracy

0.0%

Correct

0/1

🔴 gpt4_e05b82a6

Accuracy

0.0%

Correct

0/1

🟢 gpt4_731e37d7

Accuracy

100.0%

Correct

1/1

🟢 edced276

Accuracy

100.0%

Correct

1/1

🟢 10d9b85a

Accuracy

100.0%

Correct

1/1

🟢 e3038f8c

Accuracy

100.0%

Correct

1/1

🟢 2b8f3739

Accuracy

100.0%

Correct

1/1

🟢 1a8a66a6

Accuracy

100.0%

Correct

1/1

🟢 c2ac3c61

Accuracy

100.0%

Correct

1/1

🟢 bf659f65

Accuracy

100.0%

Correct

1/1

🟢 gpt4_372c3eed

Accuracy

100.0%

Correct

1/1

🟢 gpt4_2f91af09

Accuracy

100.0%

Correct

1/1

🟢 81507db6

Accuracy

100.0%

Correct

1/1

🟢 88432d0a_abs

Accuracy

100.0%

Correct

1/1

🟢 80ec1f4f_abs

Accuracy

100.0%

Correct

1/1

🟢 eeda8a6d_abs

Accuracy

100.0%

Correct

1/1

🟢 60bf93ed_abs

Accuracy

100.0%

Correct

1/1

🟢 edced276_abs

Accuracy

100.0%

Correct

1/1

🟢 gpt4_372c3eed_abs

Accuracy

100.0%

Correct

1/1

🟢 8a2466db

Accuracy

100.0%

Correct

1/1

🟢 06878be2

Accuracy

100.0%

Correct

1/1

🔴 75832dbd

Accuracy

0.0%

Correct

0/1

🔴 0edc2aef

Accuracy

0.0%

Correct

0/1

🟢 35a27287

Accuracy

100.0%

Correct

1/1

🔴 32260d93

Accuracy

0.0%

Correct

0/1

🟢 195a1a1b

Accuracy

100.0%

Correct

1/1

🟢 afdc33df

Accuracy

100.0%

Correct

1/1

🟢 caf03d32

Accuracy

100.0%

Correct

1/1

🟢 54026fce

Accuracy

100.0%

Correct

1/1

🟢 06f04340

Accuracy

100.0%

Correct

1/1

🟢 6b7dfb22

Accuracy

100.0%

Correct

1/1

🟢 1a1907b4

Accuracy

100.0%

Correct

1/1

🟢 09d032c9

Accuracy

100.0%

Correct

1/1

🟢 38146c39

Accuracy

100.0%

Correct

1/1

🟢 d24813b1

Accuracy

100.0%

Correct

1/1

🟢 57f827a0

Accuracy

100.0%

Correct

1/1

🟢 95228167

Accuracy

100.0%

Correct

1/1

🟢 505af2f5

Accuracy

100.0%

Correct

1/1

🟢 75f70248

Accuracy

100.0%

Correct

1/1

🟢 d6233ab6

Accuracy

100.0%

Correct

1/1

🟢 1da05512

Accuracy

100.0%

Correct

1/1

🔴 fca70973

Accuracy

0.0%

Correct

0/1

🔴 b6025781

Accuracy

0.0%

Correct

0/1

🟢 a89d7624

Accuracy

100.0%

Correct

1/1

🔴 b0479f84

Accuracy

0.0%

Correct

0/1

🟢 1d4e3b97

Accuracy

100.0%

Correct

1/1

🟢 07b6f563

Accuracy

100.0%

Correct

1/1

🟢 1c0ddc50

Accuracy

100.0%

Correct

1/1

🟢 0a34ad58

Accuracy

100.0%

Correct

1/1

🟢 d3ab962e

Accuracy

100.0%

Correct

1/1

🟢 2311e44b

Accuracy

100.0%

Correct

1/1

🟢 cc06de0d

Accuracy

100.0%

Correct

1/1

🟢 a11281a2

Accuracy

100.0%

Correct

1/1

🟢 4f54b7c9

Accuracy

100.0%

Correct

1/1

🟢 85fa3a3f

Accuracy

100.0%

Correct

1/1

🟢 9aaed6a3

Accuracy

100.0%

Correct

1/1

🟢 1f2b8d4f

Accuracy

100.0%

Correct

1/1

🟢 e6041065

Accuracy

100.0%

Correct

1/1

🔴 51c32626

Accuracy

0.0%

Correct

0/1

🟢 d905b33f

Accuracy

100.0%

Correct

1/1

🟢 7405e8b1

Accuracy

100.0%

Correct

1/1

🟢 f35224e0

Accuracy

100.0%

Correct

1/1

🟢 6456829e

Accuracy

100.0%

Correct

1/1

🟢 a4996e51

Accuracy

100.0%

Correct

1/1

🟢 3c1045c8

Accuracy

100.0%

Correct

1/1

🟢 60036106

Accuracy

100.0%

Correct

1/1

🟢 681a1674

Accuracy

100.0%

Correct

1/1

🟢 e25c3b8d

Accuracy

100.0%

Correct

1/1

🟢 4adc0475

Accuracy

100.0%

Correct

1/1

🟢 4bc144e2

Accuracy

100.0%

Correct

1/1

🟢 ef66a6e5

Accuracy

100.0%

Correct

1/1

🟢 5025383b

Accuracy

100.0%

Correct

1/1

🟢 a1cc6108

Accuracy

100.0%

Correct

1/1

🟢 9ee3ecd6

Accuracy

100.0%

Correct

1/1

🟢 3fdac837

Accuracy

100.0%

Correct

1/1

🟢 91b15a6e

Accuracy

100.0%

Correct

1/1

🟢 27016adc

Accuracy

100.0%

Correct

1/1

🟢 720133ac

Accuracy

100.0%

Correct

1/1

🟢 77eafa52

Accuracy

100.0%

Correct

1/1

🟢 8979f9ec

Accuracy

100.0%

Correct

1/1

🟢 0100672e

Accuracy

100.0%

Correct

1/1

🟢 a96c20ee

Accuracy

100.0%

Correct

1/1

🟢 92a0aa75

Accuracy

100.0%

Correct

1/1

🟢 3fe836c9

Accuracy

100.0%

Correct

1/1

🟢 1c549ce4

Accuracy

100.0%

Correct

1/1

🟢 6c49646a

Accuracy

100.0%

Correct

1/1

🟢 1192316e

Accuracy

100.0%

Correct

1/1

🟢 0ea62687

Accuracy

100.0%

Correct

1/1

🟢 67e0d0f2

Accuracy

100.0%

Correct

1/1

🟢 bb7c3b45

Accuracy

100.0%

Correct

1/1

🟢 ba358f49

Accuracy

100.0%

Correct

1/1

🟢 61f8c8f8

Accuracy

100.0%

Correct

1/1

🟢 60159905

Accuracy

100.0%

Correct

1/1

🟢 ef9cf60a

Accuracy

100.0%

Correct

1/1

🟢 73d42213

Accuracy

100.0%

Correct

1/1

🟢 bc149d6b

Accuracy

100.0%

Correct

1/1

🟢 099778bb

Accuracy

100.0%

Correct

1/1

🔴 09ba9854

Accuracy

0.0%

Correct

0/1

🟢 d6062bb9

Accuracy

100.0%

Correct

1/1

🟢 157a136e

Accuracy

100.0%

Correct

1/1

🟢 c18a7dc8

Accuracy

100.0%

Correct

1/1

🟢 a3332713

Accuracy

100.0%

Correct

1/1

🟢 55241a1f

Accuracy

100.0%

Correct

1/1

🟢 a08a253f

Accuracy

100.0%

Correct

1/1

🟢 f0e564bc

Accuracy

100.0%

Correct

1/1

🟢 078150f1

Accuracy

100.0%

Correct

1/1

🟢 8cf4d046

Accuracy

100.0%

Correct

1/1

🟢 a346bb18

Accuracy

100.0%

Correct

1/1

🔴 37f165cf

Accuracy

0.0%

Correct

0/1

🟢 8e91e7d9

Accuracy

100.0%

Correct

1/1

🟢 87f22b4a

Accuracy

100.0%

Correct

1/1

🟢 e56a43b9

Accuracy

100.0%

Correct

1/1

🟢 efc3f7c2

Accuracy

100.0%

Correct

1/1

🟢 21d02d0d

Accuracy

100.0%

Correct

1/1

🟢 2311e44b_abs

Accuracy

100.0%

Correct

1/1

🟢 6456829e_abs

Accuracy

100.0%

Correct

1/1

🟢 e5ba910e_abs

Accuracy

100.0%

Correct

1/1

🔴 a96c20ee_abs

Accuracy

0.0%

Correct

0/1

🟢 ba358f49_abs

Accuracy

100.0%

Correct

1/1

🔴 09ba9854_abs

Accuracy

0.0%

Correct

0/1

🟢 gpt4_59149c77

Accuracy

100.0%

Correct

1/1

🟢 gpt4_f49edff3

Accuracy

100.0%

Correct

1/1

🟢 71017276

Accuracy

100.0%

Correct

1/1

🟢 b46e15ed

Accuracy

100.0%

Correct

1/1

🟢 gpt4_fa19884c

Accuracy

100.0%

Correct

1/1

🟢 0bc8ad92

Accuracy

100.0%

Correct

1/1

🟢 af082822

Accuracy

100.0%

Correct

1/1

🟢 gpt4_4929293a

Accuracy

100.0%

Correct

1/1

🟢 gpt4_b5700ca9

Accuracy

100.0%

Correct

1/1

🔴 9a707b81

Accuracy

0.0%

Correct

0/1

🟢 gpt4_1d4ab0c9

Accuracy

100.0%

Correct

1/1

🟢 gpt4_e072b769

Accuracy

100.0%

Correct

1/1

🟢 0db4c65d

Accuracy

100.0%

Correct

1/1

🟢 gpt4_1d80365e

Accuracy

100.0%

Correct

1/1

🔴 gpt4_7f6b06db

Accuracy

0.0%

Correct

0/1

🟢 gpt4_6dc9b45b

Accuracy

100.0%

Correct

1/1

🟢 gpt4_8279ba02

Accuracy

100.0%

Correct

1/1

🟢 gpt4_18c2b244

Accuracy

100.0%

Correct

1/1

🟢 gpt4_a1b77f9c

Accuracy

100.0%

Correct

1/1

🟢 gpt4_1916e0ea

Accuracy

100.0%

Correct

1/1

🟢 gpt4_7a0daae1

Accuracy

100.0%

Correct

1/1

🟢 gpt4_468eb063

Accuracy

100.0%

Correct

1/1

🔴 gpt4_7abb270c

Accuracy

0.0%

Correct

0/1

🟢 gpt4_1e4a8aeb

Accuracy

100.0%

Correct

1/1

🟢 gpt4_4fc4f797

Accuracy

100.0%

Correct

1/1

🔴 4dfccbf7

Accuracy

0.0%

Correct

0/1

🟢 gpt4_61e13b3c

Accuracy

100.0%

Correct

1/1

🟢 gpt4_45189cb4

Accuracy

100.0%

Correct

1/1

🟢 2ebe6c90

Accuracy

100.0%

Correct

1/1

🔴 gpt4_e061b84f

Accuracy

0.0%

Correct

0/1

🔴 370a8ff4

Accuracy

0.0%

Correct

0/1

🟢 gpt4_d6585ce8

Accuracy

100.0%

Correct

1/1

🟢 gpt4_4ef30696

Accuracy

100.0%

Correct

1/1

🟢 gpt4_ec93e27f

Accuracy

100.0%

Correct

1/1

🟢 6e984301

Accuracy

100.0%

Correct

1/1

🟢 8077ef71

Accuracy

100.0%

Correct

1/1

🟢 gpt4_f420262c

Accuracy

100.0%

Correct

1/1

🟢 gpt4_8e165409

Accuracy

100.0%

Correct

1/1

🟢 gpt4_74aed68e

Accuracy

100.0%

Correct

1/1

🟢 bcbe585f

Accuracy

100.0%

Correct

1/1

🟢 gpt4_21adecb5

Accuracy

100.0%

Correct

1/1

🟢 5e1b23de

Accuracy

100.0%

Correct

1/1

🟢 gpt4_98f46fc6

Accuracy

100.0%

Correct

1/1

🟢 gpt4_af6db32f

Accuracy

100.0%

Correct

1/1

🟢 eac54adc

Accuracy

100.0%

Correct

1/1

🟢 gpt4_7ddcf75f

Accuracy

100.0%

Correct

1/1

🟢 gpt4_a2d1d1f6

Accuracy

100.0%

Correct

1/1

🔴 gpt4_85da3956

Accuracy

0.0%

Correct

0/1

🟢 gpt4_b0863698

Accuracy

100.0%

Correct

1/1

🟢 gpt4_68e94287

Accuracy

100.0%

Correct

1/1

🟢 gpt4_e414231e

Accuracy

100.0%

Correct

1/1

🟢 gpt4_7ca326fa

Accuracy

100.0%

Correct

1/1

🟢 gpt4_7bc6cf22

Accuracy

100.0%

Correct

1/1

🟢 2ebe6c92

Accuracy

100.0%

Correct

1/1

🟢 gpt4_e061b84g

Accuracy

100.0%

Correct

1/1

🟢 71017277

Accuracy

100.0%

Correct

1/1

🟢 b46e15ee

Accuracy

100.0%

Correct

1/1

🔴 gpt4_d6585ce9

Accuracy

0.0%

Correct

0/1

🟢 gpt4_1e4a8aec

Accuracy

100.0%

Correct

1/1

🟢 gpt4_f420262d

Accuracy

100.0%

Correct

1/1

🟢 gpt4_59149c78

Accuracy

100.0%

Correct

1/1

🟢 gpt4_e414231f

Accuracy

100.0%

Correct

1/1

🟢 gpt4_4929293b

Accuracy

100.0%

Correct

1/1

🟢 gpt4_468eb064

Accuracy

100.0%

Correct

1/1

🟢 gpt4_fa19884d

Accuracy

100.0%

Correct

1/1

🟢 9a707b82

Accuracy

100.0%

Correct

1/1

🔴 eac54add

Accuracy

0.0%

Correct

0/1

🟢 4dfccbf8

Accuracy

100.0%

Correct

1/1

🟢 0bc8ad93

Accuracy

100.0%

Correct

1/1

🟢 6e984302

Accuracy

100.0%

Correct

1/1

🟢 gpt4_8279ba03

Accuracy

100.0%

Correct

1/1

🟢 gpt4_b5700ca0

Accuracy

100.0%

Correct

1/1

🟢 gpt4_68e94288

Accuracy

100.0%

Correct

1/1

🟢 gpt4_2655b836

Accuracy

100.0%

Correct

1/1

🟢 gpt4_2487a7cb

Accuracy

100.0%

Correct

1/1

🟢 gpt4_76048e76

Accuracy

100.0%

Correct

1/1

🟢 gpt4_2312f94c

Accuracy

100.0%

Correct

1/1

🟢 0bb5a684

Accuracy

100.0%

Correct

1/1

🟢 08f4fc43

Accuracy

100.0%

Correct

1/1

🟢 2c63a862

Accuracy

100.0%

Correct

1/1

🟢 gpt4_385a5000

Accuracy

100.0%

Correct

1/1

🟢 2a1811e2

Accuracy

100.0%

Correct

1/1

🟢 bbf86515

Accuracy

100.0%

Correct

1/1

🟢 gpt4_5dcc0aab

Accuracy

100.0%

Correct

1/1

🟢 gpt4_0b2f1d21

Accuracy

100.0%

Correct

1/1

🟢 f0853d11

Accuracy

100.0%

Correct

1/1

🟢 gpt4_6ed717ea

Accuracy

100.0%

Correct

1/1

🟢 gpt4_70e84552

Accuracy

100.0%

Correct

1/1

🟢 a3838d2b

Accuracy

100.0%

Correct

1/1

🟢 gpt4_93159ced

Accuracy

100.0%

Correct

1/1

🟢 gpt4_2d58bcd6

Accuracy

100.0%

Correct

1/1

🟢 gpt4_65aabe59

Accuracy

100.0%

Correct

1/1

🟢 982b5123

Accuracy

100.0%

Correct

1/1

🟢 b9cfe692

Accuracy

100.0%

Correct

1/1

🟢 gpt4_4edbafa2

Accuracy

100.0%

Correct

1/1

🟢 c8090214

Accuracy

100.0%

Correct

1/1

🟢 gpt4_483dd43c

Accuracy

100.0%

Correct

1/1

🟢 e4e14d04

Accuracy

100.0%

Correct

1/1

🟢 c9f37c46

Accuracy

100.0%

Correct

1/1

🟢 gpt4_2c50253f

Accuracy

100.0%

Correct

1/1

🟢 dcfa8644

Accuracy

100.0%

Correct

1/1

🟢 gpt4_b4a80587

Accuracy

100.0%

Correct

1/1

🟢 gpt4_9a159967

Accuracy

100.0%

Correct

1/1

🟢 cc6d1ec1

Accuracy

100.0%

Correct

1/1

🟢 gpt4_8c8961ae

Accuracy

100.0%

Correct

1/1

🟢 gpt4_d9af6064

Accuracy

100.0%

Correct

1/1

🟢 gpt4_7de946e7

Accuracy

100.0%

Correct

1/1

🟢 d01c6aa8

Accuracy

100.0%

Correct

1/1

🟢 993da5e2

Accuracy

100.0%

Correct

1/1

🟢 a3045048

Accuracy

100.0%

Correct

1/1

🟢 gpt4_d31cdae3

Accuracy

100.0%

Correct

1/1

🟢 gpt4_cd90e484

Accuracy

100.0%

Correct

1/1

🟢 gpt4_88806d6e

Accuracy

100.0%

Correct

1/1

🟢 gpt4_4cd9eba1

Accuracy

100.0%

Correct

1/1

🟢 gpt4_93f6379c

Accuracy

100.0%

Correct

1/1

🟢 b29f3365

Accuracy

100.0%

Correct

1/1

🟢 gpt4_2f56ae70

Accuracy

100.0%

Correct

1/1

🟢 6613b389

Accuracy

100.0%

Correct

1/1

🟢 gpt4_78cf46a3

Accuracy

100.0%

Correct

1/1

🟢 gpt4_0a05b494

Accuracy

100.0%

Correct

1/1

🟢 gpt4_1a1dc16d

Accuracy

100.0%

Correct

1/1

🟢 gpt4_2f584639

Accuracy

100.0%

Correct

1/1

🟢 gpt4_213fd887

Accuracy

100.0%

Correct

1/1

🟢 gpt4_5438fa52

Accuracy

100.0%

Correct

1/1

🟢 gpt4_c27434e8

Accuracy

100.0%

Correct

1/1

🔴 gpt4_fe651585

Accuracy

0.0%

Correct

0/1

🟢 8c18457d

Accuracy

100.0%

Correct

1/1

🔴 gpt4_70e84552_abs

Accuracy

0.0%

Correct

0/1

🔴 gpt4_93159ced_abs

Accuracy

0.0%

Correct

0/1

🟢 982b5123_abs

Accuracy

100.0%

Correct

1/1

🟢 c8090214_abs

Accuracy

100.0%

Correct

1/1

🟢 gpt4_c27434e8_abs

Accuracy

100.0%

Correct

1/1

🟢 gpt4_fe651585_abs

Accuracy

100.0%

Correct

1/1

🟢 6a1eabeb

Accuracy

100.0%

Correct

1/1

🟢 6aeb4375

Accuracy

100.0%

Correct

1/1

🟢 830ce83f

Accuracy

100.0%

Correct

1/1

🟢 852ce960

Accuracy

100.0%

Correct

1/1

🟢 945e3d21

Accuracy

100.0%

Correct

1/1

🟢 d7c942c3

Accuracy

100.0%

Correct

1/1

🟢 71315a70

Accuracy

100.0%

Correct

1/1

🟢 89941a93

Accuracy

100.0%

Correct

1/1

🟢 ce6d2d27

Accuracy

100.0%

Correct

1/1

🟢 9ea5eabc

Accuracy

100.0%

Correct

1/1

🟢 07741c44

Accuracy

100.0%

Correct

1/1

🟢 a1eacc2a

Accuracy

100.0%

Correct

1/1

🟢 184da446

Accuracy

100.0%

Correct

1/1

🟢 031748ae

Accuracy

100.0%

Correct

1/1

🟢 4d6b87c8

Accuracy

100.0%

Correct

1/1

🟢 0f05491a

Accuracy

100.0%

Correct

1/1

🟢 08e075c7

Accuracy

100.0%

Correct

1/1

🟢 f9e8c073

Accuracy

100.0%

Correct

1/1

🟢 41698283

Accuracy

100.0%

Correct

1/1

🟢 2698e78f

Accuracy

100.0%

Correct

1/1

🟢 b6019101

Accuracy

100.0%

Correct

1/1

🟢 45dc21b6

Accuracy

100.0%

Correct

1/1

🟢 5a4f22c0

Accuracy

100.0%

Correct

1/1

🟢 6071bd76

Accuracy

100.0%

Correct

1/1

🟢 e493bb7c

Accuracy

100.0%

Correct

1/1

🟢 618f13b2

Accuracy

100.0%

Correct

1/1

🟢 72e3ee87

Accuracy

100.0%

Correct

1/1

🟢 c4ea545c

Accuracy

100.0%

Correct

1/1

🟢 01493427

Accuracy

100.0%

Correct

1/1

🟢 6a27ffc2

Accuracy

100.0%

Correct

1/1

🟢 2133c1b5

Accuracy

100.0%

Correct

1/1

🟢 18bc8abd

Accuracy

100.0%

Correct

1/1

🟢 db467c8c

Accuracy

100.0%

Correct

1/1

🟢 7a87bd0c

Accuracy

100.0%

Correct

1/1

🟢 e61a7584

Accuracy

100.0%

Correct

1/1

🟢 1cea1afa

Accuracy

100.0%

Correct

1/1

🟢 ed4ddc30

Accuracy

100.0%

Correct

1/1

🟢 8fb83627

Accuracy

100.0%

Correct

1/1

🟢 b01defab

Accuracy

100.0%

Correct

1/1

🟢 22d2cb42

Accuracy

100.0%

Correct

1/1

🟢 0e4e4c46

Accuracy

100.0%

Correct

1/1

🟢 4b24c848

Accuracy

100.0%

Correct

1/1

🟢 7e974930

Accuracy

100.0%

Correct

1/1

🟢 603deb26

Accuracy

100.0%

Correct

1/1

🟢 59524333

Accuracy

100.0%

Correct

1/1

🟢 5831f84d

Accuracy

100.0%

Correct

1/1

🟢 eace081b

Accuracy

100.0%

Correct

1/1

🟢 affe2881

Accuracy

100.0%

Correct

1/1

🟢 50635ada

Accuracy

100.0%

Correct

1/1

🟢 e66b632c

Accuracy

100.0%

Correct

1/1

🟢 0ddfec37

Accuracy

100.0%

Correct

1/1

🟢 f685340e

Accuracy

100.0%

Correct

1/1

🟢 cc5ded98

Accuracy

100.0%

Correct

1/1

🟢 dfde3500

Accuracy

100.0%

Correct

1/1

🟢 69fee5aa

Accuracy

100.0%

Correct

1/1

🟢 7401057b

Accuracy

100.0%

Correct

1/1

🟢 cf22b7bf

Accuracy

100.0%

Correct

1/1

🔴 a2f3aa27

Accuracy

0.0%

Correct

0/1

🟢 c7dc5443

Accuracy

100.0%

Correct

1/1

🟢 06db6396

Accuracy

100.0%

Correct

1/1

🟢 3ba21379

Accuracy

100.0%

Correct

1/1

🟢 9bbe84a2

Accuracy

100.0%

Correct

1/1

🟢 10e09553

Accuracy

100.0%

Correct

1/1

🟢 dad224aa

Accuracy

100.0%

Correct

1/1

🟢 ba61f0b9

Accuracy

100.0%

Correct

1/1

🟢 42ec0761

Accuracy

100.0%

Correct

1/1

🟢 5c40ec5b

Accuracy

100.0%

Correct

1/1

🟢 c6853660

Accuracy

100.0%

Correct

1/1

🟢 26bdc477

Accuracy

100.0%

Correct

1/1

🟢 0977f2af

Accuracy

100.0%

Correct

1/1

🟢 6aeb4375_abs

Accuracy

100.0%

Correct

1/1

🔴 031748ae_abs

Accuracy

0.0%

Correct

0/1

🟢 2698e78f_abs

Accuracy

100.0%

Correct

1/1

🔴 2133c1b5_abs

Accuracy

0.0%

Correct

0/1

🟢 0ddfec37_abs

Accuracy

100.0%

Correct

1/1

🟢 f685340e_abs

Accuracy

100.0%

Correct

1/1

🟢 89941a94

Accuracy

100.0%

Correct

1/1

🔴 07741c45

Accuracy

0.0%

Correct

0/1

🟢 7161e7e2

Accuracy

100.0%

Correct

1/1

🟢 c4f10528

Accuracy

100.0%

Correct

1/1

🔴 89527b6b

Accuracy

0.0%

Correct

0/1

🟢 e9327a54

Accuracy

100.0%

Correct

1/1

🟢 4c36ccef

Accuracy

100.0%

Correct

1/1

🟢 6ae235be

Accuracy

100.0%

Correct

1/1

🟢 7e00a6cb

Accuracy

100.0%

Correct

1/1

🟢 1903aded

Accuracy

100.0%

Correct

1/1

🟢 ceb54acb

Accuracy

100.0%

Correct

1/1

🟢 f523d9fe

Accuracy

100.0%

Correct

1/1

🟢 0e5e2d1a

Accuracy

100.0%

Correct

1/1

🟢 fea54f57

Accuracy

100.0%

Correct

1/1

🟢 cc539528

Accuracy

100.0%

Correct

1/1

🟢 dc439ea3

Accuracy

100.0%

Correct

1/1

🟢 18dcd5a5

Accuracy

100.0%

Correct

1/1

🟢 488d3006

Accuracy

100.0%

Correct

1/1

🔴 58470ed2

Accuracy

0.0%

Correct

0/1

🟢 8cf51dda

Accuracy

100.0%

Correct

1/1

🟢 1d4da289

Accuracy

100.0%

Correct

1/1

🟢 8464fc84

Accuracy

100.0%

Correct

1/1

🟢 8aef76bc

Accuracy

100.0%

Correct

1/1

🟢 71a3fd6b

Accuracy

100.0%

Correct

1/1

🟢 2bf43736

Accuracy

100.0%

Correct

1/1

🟢 70b3e69b

Accuracy

100.0%

Correct

1/1

🟢 8752c811

Accuracy

100.0%

Correct

1/1

🟢 3249768e

Accuracy

100.0%

Correct

1/1

🟢 1b9b7252

Accuracy

100.0%

Correct

1/1

🟢 1568498a

Accuracy

100.0%

Correct

1/1

🟢 6222b6eb

Accuracy

100.0%

Correct

1/1

🟢 e8a79c70

Accuracy

100.0%

Correct

1/1

🟢 d596882b

Accuracy

100.0%

Correct

1/1

🟢 e3fc4d6e

Accuracy

100.0%

Correct

1/1

🟢 51b23612

Accuracy

100.0%

Correct

1/1

🟢 3e321797

Accuracy

100.0%

Correct

1/1

🟢 e982271f

Accuracy

100.0%

Correct

1/1

🟢 352ab8bd

Accuracy

100.0%

Correct

1/1

🟢 fca762bc

Accuracy

100.0%

Correct

1/1

🟢 7a8d0b71

Accuracy

100.0%

Correct

1/1

🟢 a40e080f

Accuracy

100.0%

Correct

1/1

🟢 8b9d4367

Accuracy

100.0%

Correct

1/1

🟢 5809eb10

Accuracy

100.0%

Correct

1/1

🟢 41275add

Accuracy

100.0%

Correct

1/1

🟢 4388e9dd

Accuracy

100.0%

Correct

1/1

🟢 4baee567

Accuracy

100.0%

Correct

1/1

🟢 561fabcd

Accuracy

100.0%

Correct

1/1

🟢 b759caee

Accuracy

100.0%

Correct

1/1

🟢 ac031881

Accuracy

100.0%

Correct

1/1

🟢 28bcfaac

Accuracy

100.0%

Correct

1/1

🟢 16c90bf4

Accuracy

100.0%

Correct

1/1

🟢 c8f1aeed

Accuracy

100.0%

Correct

1/1

🟢 eaca4986

Accuracy

100.0%

Correct

1/1

🟢 c7cf7dfd

Accuracy

100.0%

Correct

1/1

🟢 e48988bc

Accuracy

100.0%

Correct

1/1

🟢 1de5cff2

Accuracy

100.0%

Correct

1/1

🟢 65240037

Accuracy

100.0%

Correct

1/1

🟢 778164c6

Accuracy

100.0%

Correct

1/1