Suite sessions_ARCv2_eval — GEOMETOR SEER Navigator

Sessions	22
Tasks	686
Train	40 (5.8%)
Test	8 (1.2%)

Duration	130:50:19
Avg	05:56:49
Errors	569
Best Score	0.00

Tokens	38,724,924
In Tokens	26,471,829
Out Tokens	10,736,536
Retries	925

Session	Description	Tasks	Duration	Avg	Err	Train	Train%	Test	Test%	Score	Tokens	Retries
25.085.0644	ARCv2 EVAL	120	17:27:06	00:08:43	99	7	5.8%	3	2.5%	0.00	5,065,159	0
25.087.0718	ARCv1 EVAL sorted 100:200	1	11:33:14	11:33:14	1	0	0.0%	0	0.0%	118.66	44,672	10
25.088.1031	ARCv1 EVAL sorted 300:400	5	16:23:12	03:16:38	2	0	0.0%	0	0.0%	47.62	380,652	28
25.089.0757	unsolved sorted 000:100	3	06:40:20	02:13:26	3	0	0.0%	0	0.0%	84.00	62,993	0
25.089.0841	unsolved sorted 100:200	6	07:03:11	01:10:31	4	2	33.3%	0	0.0%	0.00	124,741	0
25.089.0900	unsolved sorted 200:300	12	08:32:12	00:42:41	11	1	8.3%	0	0.0%	41.51	259,654	26
25.089.0924	unsolved sorted 300:	96	27:10:37	00:16:59	93	0	0.0%	0	0.0%	4.01	4,388,604	121
25.090.0714	unsolved sorted 050:100	3	03:15:11	01:05:03	3	0	0.0%	0	0.0%	-	33,605	5
25.091.1113	ARCv2 EVAL sorted	120	07:32:09	00:03:46	112	7	5.8%	4	3.3%	0.00	3,997,920	234
25.091.1916	unsolved	115	07:20:13	00:03:49	107	3	2.6%	0	0.0%	0.00	3,848,297	226
25.092.0632	unsolved	115	08:02:02	00:04:11	109	3	2.6%	0	0.0%	0.00	4,798,634	230
25.100.1902	unsolved	5	00:09:29	00:01:53	4	2	40.0%	0	0.0%	0.00	53,950	7
25.100.1923	unsolved	5	00:12:16	00:02:27	5	0	0.0%	0	0.0%	-	49,958	10
25.100.1936	unsolved	5	00:14:48	00:02:57	5	0	0.0%	0	0.0%	25.33	121,390	10
25.100.2035	unsolved	5	00:11:35	00:02:19	3	2	40.0%	0	0.0%	0.00	195,687	6
25.100.2058	-	5	00:16:25	00:03:17	5	0	0.0%	0	0.0%	-	133,141	9
25.100.2117	unsolved	5	00:36:06	00:07:13	0	2	40.0%	0	0.0%	0.00	1,215,337	0
25.100.2154	unsolved no code_execution	5	00:49:05	00:09:49	0	0	0.0%	0	0.0%	0.00	1,604,312	0
25.101.0604	unsolved no code_execution	25	03:12:52	00:07:42	2	3	12.0%	0	0.0%	0.00	4,191,349	2
25.101.0919	unsolved - code_execution	10	01:27:18	00:08:43	0	3	30.0%	0	0.0%	1.14	2,697,086	0
25.101.1050	unsolved - code_execution	10	01:30:54	00:09:05	1	2	20.0%	1	10.0%	0.00	2,761,324	1
25.101.1306	unsolved - code_execution	10	01:09:52	00:06:59	0	3	30.0%	0	0.0%	0.00	2,696,459	0