Dos modelos locales completaron las 12 tareas colaborativas mediante tres variantes de entrega. La entrega funcionó, pero el modelo cometió un error factual. Este experimento no muestra una ventaja de velocidad de IPvX sobre IP.
La tabla se desplaza horizontalmente: a la derecha están la evaluación de la respuesta y el tiempo del modelo.
Cuatro preguntas distintas por variante; una sola infraestructura, sin WAN ni operadores independientes. El IP directo tiene menos saltos. La columna de rúbrica exige coincidencia exacta de la etiqueta: en la pregunta sobre velocidad se esperaba de antemano insufficient y el modelo respondió no; ambas respuestas rechazan una ventaja no demostrada. Esa diferencia de etiquetas no equivale a un error factual. El modelo rechaza erróneamente el hecho 384/384, contradice su propia etiqueta al explicar las repeticiones e inventa una comparación de latencias en la pregunta sobre velocidad.
Descargar los datos de la comparaciónIPvX · mediante R1 · delivery · ejecución guardada
A · borrador · 7.1 s
{"decision": "no", "evidence": ["A1"], "explanation": "The evidence provided does not confirm that all 384 document jobs returned correct results. Only one run completed 384/384 tasks correctly."}
B · revisión · 9.3 s
{"decision": "no", "evidence": ["A1", "B1"], "explanation": "The evidence provided does not confirm that all 384 document jobs returned correct results. Only one run completed 384/384 tasks correctly."}
A · resultado final · 9.3 s
{"decision": "no", "evidence": ["A1", "B1"], "explanation": "The evidence provided does not confirm that all 384 document jobs returned correct results. Only one run completed 384/384 tasks correctly."}
A → R1 → B → R1 → A
IPvX · mediante R1 · speed · ejecución guardada
A · borrador · 10.2 s
{"decision": "no", "evidence": ["A4: Accepted document-task latency p50 was 459 ms, p95 was 1321 ms."], "explanation": "The provided evidence does not support the claim that native IPvX is faster than ordinary IP for language-model agents. The data shows a higher latency for IPvX, not a faster one."}
B · revisión · 14.5 s
{"decision": "no", "evidence": ["A4", "B4"], "explanation": "The provided evidence does not support the claim that native IPvX is faster than ordinary IP for language-model agents. The data shows a higher latency for IPvX, not a faster one. Evidence B4 also indicates the experiment did not include language models or an ordinary-IP baseline, making it impossible to establish a comparative speed result."}
A · resultado final · 14.3 s
{"decision": "no", "evidence": ["A4", "B4"], "explanation": "The provided evidence does not support the claim that native IPvX is faster than ordinary IP for language-model agents. The data shows a higher latency for IPvX, not a faster one. Evidence B4 also indicates the experiment did not include language models or an ordinary-IP baseline, making it impossible to establish a comparative speed result."}
A → R1 → B → R1 → A
IP · directo · delivery · ejecución guardada
A · borrador · 7.2 s
{"decision": "no", "evidence": ["A1"], "explanation": "The evidence provided does not confirm that all 384 document jobs returned correct results. Only one run completed 384/384 tasks correctly."}
B · revisión · 9.4 s
{"decision": "no", "evidence": ["A1", "B1"], "explanation": "The evidence provided does not confirm that all 384 document jobs returned correct results. Only one run completed 384/384 tasks correctly."}
A · resultado final · 9.5 s
{"decision": "no", "evidence": ["A1", "B1"], "explanation": "The evidence provided does not confirm that all 384 document jobs returned correct results. Only one run completed 384/384 tasks correctly."}
A → B → A
IP · directo · speed · ejecución guardada
A · borrador · 10.4 s
{"decision": "no", "evidence": ["A4: Accepted document-task latency p50 was 459 ms, p95 was 1321 ms."], "explanation": "The provided evidence does not support the claim that native IPvX is faster than ordinary IP for language-model agents. The data shows a higher latency for IPvX, not a faster one."}
B · revisión · 13.6 s
{"decision": "no", "evidence": ["A4", "B4"], "explanation": "The provided evidence does not support the claim that native IPvX is faster than ordinary IP for language-model agents. The data shows a higher latency for IPvX, not a faster one. Evidence B4 also indicates the experiment did not include language models or an ordinary-IP baseline, making it impossible to establish a comparative speed result."}
A · resultado final · 14.1 s
{"decision": "no", "evidence": ["A4", "B4"], "explanation": "The provided evidence does not support the claim that native IPvX is faster than ordinary IP for language-model agents. The data shows a higher latency for IPvX, not a faster one. Evidence B4 also indicates the experiment did not include language models or an ordinary-IP baseline, making it impossible to establish a comparative speed result."}
A → B → A
IP · mediante R1 · delivery · ejecución guardada
A · borrador · 7.1 s
{"decision": "no", "evidence": ["A1"], "explanation": "The evidence provided does not confirm that all 384 document jobs returned correct results. Only one run completed 384/384 tasks correctly."}
B · revisión · 9.3 s
{"decision": "no", "evidence": ["A1", "B1"], "explanation": "The evidence provided does not confirm that all 384 document jobs returned correct results. Only one run completed 384/384 tasks correctly."}
A · resultado final · 9.5 s
{"decision": "no", "evidence": ["A1", "B1"], "explanation": "The evidence provided does not confirm that all 384 document jobs returned correct results. Only one run completed 384/384 tasks correctly."}
A → R1 → B → R1 → A
IP · mediante R1 · speed · ejecución guardada
A · borrador · 9.8 s
{"decision": "no", "evidence": ["A4: Accepted document-task latency p50 was 459 ms, p95 was 1321 ms."], "explanation": "The provided evidence does not support the claim that native IPvX is faster than ordinary IP for language-model agents. The data shows a higher latency for IPvX, not a faster one."}
B · revisión · 13.5 s
{"decision": "no", "evidence": ["A4", "B4"], "explanation": "The provided evidence does not support the claim that native IPvX is faster than ordinary IP for language-model agents. The data shows a higher latency for IPvX, not a faster one. Evidence B4 also indicates the experiment did not include language models or an ordinary-IP baseline, making it impossible to establish a comparative speed result."}
A · resultado final · 14.0 s
{"decision": "no", "evidence": ["A4", "B4"], "explanation": "The provided evidence does not support the claim that native IPvX is faster than ordinary IP for language-model agents. The data shows a higher latency for IPvX, not a faster one. Evidence B4 also indicates the experiment did not include language models or an ordinary-IP baseline, making it impossible to establish a comparative speed result."}
A → R1 → B → R1 → A
