19:33:23llmchat.completionQA-ChatbotWhat can I use Trodo for?Let me look at your billing history1,961→31728.37s$0.0106
19:40:34toolsearch_ordersSupport-AgentHow do I link a trace to a user?Searching spans where status is error2,098→40630.48s$0.0124
19:47:45agentplanner.stepImage-GeneratorWhere did the agent spend its tokens?Install the SDK and call registerOTel2,235→49532.59s$0.0141
19:54:56retrievervector.queryHALLUCINATIONYour plan includes unlimited seats.
20:02:07llmclassify.intentBilling-BotShow me every failed tool call todayI will pull up the docs on that2,509→67336.82s$0.0176
20:09:18toolfetch_invoiceOnboard-FlowHow do I get started with tracing?You can attach a userId to the run2,646→76238.93s$0.0194
20:16:29agentrouter.decideQA-ChatbotWhich step is making us slowest?Most of the spend is in the planner2,783→85141.05s$0.0211
20:23:40retrieverkb.lookupPOLICY VIOLATIONHere is the card number we have on file.
20:30:51llmsummarise.turnImage-GeneratorHow do I link a trace to a user?Searching spans where status is error3,057→14945.27s$0.0114
20:38:02toolupdate_ticketDoc-IndexerWhere did the agent spend its tokens?Install the SDK and call registerOTel3,194→23847.39s$0.0132
20:45:13agentsubagent.spawnBilling-BotCan you refund my last invoice?The retriever is the slow one here3,331→32749.50s$0.0149
20:52:24toolsend_emailSTALE DATAQuoting from the Q1 2024 rate card.
20:59:35llmchat.completionQA-ChatbotHow do I get started with tracing?You can attach a userId to the run205→50553.73s$0.0082
21:06:46toolsearch_ordersSupport-AgentWhich step is making us slowest?Most of the spend is in the planner342→59455.84s$0.0099
21:13:57agentplanner.stepImage-GeneratorWhat can I use Trodo for?Let me look at your billing history479→68357.95s$0.0117
21:21:08retrievervector.queryTASK ADHERENCECancelled the wrong subscription.
21:28:19llmclassify.intentBilling-BotWhere did the agent spend its tokens?Install the SDK and call registerOTel753→8611m 2s$0.0152
21:35:30toolfetch_invoiceOnboard-FlowCan you refund my last invoice?The retriever is the slow one here890→701m 4s$0.0037
21:42:41agentrouter.decideQA-ChatbotShow me every failed tool call todayI will pull up the docs on that1,027→1591m 6s$0.0055
21:49:52retrieverkb.lookupUSER FRUSTRATIONthis is the fourth time i've asked
21:57:03llmsummarise.turnImage-GeneratorWhich step is making us slowest?Most of the spend is in the planner1,301→3371m 11s$0.0090
22:04:14toolupdate_ticketDoc-IndexerWhat can I use Trodo for?Let me look at your billing history1,438→4261m 13s$0.0107
22:11:25agentsubagent.spawnBilling-BotHow do I link a trace to a user?Searching spans where status is error1,575→5151m 15s$0.0124
22:18:36toolsend_emailMISSING CONTEXTWhich of your three shipments do you mean?
22:25:47llmchat.completionQA-ChatbotCan you refund my last invoice?The retriever is the slow one here1,849→6931m 19s$0.0159
22:32:58toolsearch_ordersSupport-AgentShow me every failed tool call todayI will pull up the docs on that1,986→7821m 21s$0.0177
22:40:09agentplanner.stepImage-GeneratorHow do I get started with tracing?You can attach a userId to the run2,123→8711m 23s$0.0194
22:47:20retrievervector.queryREPEATED CALLSfetch_invoice called nine times in one turn
22:54:31llmclassify.intentBilling-BotWhat can I use Trodo for?Let me look at your billing history2,397→1691m 28s$0.0097
23:01:42toolfetch_invoiceOnboard-FlowHow do I link a trace to a user?Searching spans where status is error2,534→2581m 30s$0.0115
23:08:53agentrouter.decideQA-ChatbotWhere did the agent spend its tokens?Install the SDK and call registerOTel2,671→3471m 32s$0.0132
23:16:04retrieverkb.lookupWRONG TOOLSearched the help centre instead of the order book.
23:23:15llmsummarise.turnImage-GeneratorShow me every failed tool call todayI will pull up the docs on that2,945→5251.99s$0.0167
23:30:26toolupdate_ticketDoc-IndexerHow do I get started with tracing?You can attach a userId to the run3,082→6144.10s$0.0185
23:37:37agentsubagent.spawnBilling-BotWhich step is making us slowest?Most of the spend is in the planner3,219→7036.21s$0.0202
23:44:48toolsend_emailUNGROUNDED ANSWERAnswered before any document came back.
23:51:59llmchat.completionQA-ChatbotHow do I link a trace to a user?Searching spans where status is error3,493→88110.44s$0.0237
23:59:10toolsearch_ordersSupport-AgentWhere did the agent spend its tokens?Install the SDK and call registerOTel230→9012.55s$0.0020
00:06:21agentplanner.stepImage-GeneratorCan you refund my last invoice?The retriever is the slow one here367→17914.66s$0.0038
00:13:32retrievervector.queryHALLUCINATIONYour plan includes unlimited seats.
00:20:43llmclassify.intentBilling-BotHow do I get started with tracing?You can attach a userId to the run641→35718.89s$0.0073
00:27:54toolfetch_invoiceOnboard-FlowWhich step is making us slowest?Most of the spend is in the planner778→44621.00s$0.0090
00:35:05agentrouter.decideQA-ChatbotWhat can I use Trodo for?Let me look at your billing history915→53523.11s$0.0108
00:42:16retrieverkb.lookupPOLICY VIOLATIONHere is the card number we have on file.
19:33:23llmchat.completionQA-ChatbotWhat can I use Trodo for?Let me look at your billing history1,961→31728.37s$0.0106
19:40:34toolsearch_ordersSupport-AgentHow do I link a trace to a user?Searching spans where status is error2,098→40630.48s$0.0124
19:47:45agentplanner.stepImage-GeneratorWhere did the agent spend its tokens?Install the SDK and call registerOTel2,235→49532.59s$0.0141
19:54:56retrievervector.queryHALLUCINATIONYour plan includes unlimited seats.
20:02:07llmclassify.intentBilling-BotShow me every failed tool call todayI will pull up the docs on that2,509→67336.82s$0.0176
20:09:18toolfetch_invoiceOnboard-FlowHow do I get started with tracing?You can attach a userId to the run2,646→76238.93s$0.0194
20:16:29agentrouter.decideQA-ChatbotWhich step is making us slowest?Most of the spend is in the planner2,783→85141.05s$0.0211
20:23:40retrieverkb.lookupPOLICY VIOLATIONHere is the card number we have on file.
20:30:51llmsummarise.turnImage-GeneratorHow do I link a trace to a user?Searching spans where status is error3,057→14945.27s$0.0114
20:38:02toolupdate_ticketDoc-IndexerWhere did the agent spend its tokens?Install the SDK and call registerOTel3,194→23847.39s$0.0132
20:45:13agentsubagent.spawnBilling-BotCan you refund my last invoice?The retriever is the slow one here3,331→32749.50s$0.0149
20:52:24toolsend_emailSTALE DATAQuoting from the Q1 2024 rate card.
20:59:35llmchat.completionQA-ChatbotHow do I get started with tracing?You can attach a userId to the run205→50553.73s$0.0082
21:06:46toolsearch_ordersSupport-AgentWhich step is making us slowest?Most of the spend is in the planner342→59455.84s$0.0099
21:13:57agentplanner.stepImage-GeneratorWhat can I use Trodo for?Let me look at your billing history479→68357.95s$0.0117
21:21:08retrievervector.queryTASK ADHERENCECancelled the wrong subscription.
21:28:19llmclassify.intentBilling-BotWhere did the agent spend its tokens?Install the SDK and call registerOTel753→8611m 2s$0.0152
21:35:30toolfetch_invoiceOnboard-FlowCan you refund my last invoice?The retriever is the slow one here890→701m 4s$0.0037
21:42:41agentrouter.decideQA-ChatbotShow me every failed tool call todayI will pull up the docs on that1,027→1591m 6s$0.0055
21:49:52retrieverkb.lookupUSER FRUSTRATIONthis is the fourth time i've asked
21:57:03llmsummarise.turnImage-GeneratorWhich step is making us slowest?Most of the spend is in the planner1,301→3371m 11s$0.0090
22:04:14toolupdate_ticketDoc-IndexerWhat can I use Trodo for?Let me look at your billing history1,438→4261m 13s$0.0107
22:11:25agentsubagent.spawnBilling-BotHow do I link a trace to a user?Searching spans where status is error1,575→5151m 15s$0.0124
22:18:36toolsend_emailMISSING CONTEXTWhich of your three shipments do you mean?
22:25:47llmchat.completionQA-ChatbotCan you refund my last invoice?The retriever is the slow one here1,849→6931m 19s$0.0159
22:32:58toolsearch_ordersSupport-AgentShow me every failed tool call todayI will pull up the docs on that1,986→7821m 21s$0.0177
22:40:09agentplanner.stepImage-GeneratorHow do I get started with tracing?You can attach a userId to the run2,123→8711m 23s$0.0194
22:47:20retrievervector.queryREPEATED CALLSfetch_invoice called nine times in one turn
22:54:31llmclassify.intentBilling-BotWhat can I use Trodo for?Let me look at your billing history2,397→1691m 28s$0.0097
23:01:42toolfetch_invoiceOnboard-FlowHow do I link a trace to a user?Searching spans where status is error2,534→2581m 30s$0.0115
23:08:53agentrouter.decideQA-ChatbotWhere did the agent spend its tokens?Install the SDK and call registerOTel2,671→3471m 32s$0.0132
23:16:04retrieverkb.lookupWRONG TOOLSearched the help centre instead of the order book.
23:23:15llmsummarise.turnImage-GeneratorShow me every failed tool call todayI will pull up the docs on that2,945→5251.99s$0.0167
23:30:26toolupdate_ticketDoc-IndexerHow do I get started with tracing?You can attach a userId to the run3,082→6144.10s$0.0185
23:37:37agentsubagent.spawnBilling-BotWhich step is making us slowest?Most of the spend is in the planner3,219→7036.21s$0.0202
23:44:48toolsend_emailUNGROUNDED ANSWERAnswered before any document came back.
23:51:59llmchat.completionQA-ChatbotHow do I link a trace to a user?Searching spans where status is error3,493→88110.44s$0.0237
23:59:10toolsearch_ordersSupport-AgentWhere did the agent spend its tokens?Install the SDK and call registerOTel230→9012.55s$0.0020
00:06:21agentplanner.stepImage-GeneratorCan you refund my last invoice?The retriever is the slow one here367→17914.66s$0.0038
00:13:32retrievervector.queryHALLUCINATIONYour plan includes unlimited seats.
00:20:43llmclassify.intentBilling-BotHow do I get started with tracing?You can attach a userId to the run641→35718.89s$0.0073
00:27:54toolfetch_invoiceOnboard-FlowWhich step is making us slowest?Most of the spend is in the planner778→44621.00s$0.0090
00:35:05agentrouter.decideQA-ChatbotWhat can I use Trodo for?Let me look at your billing history915→53523.11s$0.0108
00:42:16retrieverkb.lookupPOLICY VIOLATIONHere is the card number we have on file.