Skip to content
Tagged articles

AI-evaluation

106 articles · Page 2 of 2
DataFunTalk
DataFunTalk
Mar 27, 2023 · Artificial Intelligence

GPT-4 Shows Early Signs of Artificial General Intelligence: Insights from the "Sparks of AGI" Paper

A recent 154‑page Microsoft paper titled "Sparks of Artificial General Intelligence: Early Experiments with GPT‑4" argues that GPT‑4, despite being an early prototype, already exhibits many capabilities—multimodal reasoning, programming, mathematics, and human‑like interaction—suggesting it may be an early form of AGI, though experts highlight significant limitations and ongoing debates.

AI-evaluationArtificial General IntelligenceGPT-4
0 likes · 15 min read
GPT-4 Shows Early Signs of Artificial General Intelligence: Insights from the "Sparks of AGI" Paper
IT Services Circle
IT Services Circle
Feb 7, 2023 · Artificial Intelligence

ChatGPT’s Bug‑Fixing Ability Reaches State‑of‑the‑Art on the QuixBugs Benchmark

Researchers from Germany and the UK evaluated ChatGPT and three other AI models on the QuixBugs benchmark, finding that ChatGPT correctly fixed 31 of 40 bugs—outperforming CodeX, CoCoNut, and Standard APR—and sparked mixed reactions about its impact on software engineering and OpenAI’s broader strategies.

AI-evaluationChatGPTQuixBugs
0 likes · 8 min read
ChatGPT’s Bug‑Fixing Ability Reaches State‑of‑the‑Art on the QuixBugs Benchmark
DataFunTalk
DataFunTalk
Dec 28, 2021 · Artificial Intelligence

Evaluation Framework and Methodology for OPPO XiaoBu AI Assistant

This article presents a comprehensive evaluation framework for OPPO's XiaoBu AI assistant, covering evaluation concepts, objectives, five key elements, sampling methods, dimension selection, annotation scoring, report generation, and a detailed Q&A that illustrates practical metrics and processes for voice and search services.

AI-evaluationMetricsOPPO
0 likes · 23 min read
Evaluation Framework and Methodology for OPPO XiaoBu AI Assistant
DataFunSummit
DataFunSummit
Dec 27, 2021 · Artificial Intelligence

Evaluation Framework and Methodology for OPPO XiaoBu AI Assistant

This article presents a comprehensive evaluation framework for OPPO's XiaoBu AI assistant, covering the concept and purpose of evaluation, the five key evaluation elements, data sampling strategies, dimension and rule selection, annotation scoring, reporting guidelines, and detailed procedures for assessing wake‑up, ASR, NLU, and TTS performance.

AI-evaluationMetricsVoice Assistant
0 likes · 20 min read
Evaluation Framework and Methodology for OPPO XiaoBu AI Assistant