BestHub
Sign in
Tagged articles

evaluation

249 articles · Page 3 of 3
Baobao Algorithm Notes
Baobao Algorithm Notes
Aug 22, 2023 · Artificial Intelligence

Why Do Large Language Models Hallucinate? Definitions, Causes, and Mitigation Strategies

This article defines hallucination in LLMs as a failure of faithfulness or factualness, explores data‑level and model‑level origins, reviews reference‑based and reference‑free evaluation metrics, and surveys current research on data‑centric and model‑centric mitigation techniques along with future directions.

evaluationfactualityhallucination
0 likes · 16 min read
Why Do Large Language Models Hallucinate? Definitions, Causes, and Mitigation Strategies
DataFunTalk
DataFunTalk
Aug 11, 2023 · Artificial Intelligence

Multimodal Dialogue Large Model mPLUG-Owl: Technology, Applications, and Evaluation

mPLUG-Owl is a modular multimodal dialogue large model from Alibaba DAMO Academy that builds on the mPLUG series, offering advanced image, video, OCR, and multilingual capabilities, with extensive evaluations showing superior performance over MiniGPT‑4, LLaVA, and other multimodal LLMs across various tasks.

evaluationmPLUG-Owlmultimodal AI
0 likes · 17 min read
Multimodal Dialogue Large Model mPLUG-Owl: Technology, Applications, and Evaluation
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Jul 24, 2023 · Artificial Intelligence

Comprehensive Survey of Large Language Models: History, Key Technologies, Resources, and Future Directions

This article provides a detailed overview of large language models (LLMs), tracing their evolution from statistical and neural language models to modern pre‑trained transformers, discussing scaling, training, adaptation, utilization, evaluation methods, available resources, and outlining current challenges and future research directions.

Large Language ModelsPre‑trainingPrompt Engineering
0 likes · 26 min read
Comprehensive Survey of Large Language Models: History, Key Technologies, Resources, and Future Directions
DevOps
DevOps
May 19, 2023 · Cloud Computing

Comprehensive Guide to Cloud Migration: Evaluation, Planning, Execution, and Cost Optimization

This article provides a detailed guide to cloud migration, covering evaluation and analysis, pilot projects, assessment strategies, planning and design with cloud services, verification and implementation steps, continuous measurement, and cost optimization through FinOps to ensure successful and secure migration.

Cloud ComputingFinOpscloud migration
0 likes · 10 min read
Comprehensive Guide to Cloud Migration: Evaluation, Planning, Execution, and Cost Optimization
DataFunSummit
DataFunSummit
May 4, 2023 · Artificial Intelligence

LLM Ranking Arena: Elo‑Based Competitive Evaluation of Open‑Source Chatbots

A recent study by the LMSYS organization introduces an Elo‑rated, 1v1 battle arena for large language models, ranking open‑source chatbots like Vicuna, Koala, and ChatGLM, while discussing the limitations of traditional benchmarks and the advantages of crowd‑sourced, scalable evaluation.

AI benchmarkingChatbot ArenaElo rating
0 likes · 7 min read
LLM Ranking Arena: Elo‑Based Competitive Evaluation of Open‑Source Chatbots
Architect
Architect
Apr 9, 2023 · Artificial Intelligence

Evaluating the Commonsense Knowledge and Reasoning Capabilities of ChatGPT and Other Large Language Models

This study systematically evaluates ChatGPT and other large language models on their ability to answer commonsense questions, assess their knowledge awareness, and utilize generated knowledge for reasoning, revealing strong QA performance but notable gaps in social and temporal commonsense and in leveraging contextual knowledge.

ChatGPTLarge Language ModelsNLP
0 likes · 20 min read
Evaluating the Commonsense Knowledge and Reasoning Capabilities of ChatGPT and Other Large Language Models
Programmer DD
Programmer DD
Apr 9, 2023 · Artificial Intelligence

How Does Alibaba’s Tongyi Qianwen Compare to ChatGPT? A Hands‑On Evaluation

This article reviews Alibaba’s Tongyi Qianwen large‑language model by testing its self‑introduction, code generation, literary creation, mathematical reasoning, Chinese language understanding, and casual chatting abilities, summarizing strengths, weaknesses, and overall performance compared with other LLMs.

Artificial IntelligenceChinese languagecode generation
0 likes · 7 min read
How Does Alibaba’s Tongyi Qianwen Compare to ChatGPT? A Hands‑On Evaluation
DataFunSummit
DataFunSummit
Mar 19, 2023 · Artificial Intelligence

Complex Question Answering Evaluation of ChatGPT

This paper presents a large‑scale evaluation of ChatGPT on knowledge‑base complex question answering, introducing a feature‑driven multi‑label annotation framework and CheckList‑based functional, robustness, and controllability tests, and comparing its performance with other LLMs across multiple English and multilingual datasets.

ChatGPTChecklistComplex QA
0 likes · 25 min read
Complex Question Answering Evaluation of ChatGPT
Model Perspective
Model Perspective
Nov 6, 2022 · Fundamentals

Unlock Objective Decision-Making with the Entropy Weight Method

The Entropy Weight Method (EWM) offers an objective, data‑driven way to calculate indicator weights by measuring information entropy, avoiding subjective bias and improving the reliability of multi‑criteria evaluations across fields such as water quality and resource management.

decision makingentropy weight methodevaluation
0 likes · 4 min read
Unlock Objective Decision-Making with the Entropy Weight Method
DataFunSummit
DataFunSummit
Sep 23, 2022 · Artificial Intelligence

A Comprehensive Overview of Automatic Text Summarization: Methods, Datasets, Evaluation, and Future Directions

This article surveys automatic text summarization, detailing system classifications, extractive, abstractive and hybrid techniques, notable recent research, multi‑document and cross‑lingual challenges, major datasets, evaluation metrics, and promising future research avenues in the field.

NLPText Summarizationabstractive
0 likes · 21 min read
A Comprehensive Overview of Automatic Text Summarization: Methods, Datasets, Evaluation, and Future Directions
DataFunSummit
DataFunSummit
Sep 5, 2022 · Artificial Intelligence

Comprehensive Evaluation of Long‑Audio Speech‑to‑Text Services from Major Cloud Providers

This article presents a systematic, multi‑dimensional benchmark of six leading cloud speech‑recognition platforms—Alibaba Cloud, Tencent Cloud, iFlytek, Baidu Cloud, Huawei Cloud, and Microsoft Azure—using a 22.6‑hour, 81‑file Mandarin dataset, scoring with the CORR metric and SCTK tool, and discusses each provider's workflow, strengths, pitfalls, and cost.

AISCTKcloud services
0 likes · 15 min read
Comprehensive Evaluation of Long‑Audio Speech‑to‑Text Services from Major Cloud Providers
DataFunSummit
DataFunSummit
Aug 20, 2022 · Information Security

Content Risk Control Industry Overview and Evaluation System

The article reviews the development background of the digital economy‑driven content risk control industry, examines current content moderation technologies and challenges, describes the establishment of a content technology promotion alliance, outlines its research directions and evaluation standards, and includes a Q&A on regulatory collaboration.

Artificial Intelligencecontent moderationevaluation
0 likes · 16 min read
Content Risk Control Industry Overview and Evaluation System
Model Perspective
Model Perspective
Jul 2, 2022 · Operations

Top Resources for Evaluation & Optimization Models – A Curated Guide

This article compiles and categorizes recent model‑related publications, offering a comprehensive list of evaluation‑model resources—including concepts, preprocessing techniques, weighting methods, and various algorithms—and optimization‑model references covering linear and integer programming, graph theory, network flows, and meta‑heuristics.

Linear ProgrammingModelingOperations
0 likes · 4 min read
Top Resources for Evaluation & Optimization Models – A Curated Guide
Architecture and Beyond
Architecture and Beyond
May 1, 2022 · R&D Management

Effective Questioning Techniques for Promotion Review Panels

The article outlines systematic questioning strategies for judges in corporate promotion defenses, detailing how to clarify definitions, probe processes, assess difficulty, evaluate big‑picture thinking, explore methodology, and link technical work to business value, thereby ensuring fair and insightful evaluations.

InterviewR&D Managementcareer development
0 likes · 13 min read
Effective Questioning Techniques for Promotion Review Panels
DataFunTalk
DataFunTalk
Oct 5, 2021 · Artificial Intelligence

From Technology to Experience: Vivo Machine Translation Deployment Practice

This article presents a comprehensive guide to deploying machine translation at Vivo, covering business analysis, algorithm choices beyond standard NMT, language detection challenges, data collection and cleaning, scientific evaluation methods, and engineering optimizations to deliver a seamless user experience.

AIEngineeringNMT
0 likes · 20 min read
From Technology to Experience: Vivo Machine Translation Deployment Practice
IT Architects Alliance
IT Architects Alliance
Jul 26, 2021 · R&D Management

How to Conduct a Comprehensive Architecture Evaluation: A Step-by-Step Guide

This article outlines a thorough methodology for evaluating software, hardware, and overall system architectures, detailing assessment criteria, a five‑stage evaluation process, quality‑assurance measures, and best‑practice checkpoints to ensure high availability, scalability, security, and cost‑effectiveness of complex engineering projects.

Quality AssuranceSystem Designarchitecture
0 likes · 12 min read
How to Conduct a Comprehensive Architecture Evaluation: A Step-by-Step Guide
Liulishuo Tech Team
Liulishuo Tech Team
Jul 7, 2021 · Frontend Development

Evaluation and Evolution of Mini‑Program Development Frameworks for Frontend Teams

This article reviews the background, key considerations, architectural principles, evolution, performance comparison, and a customized solution for building mini‑programs using frameworks such as WePY, Taro, and UniApp, highlighting cross‑platform support, TypeScript integration, and development experience improvements.

evaluationframeworkperformance
0 likes · 12 min read
Evaluation and Evolution of Mini‑Program Development Frameworks for Frontend Teams
Efficient Ops
Efficient Ops
Apr 16, 2021 · Operations

How Anxin Securities Achieved Top RPA Maturity: Insights from China’s First RPA Standard Evaluation

Anxin Securities’ RPA Unified Management Platform earned the highest 3+ maturity rating at China’s inaugural RPA standard assessment, showcasing extensive automation across finance, operations, and disaster recovery, while outlining future SmartRPA initiatives and AI‑driven enhancements for digital transformation.

AI integrationProcess AutomationRPA
0 likes · 10 min read
How Anxin Securities Achieved Top RPA Maturity: Insights from China’s First RPA Standard Evaluation
21CTO
21CTO
Feb 26, 2021 · Artificial Intelligence

Why One Metric Isn't Enough: Multi‑Dimensional Evaluation of Recommendation Systems

The article explains why relying on a single metric like click‑through rate is insufficient for recommendation systems, and outlines a comprehensive, multi‑dimensional evaluation framework that combines business indicators, user behavior metrics, and algorithmic performance measures such as recall, precision, and AUC.

AB testingAIAUC
0 likes · 10 min read
Why One Metric Isn't Enough: Multi‑Dimensional Evaluation of Recommendation Systems
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Feb 26, 2021 · Artificial Intelligence

Inside Toutiao's Transparent Real-Time Recommendation Engine

This article details how Toutiao's senior algorithm architect designs a transparent recommendation system, covering system overview, three-dimensional feature modeling, real-time training pipelines, recall strategies, content analysis, user tagging, evaluation methods, and content safety measures.

Content AnalysisReal-time Trainingcontent safety
0 likes · 17 min read
Inside Toutiao's Transparent Real-Time Recommendation Engine
21CTO
21CTO
Jan 11, 2021 · Artificial Intelligence

How to Build a Recommendation System from Scratch: Key Concepts and Strategies

This article explains the fundamentals of recommendation systems, covering data collection, user and content profiling, system architecture, algorithmic pipelines such as recall, filtering, ranking, and evaluation metrics, while also discussing practical challenges like echo chambers and long‑term user value.

AlgorithmRankingevaluation
0 likes · 16 min read
How to Build a Recommendation System from Scratch: Key Concepts and Strategies
NetEase Yanxuan Technology Product Team
NetEase Yanxuan Technology Product Team
Nov 27, 2020 · Product Management

How to Build Effective Decision‑Making Products: A Practical Blueprint

This article outlines a comprehensive framework for designing decision‑type products, covering their evolution stages, core elements of model‑data‑strategy, domain modeling techniques, data‑to‑knowledge transformation, business and process value, and a feedback‑driven decision loop with evaluation and simulation.

Data ModelingDecision ProductsSimulation
0 likes · 20 min read
How to Build Effective Decision‑Making Products: A Practical Blueprint
Programmer DD
Programmer DD
Oct 24, 2020 · Cloud Native

Should You Switch to Microservices? Evaluation Tips and Migration Steps

This article examines the fundamentals of monolithic and microservice architectures, outlines the advantages and drawbacks of each, provides criteria for deciding when to adopt microservices, and offers practical guidance on technical, talent, and organizational considerations for a successful migration.

Migrationarchitecturecloud-native
0 likes · 16 min read
Should You Switch to Microservices? Evaluation Tips and Migration Steps
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Oct 1, 2020 · Cloud Native

When Should You Adopt Microservices? A Practical Evaluation Guide

This article explores the fundamentals of monolithic and microservice architectures, assesses the benefits, costs, and risks of adopting microservices, and provides practical criteria—including business complexity, team size, and technical readiness—to help decide the optimal moment for migration.

backendcloud-nativeevaluation
0 likes · 16 min read
When Should You Adopt Microservices? A Practical Evaluation Guide
Top Architect
Top Architect
Sep 19, 2020 · Artificial Intelligence

Architecture and Evaluation of Toutiao's Large-Scale Recommendation System

The article details the end‑to‑end architecture of Toutiao's massive recommendation platform, covering system overview, content and user feature extraction, model training, recall strategies, evaluation methodology, and content safety mechanisms, while highlighting practical challenges and engineering solutions.

Content Analysiscontent safetyevaluation
0 likes · 18 min read
Architecture and Evaluation of Toutiao's Large-Scale Recommendation System
Sohu Tech Products
Sohu Tech Products
Sep 16, 2020 · Artificial Intelligence

Open-Domain Dialogue Systems: Current State, Challenges, and Future Directions

This article reviews the latest advances in open-domain dialogue systems, covering classification, end‑to‑end generation challenges, knowledge‑controlled generation, automated evaluation, large‑scale latent‑space models such as PLATO, and outlines future research directions for building more coherent and controllable conversational AI.

Dialogue Systemsevaluationknowledge grounding
0 likes · 14 min read
Open-Domain Dialogue Systems: Current State, Challenges, and Future Directions
Efficient Ops
Efficient Ops
Aug 20, 2020 · Operations

Understanding China’s First DevOps Capability Maturity Model and Evaluation Process

This article introduces China’s inaugural DevOps Capability Maturity Model, outlines its eight-part structure—including system and tool requirements—describes the standardized evaluation methodology, registration details, and provides contact information for organizations seeking certification.

Capability Maturity ModelDevOpsStandardization
0 likes · 6 min read
Understanding China’s First DevOps Capability Maturity Model and Evaluation Process
21CTO
21CTO
Feb 18, 2020 · Artificial Intelligence

Inside Toutiao’s Real‑Time Recommendation Engine: Architecture, Features, and Evaluation

This article details Toutiao’s large‑scale recommendation system, explaining how it models content, user, and environment features, the variety of algorithms and real‑time training pipelines used, feature engineering categories, recall strategies, content analysis, user tagging, evaluation methods, and content‑safety mechanisms.

Real-time Trainingcontent safetyevaluation
0 likes · 18 min read
Inside Toutiao’s Real‑Time Recommendation Engine: Architecture, Features, and Evaluation
DataFunTalk
DataFunTalk
Aug 30, 2019 · Artificial Intelligence

TransFM: Integrating Translation-based Recommendation and Factorization Machines for Sequential Recommendation

This article reviews the TransFM model, which combines the translation‑based sequential recommendation approach (TransRec) with factorization machines (FM), explains its formulation, optimization via sequential Bayesian personalized ranking, and demonstrates its superior performance on Amazon and Google Local datasets compared with several baselines.

evaluationfactorization machinesmachine learning
0 likes · 8 min read
TransFM: Integrating Translation-based Recommendation and Factorization Machines for Sequential Recommendation
iQIYI Technical Product Team
iQIYI Technical Product Team
Jul 12, 2019 · Artificial Intelligence

Real-Time Evaluation System for Adaptive Bitrate (ABR) Algorithms and Controlled Bitrate Distribution

RESA is a real‑time evaluation platform that continuously tests multiple Adaptive Bitrate (ABR) algorithms on live user traffic, introduces a multi‑user QoE metric derived from viewing behavior, reveals trade‑offs between clarity and bandwidth, and proposes the RL‑based ABSbc algorithm to steer bitrate distribution and balance user experience with network cost.

ABRBandwidth ControlQoE
0 likes · 23 min read
Real-Time Evaluation System for Adaptive Bitrate (ABR) Algorithms and Controlled Bitrate Distribution
21CTO
21CTO
Jan 16, 2019 · Artificial Intelligence

Inside Toutiao’s Recommendation Engine: Architecture, Features, and Evaluation

This article provides a comprehensive overview of Toutiao’s recommendation system, detailing its three‑dimensional modeling of content, user, and context, the feature extraction pipeline, real‑time training infrastructure, user‑tag generation, evaluation methodology, and content‑safety mechanisms.

Real-time Trainingcontent safetyevaluation
0 likes · 18 min read
Inside Toutiao’s Recommendation Engine: Architecture, Features, and Evaluation
DataFunTalk
DataFunTalk
Jan 3, 2019 · Artificial Intelligence

Machine Learning and Recommendation System Practice

This article presents a comprehensive overview of applying machine learning to recommendation systems, covering fundamental challenges such as user cold‑start, precise interest modeling, collaborative filtering, and both offline and online evaluation methods, while illustrating concepts with numerous diagrams.

AICollaborative FilteringRecommendation Systems
0 likes · 9 min read
Machine Learning and Recommendation System Practice
360 Quality & Efficiency
360 Quality & Efficiency
May 11, 2018 · Artificial Intelligence

Common Engineering Algorithms and Their Testing Methods

This article introduces the most commonly used algorithms in engineering—recommendation, optimization, estimation, and classification—explains their typical application scenarios, and discusses various testing methods and evaluation metrics such as offline experiments, user surveys, A/B testing, and performance indicators like accuracy, coverage, diversity, and robustness.

AlgorithmOptimizationevaluation
0 likes · 12 min read
Common Engineering Algorithms and Their Testing Methods
ThinkingAgent
ThinkingAgent
Mar 22, 2018 · Artificial Intelligence

A Step‑by‑Step Guide to the Standard Machine Learning Workflow

The article outlines the seven‑stage machine‑learning pipeline—from data acquisition and preparation through model selection, training, evaluation, parameter tuning, and deployment—highlighting the critical role of feature engineering, which typically consumes over 80% of project time.

Workflowevaluationfeature engineering
0 likes · 3 min read
A Step‑by‑Step Guide to the Standard Machine Learning Workflow
Efficient Ops
Efficient Ops
Feb 25, 2018 · Cloud Computing

Why Multi-Cloud Management Platforms Need Standards: Key Insights & Evaluation

Amid the rise of multi‑cloud strategies, China’s nascent multi‑cloud management platform market faces a lack of standards, prompting TrustCloud to launch the first domestic evaluation framework that assesses information authenticity, platform quality, and service completeness, with results to be revealed at the 2018 Cloud Computing Open‑Source Industry Conference.

Cloud ComputingCloud ManagementMulti-Cloud
0 likes · 6 min read
Why Multi-Cloud Management Platforms Need Standards: Key Insights & Evaluation
Architecture Digest
Architecture Digest
Jan 30, 2018 · Artificial Intelligence

Overview of Toutiao's Recommendation System: Architecture, Content Analysis, User Tagging, Evaluation, and Content Safety

This article presents a comprehensive overview of Toutiao's recommendation system, detailing its three‑dimensional modeling approach, real‑time training pipeline, feature engineering, content and user analysis techniques, evaluation methodology, and the extensive content‑safety mechanisms employed to ensure reliable and responsible information distribution.

Content Analysiscontent safetyevaluation
0 likes · 19 min read
Overview of Toutiao's Recommendation System: Architecture, Content Analysis, User Tagging, Evaluation, and Content Safety
21CTO
21CTO
Jan 16, 2018 · Artificial Intelligence

Inside Toutiao’s Recommendation Engine: Architecture, Features, and Evaluation

This article provides a comprehensive overview of Toutiao's recommendation system, covering its three‑dimensional modeling approach, feature engineering, real‑time training pipeline, recall strategies, user‑tag generation, evaluation methodology, and content‑safety mechanisms.

Real-time Trainingcontent safetyevaluation
0 likes · 18 min read
Inside Toutiao’s Recommendation Engine: Architecture, Features, and Evaluation
Architecture Digest
Architecture Digest
Sep 15, 2017 · Artificial Intelligence

Overview of Recommendation Systems: Goals, Methods, Architecture, and Practical Considerations

This article explains the objectives of recommendation systems, compares popular recommendation approaches, details the components and algorithms of personalized recommendation pipelines, and discusses practical challenges such as real‑time processing, freshness, cold‑start, diversity, content quality, and surprise handling.

Data Pipelinecold startevaluation
0 likes · 15 min read
Overview of Recommendation Systems: Goals, Methods, Architecture, and Practical Considerations
Baidu Intelligent Testing
Baidu Intelligent Testing
Sep 6, 2017 · Product Management

Understanding User Satisfaction Models and How to Build Them

The article explains what a user satisfaction model is, why it matters for product evaluation, and outlines a step‑by‑step methodology—including defining dimensions, collecting questionnaire data, applying statistical techniques, creating a two‑dimensional evaluation matrix, and deriving actionable improvement plans—to quantitatively assess and enhance user experience.

ModelingUX Researchevaluation
0 likes · 6 min read
Understanding User Satisfaction Models and How to Build Them
21CTO
21CTO
Mar 18, 2016 · Artificial Intelligence

10 Essential Tips for Building High‑Performance Intelligent Recommendation Systems

This article outlines ten practical key points—including leveraging explicit and implicit feedback, hybridizing algorithms, handling temporal and geographic factors, exploiting social ties, solving cold‑start issues, optimizing presentation, defining clear metrics, ensuring real‑time updates, and scaling big‑data processing—to help engineers design effective intelligent recommendation systems.

User Behaviorcold startdata mining
0 likes · 18 min read
10 Essential Tips for Building High‑Performance Intelligent Recommendation Systems