پیوندهای مفید
آمار
| تعداد نشریات | 31 |
| تعداد شماره‌ها | 778 |
| تعداد مقالات | 7,442 |
| تعداد مشاهده مقاله | 18,297,117 |
| تعداد دریافت فایل اصل مقاله | 7,495,584 |
Is evaluation based on accuracy of classification algorithms misleading? An approach to model validation using Bayes error rate | ||
| Journal of Mathematical Modeling | ||
| مقالات آماده انتشار، اصلاح شده برای چاپ، انتشار آنلاین از تاریخ 19 فروردین 1404 اصل مقاله (638.98 K) | ||
| نوع مقاله: Special Issue: First International Conference on Machine Learning and Knowledge Discovery | ||
| شناسه دیجیتال (DOI): 10.22124/jmm.2025.28746.2649 | ||
| نویسندگان | ||
| Hossein Kazemzadeh Gharechopogh؛ Adel Mohammadpour* | ||
| Faculty of Mathematics and Computer Science, Amirkabir University of Technology | ||
| چکیده | ||
| Researchers have long regarded model accuracy as the primary metric for evaluating the performance of classification algorithms. The current evaluation approach, which relies solely on model accuracy, often leads to inappropriate evaluation of classifiers, regardless of the dataset's separability and complexity. This limitation underscores the need for a new and more comprehensive method. We argue that accuracy-based evaluation can be misleading, even when considering measures of data separability and complexity. We compare the error rates of well-known classifiers on Gaussian-generated datasets and show that, paradoxically, many algorithms' observed errors are lower than that of the theoretical optimal classifier, leading to an overestimation of their performance. We consider a model invalid if its error rate is lower than the optimal classifier error, known as the Bayes error rate. To identify such invalid models, we introduce a procedure and propose an algorithm for model validation based on the Bayes error rate. | ||
| کلیدواژه‌ها | ||
| Classification؛ evaluation؛ validation؛ Bayes error rate؛ discriminant analysis and complexity measure | ||
|
آمار تعداد مشاهده مقاله: 34 تعداد دریافت فایل اصل مقاله: 19 |
||