Advanced Ranking Modes: YetiRankPairwise
YetiRankPairwise is an advanced ranking mode that optimizes specific ranking loss functions by specifying the mode
parameter. It supports various loss functions like DCG
, NDCG
, MRR
, ERR
, and MAP
. Parameters:
- Mode: Can be
Classic
or a specific ranking loss function. - Number of permutations: Default is 10.
- Probability of search continuation: Default is 0.85.
model = CatBoostRanker(
iterations=1000,
learning_rate=0.1,
depth=6,
loss_function='YetiRankPairwise',
eval_metric='NDCG',
custom_metric=['DCG', 'ERR']
)
model.fit(train_data, eval_set=test_data)
Output:
0: learn: 0.5000000 test: 0.4500000 best: 0.4500000 (0) total: 0.1s remaining: 1m 40s
1: learn: 0.5200000 test: 0.4600000 best: 0.4600000 (1) total: 0.2s remaining: 1m 40s
...
999: learn: 0.9500000 test: 0.9000000 best: 0.9000000 (999) total: 1m 40s remaining: 0us
bestTest = 0.9000000
For large datasets, it is recommended to use YetiRankPairwise
or PairLogitPairwise
as they provide more accurate results but may take longer to train. Additionally, metrics like PFound
and NDCG
can be calculated during training to monitor the modelâs performance.
CatBoost Ranking Metrics: A Comprehensive Guide
CatBoost, short for âCategorical Boosting,â is a powerful gradient boosting library developed by Yandex. It is renowned for its efficiency, accuracy, and ability to handle categorical features with ease. One of the key features of CatBoost is its support for ranking tasks, which are crucial in applications like search engines, recommendation systems, and information retrieval. This article delves into the various ranking metrics supported by CatBoost, their usage, and how they can be leveraged to build high-performing ranking models.
Table of Content
- Understanding Ranking in CatBoost
- Key CatBoost Ranking Metrics
- 1. Normalized Discounted Cumulative Gain (NDCG)
- 2. Mean Reciprocal Rank (MRR)
- 3. Expected Reciprocal Rank (ERR)
- 4. Mean Average Precision (MAP)
- Advanced Ranking Modes: YetiRankPairwise
- Choosing the Right Ranking Metric
Contact Us