It is important to notice that 2021 Benchmark scoring campaign was assessed with ETSI 103 559 Annex A scoring methodology.
In assessing the overall performance and overall score of each mobile network, 5 main categories of services have been evaluated:
The above-mentioned categorisation is being applied in parallel with areas categorisation. Based on ETSI 103 559 Annex A three main area types are being distinguished. They are than divided into subdivisions.
With this methodology applied, Telekom Srbija achieved 85.66 (out of 100) scoring points, followed by A1 Srbija with 82.73 (out of 100) scoring points and Telenor 82.14 (out of 100) scoring points.
Telekom Srbija achieved the best results during this year’s benchmark. Results of A1 Srbija and Telenor are very close. The differences are minor and below confidence level.
The mobile Network Benchmarking results achieved in each category of services and on every measurement aggregation, as well as the overall scores achieved, are presented in Figure 1 below. Values for aggregations on the right are weighted values as used for the calculation of the final score.
Fig.1. Final and Aggregation scorings for all three operators
The Voice services scores achieved are presented in Figure 2 below.
Fig.2. Final and Aggregation Voice scorings for all three operators
Scores for data tests including data transmission, web browsing, YouTube and messaging are presented on Figure 3 below.
Fig.3. Final and Aggregation Data scorings for all three operators
Results by 5 main categories of services for all three operators are shown in Figure 4. Values for respective services show the percentage of maximum score achieved, to assess the gap in quality.
Fig.4. Results by 4 main categories of services for all three operators
All three mobile operators achieved good KPIs levels in most of the aggregations for voice services. On Rural roads and in Trains the quality of voice service is poorer for all of them. These results require improvements.
Telekom Srbija presented the best voice performance in most of the aggregations, mainly due to smallest number of failed calls. All mobile operators depicted similar quality of voice service. Telenor ranked last due to highest percent of bad voice samples on Roads where A1 Srbija had better performance.
Telekom Srbija scored best in most of data type services. In data transfer performance Telekom Srbija and A1 Srbija showed similar results and scored between 50% and 55% of maximum points in this test (60%).
A1 Srbija slightly ahead, due to higher throughputs for small file transfer. Telenor ranked last mainly due to poor performance of data transmission tests.