Mobile network benchmarking

The Regulatory Agency for Electronic Communications and Postal Services (RATEL) is responsible for state strategy and policies in the field of electronic communications and postal services in the Republic of Serbia. It also assures highest Quality of Service standards by enforcing country-wide coverage of mobile services and their continued improvement of performance.

The strategy of RATEL is to encourage further investments and development of telecommunications markets by fostering competition, cost-effectiveness and efficiency in mobile communications, as well as to provide subscribers with fair and unbiased information about the quality of service in the mobile networks in the Republic of Serbia. Therefore, as of 2017, RATEL is carrying out the extensive benchmarking tests of the three mobile network operators: Telekom Srbija, Telenor and Vip mobile. This is the fourth year in a row that RATEL performs nationwide benchmarking.

The purpose of Mobile Network Benchmarking is to compare in an objective fashion the quality of mobile network services by measuring Key Performance Indicators (KPIs) which represent user experience of services offered by all mobile network operators. The benchmarking measurements were conducted in September and October 2020. In the first half of 2019, RATEL conducted a public international tender for Mobile Network Benchmarking activity and awarded a contract to a consortium comprised of CRONY, a Serbian company specialized in the representation of foreign companies in Serbia, and Systemics-PAB, a renowned services company from Poland. 2020 benchmarking campaign is the continuation of the project stated in 2019.

Systemics-PAB is a well-recognized company offering benchmarking services to regulatory authorities and network operators worldwide. They provide solutions and services to measure, monitor and analyse the quality of mobile and fixed networks, with the aim to enhance the end-user experience. The experience Systemics-PAB gained in more than 14 years of working in this area, has enabled them to develop effective techniques and methodologies for conducting the benchmark activities, and all their tests, measurements and processes overall are ISO 9001 certified, which ensures impartiality and reliability of the results.

The rating and benchmarking of mobile services is done by using Systemics-PAB own scoring methodology that allows objective assessment of Quality of Service and user experience for each mobile network operator.

Benchmarking measurements covered 50 cities and 10,000 km of Serbian roads. During the campaign, over 7000 voice calls and 7000 of every data service tests were performed for each mobile network operator across all technologies (2G, 3G, 4G). These measurements included:

  • Measurement of KPIs for voice and data services,
  • Measurement of radio parameters for 2G / 3G / 4G technologies.

The whole benchmarking campaign was divided into phases as presented in Figure 1.

Fig.1 Benchmarking campaign phases
Fig.1 Benchmarking campaign phases

In parallel with analysis and reporting, a dedicated portal was updated with new results to enable the broad public viewing of benchmarking results on RATEL’s web page. The portal was also improved with new features.

Market overview

 

In 2019, the largest share in total revenues of 59.8% in the Serbian electronic communications market, as in previous years, was achieved by providing mobile telephony services. (Source: An overview of the Telecom and Postal Services Market in the Republic of Serbia in 2019, RATEL).

The mobile market in Serbia, in terms of number of subscribers, is divided among three mobile network operators (MNO) and one mobile virtual network operator (MVNO). Since MVNO Globaltel had around 0,05% mobile market revenue share and around 0,3% of mobile subscribers’ share in 2020, it was not included in the scope of the Benchmark activity. Respective mobile subscribers’ shares of three MNOs are presented in Figure 2. Figure 3 presents the mobile market share in Serbia in terms of revenues generated by the operators.

Mobile subscribers

Fig. 2. Mobile subscribers
Source: Q2 2020 Market overview, RATEL

Mobile Market revenue share

Fig. 3. Mobile market revenue share
Source: 2019 Market overview, RATEL

The number of mobile subscribers in Serbia is approximately 8.1 million, which corresponds to 116.31% of SIM penetration. The voice users generated more than 5.5 billion minutes in the second quarter of 2020. Close to 54% of the voice traffic was on-net traffic. 6.21 millions of subscribers were active mobile broadband subscribers generating over 109.5 million GB of data traffic in the Q2 2020.

Telekom Srbija - MTS is the mobile network operator with the greatest number of subscribers in Serbia. It was founded in 1997 and started to provide mobile communications service in 1998. Telekom Srbija operates its 4G network at 800 MHz and 1800 MHz. Additionally, it operates a 3G network at 900 MHz and 2100 MHz and a 2G network at 900 MHz. In 2019, Telekom Srbija started providing the VoLTE (Voice over LTE) service to its subscribers.

Telenor has been presented in Serbia since 2006, when they bought Mobi63, a former Mobtel that was founded in 1994. Since March 2018, Telenor is owned by PPF investment fund. Telenor operates its 4G network at 800 MHz and 1800 MHz, and partly at 2100 MHz. It operates its 3G network mainly at 900 MHz, with limited additional 2100 MHz coverage, and its 2G network at 900 MHz and 1800 MHz. In 2020 Telenor started providing the VoLTE (Voice over LTE) service to its subscribers.

Vip mobile was established in 2006 and is part of Telekom Austria Group. Vip mobile offers 4G network at 800 MHz and 1800 MHz, 3G network at 2100 MHz and 2G network at 900 MHz and 1800 MHz. In 2019 Vip mobile started providing the VoLTE (Voice over LTE) service to its subscribers.

Telekom Srbija has the largest number of locations with active base stations in Q3 2020, as presented in Figure 4. (Source: RATEL data for Q3 2020, RATEL)

Total number of locations with active base stations, per operator, Q3 2019
Fig. 4. Total number of locations with active base stations, per operator, Q3 2020

 

The total number of active base stations per mobile operator until Q3 2020, is presented in Figure 5. (Source: RATEL data for Q4 2019, Q1 2020, Q2 2020, Q3 2020, RATEL)

Fig. 5. Total number of active base stations per technology and mobile operator until Q3 2020