Customer required our service for an in-train Measurement Campaign to measure KPI and KQI of Wi-Fi connection and Standard Mobile Connection offered from local OPCO.
All Activity have to be performed in a benchmark way between the 2 National Train Companies.
Working closely with customer’s staff, laroccasolutions performed dedicated measurement sessions and delivered a deep analysis of KQI and KPI requested from customer.
Measurements has been done contemporary with in-train Wi-Fi connection and with standard mobile connection.
In-Train Measurement Benchmark
What We Did
Choose Measurement System, Perfome Measurements
Log-Files Analysis & Reports Production
laroccasolutions performed all measurements with new FOCUS-INFOCOM tools.
A dedicated backpack with 6 mobiles connected plus a standard tablet to setup all script, control mobiles and analyze result in real time.
Moreover, our Customer asked us to measure the differences between using the installed active In-Train Repeater System and without using it.
Basically, our engineers build up an automatic SCRIPT with FOCUS-INFOCOM tools, to measure SIGNAL COVERAGE, INTERFERENCE, THROUGHPUT DL/UL.
Furthermore, thanks to our SAM tool, we measured the customer perspective on YOUTUBE, FACEBOOK, SKYPE & WHATSAPP using a dedicated MOS Algorithm.
Measurements were carried out along the railway route by simultaneously measuring the Mobile Operators, and it were carried out in different time slots in order to have a better statistical results.
In order to evaluate the REAL CUSTOMER EXPERIENCE, particularly BUSINESS, he used a instrumentation based on Android SmartPhone.
The peculiarity of these systems is in fact to be “always connected”, as well as for equipment usually dedicated to business customers (Blackberry, Iphone), thereby reducing the access time to the network and don’t consider the PDP Context Activation.
Statistical analysis of the detected values, in order to improve the margin of error, was carried out using a logarithmic average.
Dedicated E2E measurement, performed per any mobile service operator, was performed using a dedicated terminal that runs through an automated script, voice & call tests interrupted by a break.
All test were made via mobile with a pause of 20 sec, VOICE CALL duration of 60 seconds & DATA TESTs by download an FTP file size of 50Mb continuously with 10s pause between instances.
What is an In-Train Repeater?
In-Train Repeaters are dedicated for operation in trains. They have the function to improve the connection between the mobile phones inside the train with the network operators’ base stations outside. This is necessary due to a very high transmission loss caused by metal coated windows, especially in ICE trains.
Inside an ICE carriage the shielding of the mobile communication signal is approximately 30 dB.
A connection without disturbance and without call drops would only be possible in areas, where the sender and remote performance of the base station as well as of the closeness of the base stations is disproportionately high.
Reports & Analysis
- ATTEMPTS: Number of access to try to Download the reference file
- FAILS: Number of fails to Download the reference file
- DROPS: Number of drop during normal download of the reference file
- COMPLETITION: Number of Completed Download
- SESSION: Average Time to Download the reference file
- Mean DATA RATE:
- Per any TA: Average Real Throughput
- USER per TA: Average Perspective Throughput
- Technology Distribution: Distribution of use by Technology
Perspective Throughput: Essentially it is the effective DL TP perspective from the user without Network Signaling contribution. This particular KPI has been introduced to measure the real USER EXPERIENCE.
- Service Accessibility – Telephony (%) (SA-T%): It is measured as a rate between SCS (Successful Call Attemps) and the CA (Call Attempts);
- CSFR – CALL SETUP FAILURE RATE (%): Percentage of call failed during first Phase of call
- CSS – CALL SETUP SUCCESS RATE (%): Percentage of call correctly connected
- CSR – CALL SUCCESS RATE (%): Percentage of call correctly close
- CDR – CALL DROP RATE (%): Percentage of DROP CALL
- CFR – CALL FAILURE RATE (%): Percentage of FAILED CALL – No connection done
- ST – SETUP TIME: It is measured between as the time between CHANNEL REQUEST & L’ALERTING (Layer 3 Messagges) – Focus Infocom ETSI KPI Trigger Point Specification
- MIN OF SETUP TIME: Minimum SETUP TIME Measured
- MAX OF SETUP TIME: Maximum SETUP TIME Measured
Measurement System Overview
Focus Infocom was the first manufacturer who introduced a smartphone-based benchmark system based called XGMA Smartphone.
The system was the first of its kind that was used in a nationwide operator benchmark test, published by Chip Online, Germany’s largest internet portal for IT.
Currently Focus Infocom provides a full-fledged series of measurement systems based on Android™ smartphones. Focus Infocom Android™ smartphone-based test systems helps to meet customer expectations and deliver system availability and service performance even when it comes to measuring app based QoS performance.