How to Calculate Digital Experience
Digital experience measures how well a website, SaaS platform and network resources perform for users. It considers various metrics impacting the user's experience and combines them into an overall score. This score evaluates the site or application's quality and identifies improvement areas.
What Metrics Are Considered?
To calculate digital experience, we consider several metrics that can negatively affect end users. These include factors such as WiFi Signal, Latency, and Packet Loss, as well as how easily users can access the network and whether they use the correct SSID to connect. By analysing these metrics, we can better understand how well the digital environment performs for users.
How is the Score Calculated?
We start with a perfect score of 100 and subtract from this for any negative factors causing issues. For example, we may deduct points from the overall score if a site has a slow page load time. Similarly, if the site experiences frequent downtime, this can result in a lower score. Considering these factors, we can calculate a comprehensive score that reflects the overall digital experience of the portfolio, a site or even individual occupiers and users. Factors are weighted based on their impact on users. For example, the site being offline will have a much higher impact than failed logins.
Why is Digital Experience Important?
A good digital experience is essential because it directly impacts the satisfaction and loyalty of end users. A poor digital experience can lead to frustration, decreased engagement, and customer loss. By regularly monitoring and improving the digital experience, you can ensure that users have a positive and seamless experience, leading to increased satisfaction and retention.
Note: We continually improve our DX scoring to provide the best data. We may introduce new DX metrics and modify the weighting to ensure we give you the best representation of users' Digital Experiences.
DX Metrics
CIRCUIT LATENCY
NOTE - The Circuit Latency metric is only available at some essensys Cloud locations. It uses hardware installed at the site and in our data centres to measure this metric. We can only provide this data if the hardware is installed at your site. Please take a look at Internet Latency as an alternative metric to use.
What is Circuit Latency?
Circuit latency is the time it takes for a signal to travel from the edge of your site to our data centre and back again. In simpler terms, it is the delay between sending and receiving a signal.
Why is Circuit Latency important to me?
Circuit Latency can significantly affect your overall internet experience. High latency can result in slow loading times, buffering when streaming videos, and delays in online gaming. This can be frustrating and significantly impact your productivity and enjoyment while using the internet.
Circuit Latency can also affect the performance of specific applications and services. For example, if you are using Voice over Internet Protocol (VoIP) or services such as Teams or Zoom for phone calls, high latency can cause delays and disruptions in the call. This can be especially problematic for businesses that rely on VoIP or Video communication.
How do we measure Circuit Latency?
We measure Circuit Latency using dedicated hardware on your site and in our data centre. This allows us to measure and quickly isolate issues on the fibre circuit accurately.
How do we convert Circuit Latency to a score?
To convert to a score, we look at the amount of time that latency goes above thresholds for Poor and Bad.
Poor is > 15ms
Bad is > 30ms
We also score differently depending on whether the high latency period is inside or outside office hours.
CIRCUIT PACKET-LOSS
NOTE - The Circuit Packet-Loss metric is only available at some essensys Cloud locations. It uses hardware installed at the site and in our data centres to measure this metric. We can only provide this data if the hardware is installed at your site. Please take a look at Internet Packet-Loss as an alternative metric to use.
What is Circuit Packet-Loss?
Packet loss is a term used to describe the loss of data packets during transmission over a network. This means that some of the information being sent from the edge of your site to the internet is not reaching its intended destination.
Packet loss means your users' devices must resend information requests, significantly slowing down their experience. This could be better for time-sensitive applications such as video calls.
Why is Circuit Packet-Loss important to me?
Packet loss will result in a generally poor internet experience for users, particularly for time-sensitive applications such as MS Teams, Zoom, or Google Meet. It may also affect VOIP Telephony services.
How do we measure Circuit Packet-Loss?
We measure Circuit Packet Loss using dedicated hardware on your site and in our data centre. This allows us to obtain accurate measurements and quickly isolate issues on the fibre circuit.
How do we convert Circuit Packet-Loss to a score?
To convert to a score, we look at how much time Packet-Loss exceeds thresholds for Poor and Bad.
Poor is > 0%
Bad is > 5%
We also score differently depending on whether the high latency period is inside or outside office hours.
INTERNET LATENCY
NOTE - Internet Latency is available at most essensys sites. Unlike Circuit Latency, it does not require dedicated hardware. Specific network configurations do not support this measurement. If this metric is unavailable, please get in touch with support to find out if it can be turned on for your site.
What is Internet Latency?
Circuit latency is the time it takes for a signal to travel from a device on your network to servers on the Internet and back again. In simpler terms, it is the delay between sending and receiving a signal.
Internet Latency and Circuit Latency are similar metrics but are measured at different points in the network.
Circuit Latency is measured by dedicated hardware and only covers the fibre that goes into your building. It allows us to determine issues occurring with the ISP.
Internet Latency is measured between a Switch on your site and services on the internet. It is likely to be much closer to the figure your users will experience, but it is affected by conditions on your local network and the internet.
Why is Internet Latency important to me?
Internet Latency can significantly affect your overall internet experience. High latency can result in slow loading times, buffering when streaming videos, and delays in online gaming. This can be frustrating and significantly impact your productivity and enjoyment while using the internet.
Internet Latency can also affect the performance of specific applications and services. For example, if you are using Voice over Internet Protocol (VoIP) or services such as Teams or Zoom for phone calls, high latency can cause delays and disruptions in the call. This can be especially problematic for businesses that rely on VoIP or Video communication.
How do we measure Internet Latency?
We measure Internet Latency by regularly sending packets from one of your switches on-site to servers on the Internet and measuring the time it takes to get a response.
How do we convert Internet Latency to a score?
To convert to a score, we look at the amount of time that latency goes above thresholds for Poor and Bad.
Poor is > 50ms
Bad is > 100ms
We also score differently depending on whether the high latency period is inside or outside office hours.
INTERNET PACKET-LOSS
What is Internet Packet-Loss?
This measures packet loss to the Internet, as measured from the switch on site to four different anycast DNS servers. We look for 15-minute blocks with a mean loss above the defined thresholds, with an additional penalty for blocks during business hours. Backup circuits are included in the calculation if the site is in failover. It also measures whatever circuit is active at the time.
Why is Internet Packet-Loss important to me?
Packet loss will result in a generally poor internet experience for users, particularly for time-sensitive applications such as MS Teams, Zoom, or Google Meet. It may also affect VOIP Telephony services.
How do we measure Internet Packet-Loss?
We configure one of the on-site switches to send ping data back and forth to the Internet. This is measured from the switch on site to four different Anycast DNS servers.
How do we convert Internet Packet-Loss to a score?
To convert to a score, we look at how much time Packet-Loss exceeds thresholds for Poor and Bad.
Poor is > 0%
Bad is > 5%
We also score differently depending on whether the high latency period is inside or outside office hours.
SECURE-TO-GUEST WIFI RATIO
What is the Secure-to-Guest Ratio?
The ratio of WiFi guest user sessions to WiFi secure user sessions.
Why is the Secure-to-Guest Ratio important to me?
Users will typically experience higher performance on their dedicated WiFi than on the shared network. A high ratio suggests that too many people are using Guest, and you should encourage them to join WiFi Secure.
How do we measure the Secure-to-Guest Ratio?
We use the WiFi accounting data to track the number of users on guest vs the number of users on secure.
How do we convert Secure-to-Guest Ratio to a score?
To convert to a score, we look at the amount of time that latency goes above thresholds for Poor and Bad.
Poor is > 40%
Bad is > 75%
SITE HARD DOWN
What is Site Hard Down?
Based on the SLA details for the site, we look at the minutes of hard downtime. During this time, there will be
Why is Site Hard Down important to me?
When a site is down, users cannot access the Internet. This can lead to an inferior experience and noise for your support teams.
How do we measure Site Hard Down?
The essensys NOC monitors all sites remotely so that we can accurately measure if a site goes offline.
How do we convert Site Hard Down to a score?
We measure the number of minutes the site is down and convert this to a score based on how long the outage is.
USER ACCESS POINT FLAPPING
What is Access Point Flapping?
User Access Point Flapping occurs when users switch frequently between 2 access points. This usually means they are physically between two access points in the building and are experiencing poor reception from both.
Why is Access Point Flapping important to me?
A high level of Access Point Flapping shows that users are experiencing poor WiFi signal quality and, therefore, a poor digital experience. You may need to look at the layout of your Access Point location to improve the overall signal quality.
How do we measure Access Point Flapping?
We look at the WiFi accounting data to spot users frequently switching between 2 access points.
How do we convert Access Point Flapping to a score?
We use a linear scale to convert the amount of Access Point flapping to a score.
USER FAILED LOGINS
What are User Failed Logins?
Users authenticate to the network using their unique username and password. If the username or password is incorrect, we log this and report the number of failed attempts.
Why is User Failed Logins important to me?
A higher-than-usual failed login may indicate users are having issues logging in. This could be because you have a large number of occupiers onboarding. A very high spike could also indicate a security issue if someone is trying to brute force a password.
How do we measure User Failed Logins?
We log all failed logins and the reason for the failure.
How do we convert User Failed Logins to a score?
We base the score on the count of failures.
USER SESSION FRAGMENTS
What are User Session Fragments?
User session fragments are an indicator of poor signal strength issues. It measures very short sessions on a specific WAP.
Why is User Session Fragments important to me?
A high number of Session Fragments will result in a poor experience for these users. They may have interruptions in a video call or see pages not loading for a short period.
How do we measure User Session Fragments?
We analyse the WiFi accounting data to look for sessions that start and end quickly.
How do we convert User Session Fragments to a score?
We use a linear scale to convert the number of session fragments to a score, with any number greater than 0 contributing to the score
WAP OVER-UTILISATION
What is WAP Over-Utilisation?
Wireless Access Points have a limited capacity, Limited by the wireless frequencies available and the hardware of the Access point. We track how many devices are simultaneously using a single Access Point to determine whether the Access Point is overloaded.
Why is WAP Over-Utilisation important to me?
Overloaded access points will significantly degrade the service for the users connected.
How do we measure WAP Over-Utilisation?
We track devices via the WiFi Accounting data and look for the total number connected at any time.
How do we convert WAP Over-Utilisation to a score?
To convert to a score, we look at the amount of time that latency goes above thresholds for Poor and Bad.
Poor is > 30 devices
Bad is > 40 devices