Incident History

09/08/23 10:32PM - RESOLVED: Incident

Duration: 2023-09-08 14:00 UTC

Duration: 2023-09-08 14:00 UTC

Services affected: Data

Scope: Global

Description: This is to notify you that we are experiencing a service disruption related to our ROPDT service that is registration and data communication. The ROPDT engineers continue to troubleshoot the issue and we will provide updates as more information becomes available.

Services affected: ROPDT Data Connectivity

Location: Global

Start Time: 2023-09-08 14:00 UTC

Description: We are seeing a gradual and stable improvement in our UKJ traffic levels. Our graphs show that we already at the normal traffic level (pre outage). UKJ has advised that signalling has now stabilised and that congestion is steadily reducing, but there are still some issues with congestion due to the incident. Some customers can still experience connectivity issues that are pointing to some as yet undefined issues with certain APNs. Our teams are currently focusing on finding resolutions for this. If you are still facing connectivity issues, we suggest a reboot on the device. Please check your connectivity and inform us if you are still seeing issues, by providing details of locations and affected networks, with ICCID.

Services affected: Data Connectivity

Scope: Global

Duration: 30/08/2023 14:30 UTC

Description: We are seeing a gradual and stable improvement in our UKJ traffic levels. Our graphs show that we already at the normal traffic level (pre outage).

Over the past few hours the network engineers have made steady progress to restore full capacity on the network as the traffic backlog clears. They are seeing positive results from our testing and monitoring and we are steadily returning to pre-incident levels.

We maintain a close communication with the Management of the UKJ team to restore everything back to full service.

Services affected: Data Connectivity

Scope: Global

Duration: 30/08/2023 12:00 UTC

Description: We are seeing a gradual but stable improvement in our UKJ traffic levels. Our graphs show that we have about 80% of the traffic recovered. The engineers are monitoring closely but they are still trying to mitigate network congestion as devices come back online. We maintain a close communication with the Management of the UKJ team, trying to recover the traffic as soon as we can.

Services affected: Data Connectivity

Scope: Global

Duration: 30/08/2023 09:30 UTC

Description: Dear customer,

We are seeing a gradual but stable improvement in our UKJ traffic levels. The engineers are monitoring closely but they are still trying to mitigate network congestion as devices come back online. We maintain a close communication with the Management of the UKJ team, trying to recover the traffic as soon as we can. I'm truly sorry for the recent disruption to our data services. We're actively working to fix the issue, and we will be taking steps to make sure it doesn't happen again. If you have any questions or concerns, please don't hesitate to reach out.

Services affected: Data Connectivity

Scope: Global

Duration: 30/08/2023 07:30 UTC

Description: After the previous status update of positive service restoration, the UKJ encountered issues with signaling traffic dropping connections. Engineers and vendors are working together to resume traffic and improve stability.

As such you may still experience a degraded service on connectivity.

Services affected: Data Connectivity

Scope: Global

Duration: 30/08/2023 00:27 UTC

Description: Whilst the principal issues have been fixed, the network continues to remain in recovery mode as engineers throttle connections in order to prevent too much congestion as all of the devices come back online. Services continue to restore, and we are seeing traffic levels recovering towards normal levels. 

We continue in contact with UKJ engineers and they hope to provide an ETA soon.

Services affected: Data Connectivity

Scope: Global

Duration: 2023-08-29 16:00 UTC

Description: Whilst the principal issues have been fixed, the network continues to remain in recovery mode as engineers throttle connections in order to prevent too much congestion as all of the devices come back online. Traffic is recovering gradually and we are continuing to see improvements. We continue in contact with UKJ engineers and they hope to provide an ETA soon.

Services affected: Data Connectivity

Scope: Global

Duration: 2023-08-29 13:30 UTC

Description: Whilst the principal issues have been fixed, the network continues to remain in recovery mode as engineers throttle connections in order to prevent too much congestion as all of the devices come back online. Traffic is recovering gradually and we are continuing to see improvements.

Services affected: Data Connectivity

Scope: Global

Duration: 2023-08-29 11:30 UTC

Description: Further to our previous 'positive' notification, we are seeing some traffic recovery as our network partner carefully brings up the links to restore service. We'll follow-up with more information when we have it.

Services affected: Data Connectivity

Scope: Global

Duration: 2023-08-29 10:00 UTC

Description: We have had some positive news from our discussions with the network supplier. Even though the incident is not resolved, it is moving in the right direction. The original issue, as identified earlier today, which caused this incident has been fixed and that system has been confirmed as stable. This issue centred around the signalling links to the IP core and an equipment change was necessary. Due to the length and complexity of the outage, the network is now in recovery mode. This means that engineers are carefully recovering the links to bring up traffic in a stable manner. They need to do this to manage congestion and avoid serious signalling storms.

Services affected: Data Connectivity

Scope: Global

Duration:2023-08-29 09:00 UTC

Description: Despite measures put in place to restore connectivity, the network is still telling us that there are signalling failures for all inbound and outbound traffic. Our network supplier is liaising with their vendors to cover all bases. We continue to apologise and to push the management of our network partner to provide any further information when they have it. They still do not have an ETA for resolution.

Services affected: Data Connectivity

Scope: Global

Duration: 2023-08-29 08:00 UTC

Description: We have identified issues with UKJ SIMs connectivity. Not all the SIMs are impacted. We have contacted UKJ already and their engineers are working on it with priority already. More updated will be shared as soon as they become available.

Services affected: Data Connectivity

Scope: Global

Duration: 2023-08-28 T19:00 UTC

Description: Planned maintenance

Services affected: Provisioning Services - Platform access

Scope: Global

Duration: 2023-08-29 07:00 UTC

Description: This is to notify you that we are experiencing a degradation related to our Pod IoT Suite platform. Some services are impacted and the access of the IoT Suite platform can be affected during the next 3 to 4h. Our engineers continue to troubleshoot the issue with priority and we will provide updates as more information becomes available.

Services affected: Pod IoT Suite, API, Provisioning

Location: Global

Start time: 25/08/2023 12:40 UTC

08/28/23 09:08AM - RESOLVED: Activation issues on UKJ SIMs

Duration: 2023-08-25 06:00 UTC

Duration: 2023-08-25 T06:00 UTC

Services affected: Provisioning

Scope: Global

06/08/23 05:35AM - RESOLVED: Incident

Duration: 08Jun2023 01:30 UTC

Duration: 08Jun2023 01:30 UTC

Services affected: API

Scope: UKJ Global

Description: Programmed maintenance on UKA infrastructure

Services affected: Data

Scope: GLOBAL

Duration: 2023-05-18 01:00 AM UTC

Description: Planned maintenance.

Services affected: Data sessions

Scope: Global

Duration: 2023-05-04 19:00 UTC