Settlement/Credit Data – Sandbox/Testing Service Disruption
Incident Date/Time
Start:17 April 2025
End: 24 April 2025 10:26 GMT
Description of Issue
Beginning 17 April 2025 Cybersource identified an issue affecting Settlement/Credit data from Enterprise Business Center (EBC) in our Sandbox/Testing Environment. This led to some merchants experiencing failures for follow-on actions such as Void/Credit for those settlement transactions which were incorrectly displayed in EBC, and as a result, customers were unable to complete their usual test suite. Support teams identified an issue with automated scripts inadvertently running continually within the Sandbox/Testing Environment. The issue was mitigated by blocking automated scripts from running.
Impact
Some merchants may have experienced missing data within the sandbox/testing environment.
Root Cause
Root cause was identified as an automated script being run inadvertently which caused Settlement / Credit data within the Sandbox / testing environment to be stuck in a message queue. The queued message data could not be recovered for forward processing; hence merchants would have had to re-run tests to populate data.
Mitigating and Preventative Actions
To Mitigate, support teams prevented the automated script from running.
To prevent future recurrence, Cybersource plans to:
- Implement rate limits on the usage of CAS environments for customer performance testing.
This was tracked and investigated under incident EPS-32120.