Incident History for Piano

A postmortem has been published for the incident that delayed generation of yesterday's Piano Analytics data.

The Piano Analytics data generation delay has been resolved and all scheduled exports have been sent.

We are continuing to monitor for any further issues after a fix was implemented for the delayed Piano Analytics data.

A fix has been implemented and data recovery is underway, already completed for around 90% of customers.

The scheduled ESP search infrastructure upgrade in the AP and AU regions has been completed.

Scheduled maintenance for ESP search infrastructure in AP and AU regions is currently in progress.

Scheduled maintenance for ESP search infrastructure in AP and AU regions begins in 60 minutes.

SocialFlow automated publishing is resolved; feed content is reaching queues and posting to social networks normally again.

SocialFlow automated publishing is failing, with feed content not reaching queues or posting to social networks; manual posting still works while engineers investigate.

Composer access check errors affecting US and Europe regions have been resolved.

Composer access check errors in US and EU regions are resolved; all affected functionality is fully restored with no further errors observed.

Piano identified access check errors in Composer for US and EU users; the cause is fixed and access checks are restored while monitoring continues.

The incident has been resolved.

A fix has been implemented for data errors in the US region and we are monitoring the results.

Investigating an issue causing missing or outdated personalization data and audience segmentation for US users.

The incident has been resolved.

API availability is improving and expected to fully recover soon; monitoring continues.

Investigating an issue affecting personalized content and audience segmentation in the US environment, causing missing or outdated data.

The incident affecting email and push notification delivery has been resolved.

A fix has been implemented for email and push notification delivery issues, and we are monitoring the results.

The issue has been identified and a fix is being implemented for email and push notification delivery.

Scheduled database maintenance for Piano Subscriptions in the US region has been completed.

Scheduled database maintenance for Piano Subscriptions in the US region is now in progress.

Scheduled database maintenance for Piano Subscriptions in the US region will begin in 60 minutes, affecting multiple components.

Scheduled database maintenance for the EU region has been completed successfully.

Scheduled database maintenance for the EU region is currently in progress, affecting multiple components.

Scheduled database maintenance for the EU region will begin in 60 minutes, affecting multiple components.

The SSL certificate errors affecting Insight access have been resolved.

Piano identified SSL certificate errors affecting Insight access; the certificate has been renewed and the fix verified, with monitoring ongoing.

The scheduled database maintenance for Piano Subscriptions in the AU region has been completed successfully.

Scheduled maintenance is currently in progress for Piano Subscriptions in the AU region, affecting multiple components.

The reports issue affecting all regions has been resolved.

A fix has been implemented for the reports issue affecting all regions, and we are monitoring the results.

We are investigating an issue with report generation affecting all regions.