Our cloud instance started to return tiger backend...
# gooddata-cloudj
Jani Siivola
04/02/2023, 4:36 PMOur cloud instance started to return tiger backend error
{"title":"Internal Server Error","status":500,"detail":"Server-side problem. Contact support.","traceId":"79a14793963b65f7"}b
Boris
04/02/2023, 4:39 PMHi Jani, thanks for reposting it here. Just a few questions:
What action triggered this error?
Are the errors intermittent?
j
Juha-Pekka Laine
04/02/2023, 4:44 PMI am debuggin this with Jani, so I can add some details.
At least loading dashboard in cloud.gooddata.com . Dashboard view loads, but insights display this:
j
Jani Siivola
04/02/2023, 4:45 PMThe endpoint that returns this is
/api/v1/actions/workspaces/<workspace-id>/execution/afm/executeb
Boris
04/02/2023, 4:45 PMthanks for the info, we are investigating the issue
j
Juha-Pekka Laine
04/02/2023, 4:55 PMSo the initial data sync to these workspaces was done earlier today and everything worked fine. For some weeks we have tested the sama data in docker env.
There is a background job that updates the data hourly, but also that has been working on docker without issues as well.
In EU instance we have one workspace with the same setup (but different data) and it is working fine right now.
b
Boris
04/02/2023, 4:58 PMin our logs we can see that there is some issue with the insight computation on our side (only in the US), which confirms the information you've provided.
✔️ 1
Boris
04/02/2023, 5:23 PMwe seemed to have identified the cause of the issue and now working to fix it asap
Boris
04/02/2023, 5:25 PMcould you please confirm that you are able to compute insights now?
j
Juha-Pekka Laine
04/02/2023, 5:35 PMIt doesn´t give the same error anymore, but it says that there is "No data for your filter selection.". Might be something that @Jani Siivola can check. If the data source is correctly set now etc.
b
Boris
04/02/2023, 5:38 PMcould you try to invalidate the cache? https://www.gooddata.com/developers/cloud-native/doc/cloud/connect-data/cache-management/reload-cached-data/#invalidate-cached-data
j
Juha-Pekka Laine
04/02/2023, 5:54 PMI got confirmation that the customer workspace works properly now! Thanks for the prompt investigation and quick resolution!
This was the only issue we faced on todays production testing.
GoodData will be available for our customers tomorrow onwards!
j
Jani Siivola
04/02/2023, 6:06 PMThank you. All good now. “No data for your filter selection” was a dashboard where filters don’t match any data so works as expected
👍 1
Jani Siivola
04/03/2023, 1:44 PMWe are hitting this problem again in both US and EU cloud instances
Jani Siivola
04/03/2023, 1:46 PMand now it works again. Seems like this issue still comes and goes once in a while
b
Boris
04/03/2023, 1:51 PMHi Jani, sorry for the inconvenience, we are checking
👍 1
Boris
04/03/2023, 2:11 PMHi Jani, in the US it was indeed the same issue, we are currently increasing the resources to avoid further issues.
As for the EU, it seems to be different situation, which lasted for only around 3 minutes, and then resolved itself, but we need to look further into it.