We’re having an problem loading a specific GoodDat...
# gooddata-cloud
e
We’re having an problem loading a specific GoodData workspace in our US instance. The workspace loads the list of dashboards but then ‘spins forever’ when trying to load individual dashboard content. It seems to be hanging or at least repeating POSTs to https://collector.iad1.prodgdc.com/v1/metrics. This happens for each of the 16 dashboards in the workspace. I’ve checked a handful of other workspaces in that instance, and the dashboards are loading fine. We have another GoodData instance in the EU, and that also seems to be behaving fine. I can share workspace details and a HAR file directly with anyone from GoodData who can help us out.
j
Hi Eoghan, We will definitely look into this. So do I understand correctly that only 1 workspace within your domain is erroring out in this way? Could you please DM me the Workspace ID along with the HAR file?
e
Thanks Julius. This behaviour has only been noted for one workspace, but we have nearly 150 across two customer-facing GoodData instances and I’ve only had the chance to check in about 5 so far.
👍🏼 1
I’ll DM you the details.
j
Hi Eoghan, just to let you know we are still investigating the issue together with our engineers however we haven’t been able to reach a conclusion yet. Did you try some other browser if the result is the same? Additionally do you have any experimental features enabled in the organization?
e
Hi Jan, thanks for letting me know. I just tried with Firefox - same result. We don’t have any experimental features enabled.
j
Hi Eoghan, it looks like the issue was caused by sheduled exports configured on dashboards there were 2 schedules on two different dashboards in some inconsistent state. GET call for
/api/v1/entities/workspaces/{workspaceId}/automations
returned two schedules:
Copy code
[
    {
        "analyticalDashboard": {
            "id": "b555cba6-667c-423e-beb6-225db69cee1f",
            "type": "analyticalDashboard"
        },
        "createdAt": "2024-11-19 14:28",
        "createdBy": {
            "id": "6eabf5e234b301eced1a2b2a47fe5704",
            "type": "user"
        },
        "details": {
            "message": "",
            "subject": ""
        },
        "id": "177d618c-5c77-44c7-8afd-6e89de8b5cec",
        "notificationChannel": {
            "id": "789fdd32-89e2-4083-b482-1c53b2e7d50e",
            "type": "notificationChannel"
        },
        "recipients": [
            {
                "id": "6615e72d8fbf5104b5bc114dbda1bea1",
                "type": "user"
            }
        ],
        "schedule": {
            "cron": "0 0 15 ? * *",
            "firstRun": "2024-11-19T21:00:00Z",
            "timezone": "Etc/UTC"
        },
        "state": "ACTIVE",
        "title": "Test",
        "visualExports": [
            {
                "requestPayload": {
                    "dashboardId": "b555cba6-667c-423e-beb6-225db69cee1f",
                    "fileName": "Project Details & Tasks"
                }
            }
        ]
    },
    {
        "analyticalDashboard": {
            "id": "6558cb24-088f-4c8d-aca9-34ca1f75132c",
            "type": "analyticalDashboard"
        },
        "createdAt": "2024-11-12 15:31",
        "createdBy": {
            "id": "6eabf5e234b301eced1a2b2a47fe5704",
            "type": "user"
        },
        "details": {
            "message": "",
            "subject": ""
        },
        "exportDefinitions": [
            {
                "id": "5876d51e-847f-4b7a-8eed-6d813e587faf",
                "type": "exportDefinition"
            }
        ],
        "id": "2df45647-3f02-4842-a010-921a5789d229",
        "notificationChannel": {
            "id": "789fdd32-89e2-4083-b482-1c53b2e7d50e",
            "type": "notificationChannel"
        },
        "recipients": [
            {
                "id": "6615e72d8fbf5104b5bc114dbda1bea1",
                "type": "user"
            }
        ],
        "schedule": {
            "cron": "0 0 16 ? * *",
            "firstRun": "2024-11-12T21:00:00Z",
            "timezone": "Etc/UTC"
        },
        "state": "ACTIVE",
        "title": "Test"
    }
]
When I removed it by sending an empty array (
[]
) with PUT to the same endpoint to remove the schedules dashboards started loading again. Could you please check on your side?
I will investigate further what can lead to the following inconsistent state. Do you have an idea how the scheduled exports were created on the dashboards (UI or API etc.)?
e
Hi Jan, looks like that fix worked - dashboards are loading for me too
The scheduled exports were setup via the UI
We haven’t used the API or python SDK for that
Please let me know if you discover why the schedules caused a problem - we have at least one customer keen to use the scheduling
And thank you!
j
Hi @Eoghan Bonass I can confirm from the logs that schedules were created through UI and I don’t see any errors or anything unusual. I managed to replicate the issue with loading dashboards updating the schedules with API in my testing env. however I haven’t managed to replicate it when creating schedules through UI and haven’t got a similar issue reported so far. When a schedule is created, there is metadata sync running on the background regarding this feature. This is probably the point where the inconsistency originated. However it seems as a rare race condition. I’ve created internal engineering ticket for further investigation and I’ll update you about results
e
Thanks for the detailed update @Jan Kos - certainly sounds like a one-off, but let us know if there’s more from the investigation.